Engineering Analyst, Trust and Safety Responsible AI Testing

Key Skills

Aartificial intelligence, C++, Cyber Security, Data Analytics, Effective communication skills, Large Language Models - LLMs, Presentation skills, Python Programming, R Programming, SQL

Job Description

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 7 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
• 7 years of experience managing projects and defining project scope, goals, and deliverables.
• 7 years of experience with one or more of the following languages: SQL, R, Python, or C++.
• 5 years of experience working in a Trust and Safety Operations, data analytics, cybersecurity, or other related environment.

Preferred qualifications:

• Master's degree or PhD in a quantitative or engineering field.
• Experience in designing and conducting experiments or quantitative research, in a technology or AI context.
• Experience working with Large Language Models, LLM Operations, prompt engineering, pre-training, and fine-tuning.
• Understanding of AI systems, machine learning, and their potential risks.
• Excellent problem-solving and critical thinking skills with attention to detail and the ability to think strategically and identify emerging threats and vulnerabilities.
• Excellent communication and presentation skills and the ability to influence cross-functionally at various levels.

About the job

Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.

As an Engineering Analyst within the Trust and Safety Responsible AI Testing Team, you will be part of a global team that drives One Google solutions for industry-leading responsible AI applications.

You will focus on the broad spectrum safety, and neutrality risks and prioritize close partnerships with colleagues in Google Deep Mind (GDM) to design and develop solutions to further Google’s ability to prevent abuse on GDM base models.

You will blend your domain expertise in safety policy and GenAI testing processes with technical acumen in experimental design, data science, and engineering experience to drive solutions to challenges, with the ultimate impact of improving user safety in GenAI products.

At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.

Responsibilities

• Drive structured and unstructured testing of novel model modalities and capabilities, collaborating with Google DeepMind.
• Lead platform and tooling development, designing engineering solutions and prompt generation strategies, leveraging Large Language Models (LLMs) to improve adversarial testing and bridge technical constraints.
• Define and ensure adherence to testing and safety standards in collaboration with cross-functional teams, including policy and engineering.
• Perform analyses, develop insights for model and product-level safety mitigations, and influence safety initiatives across Product, Engineering, Research, and Policy. Act as a key advisor to leadership on complex safety issues and represent Google's AI safety efforts externally.
• Be exposed to graphic, controversial, or upsetting content.