Red Teaming Lead, Responsibility

Snapshot

This role works with sensitive content or situations and may be exposed to graphic, controversial, and/or upsetting topics or content.

As Red Teaming Lead in Responsibility at Google DeepMind, you will be working with a diverse team to drive and grow red teaming of Google DeepMind's most groundbreaking models. You will be responsible for our frontier risk red teaming program, which probes for and identifies emerging model risks and vulnerabilities. You will pioneer the latest red teaming methods with teams across Google DeepMind and external partners to ensure that our work is conducted in line with responsibility and safety best practices, helping Google DeepMind to progress towards its mission.

About us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The role

As a Red Teaming Lead working in Responsibility, you'll be responsible for managing and growing our frontier risk red teaming program. You will be conducting hands-on red teaming of advanced AI models, partnering with external organizations on red teaming exercises, and working closely with product and engineering teams to develop the next generation of red teaming tooling. You'll be supporting the team across the full range of development, from running early tests to developing higher-level frameworks and reports to identify and mitigate risks.

Key responsibilities

• Leading and managing the end-to-end responsibility & safety red teaming programme for Google DeepMind.
• Designing and implementing expert red teaming of advanced AI models to identify risks, vulnerabilities, and failure modes across emerging risk areas such as CBRNe, Cyber and socioaffective behaviors.
• Partnering with external red teamers and specialist groups to design and execute novel red teaming exercises.
• Collaborating closely with product and engineering teams to design and develop innovative red teaming tooling and infrastructure.
• Converting high-level risk questions into detailed testing plans, and implementing those plans, influencing others to support as necessary.
• Working collaboratively alongside a team of multidisciplinary specialists to deliver on priority projects and incorporate diverse considerations into projects.
• Communicating findings and recommendations to wider stakeholders across Google DeepMind and beyond.
• Providing an expert perspective on AI risks, testing methodologies, and vulnerability analysis in diverse projects and contexts.

About you

In order to set you up for success in this role, we are looking for the following skills and experience:

• Demonstrated experience running or managing red teaming or novel testing programs, particularly for AI systems.
• A strong, comprehensive understanding of sociotechnical AI risks from recognized systemic risks to emergent risk areas.
• A solid technical understanding of how modern AI models, particularly large language models, are built and operate.
• Strong program management skills with a track record of successfully delivering complex, cross-functional projects.
• Demonstrated ability to work within cross-functional teams, fostering collaboration, and influencing outcomes.
• Ability to present complex technical findings to both technical and non-technical teams, including senior stakeholders.
• Ability to thrive in a fast-paced environment, and an ability to pivot to support emerging needs.
• Demonstrated ability to identify and clearly communicate challenges and limitations in testing approaches and analyses. 

In addition, the following would be an advantage:

• Direct, hands-on experience in safety evaluations and developing mitigations for advanced AI systems.
• Experience with a range of experimentation and evaluation techniques, such as human study research, AI or product red-teaming, and content rating processes.
• Experience working with product development or in similar agile settings.
• Familiarity with sociotechnical and safety considerations of generative AI, including systemic risk domains identified in the EU AI Act (chemical, biological, radiological, and nuclear; cyber offense; loss of control; harmful manipulation).

The US base salary range for this full-time position is between $174,000 - $258,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

Note: In the event your application is successful and an offer of employment is made to you, any offer of employment will be conditional on the results of a background check, performed by a third party acting on our behalf. For more information on how we handle your data, please see our Applicant and Candidate Privacy Policy.

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunities regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.