Red Teaming Lead, Responsibility

Snapshot

This role works with sensitive content or situations and may be exposed to graphic controversial and/or upsetting topics or content.

As Red Teaming Lead in Responsibility at Google DeepMind you will be working with a diverse team to drive and grow red teaming of Google DeepMinds most groundbreaking models. You will be responsible for our frontier risk red teaming program which probes for and identifies emerging model risks and vulnerabilities. You will pioneer the latest red teaming methods with teams across Google DeepMind and external partners to ensure that our work is conducted in line with responsibility and safety best practices helping Google DeepMind to progress towards its mission.

About us

Artificial Intelligence could be one of humanitys most useful inventions. At Google DeepMind were a team of scientists engineers machine learning experts and more working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery and collaborate with others on critical challenges ensuring safety and ethics are the highest priority.

The role

As a Red Teaming Lead working in Responsibility youll be responsible for managing and growing our frontier risk red teaming program. You will be conducting hands-on red teaming of advanced AI models partnering with external organizations on red teaming exercises and working closely with product and engineering teams to develop the next generation of red teaming tooling. Youll be supporting the team across the full range of development from running early tests to developing higher-level frameworks and reports to identify and mitigate risks.

Key responsibilities

• Leading and managing the end-to-end responsibility & safety red teaming programme for Google DeepMind.
• Designing and implementing expert red teaming of advanced AI models to identify risks vulnerabilities and failure modes across emerging risk areas such as CBRNe Cyber and socioaffective behaviors.
• Partnering with external red teamers and specialist groups to design and execute novel red teaming exercises.
• Collaborating closely with product and engineering teams to design and develop innovative red teaming tooling and infrastructure.
• Converting high-level risk questions into detailed testing plans and implementing those plans influencing others to support as necessary.
• Working collaboratively alongside a team of multidisciplinary specialists to deliver on priority projects and incorporate diverse considerations into projects.
• Communicating findings and recommendations to wider stakeholders across Google DeepMind and beyond.
• Providing an expert perspective on AI risks testing methodologies and vulnerability analysis in diverse projects and contexts.

About you

In order to set you up for success in this role we are looking for the following skills and experience:

• Demonstrated experience running or managing red teaming or novel testing programs particularly for AI systems.
• A strong comprehensive understanding of sociotechnical AI risks from recognized systemic risks to emergent risk areas.
• A solid technical understanding of how modern AI models particularly large language models are built and operate.
• Strong program management skills with a track record of successfully delivering complex cross-functional projects.
• Demonstrated ability to work within cross-functional teams fostering collaboration and influencing outcomes.
• Ability to present complex technical findings to both technical and non-technical teams including senior stakeholders.
• Ability to thrive in a fast-paced environment and an ability to pivot to support emerging needs.
• Demonstrated ability to identify and clearly communicate challenges and limitations in testing approaches and analyses.

In addition the following would be an advantage:

• Direct hands-on experience in safety evaluations and developing mitigations for advanced AI systems.
• Experience with a range of experimentation and evaluation techniques such as human study research AI or product red-teaming and content rating processes.
• Experience working with product development or in similar agile settings.
• Familiarity with sociotechnical and safety considerations of generative AI including systemic risk domains identified in the EU AI Act (chemical biological radiological and nuclear; cyber offense; loss of control; harmful manipulation).

The US base salary range for this full-time position is between $174000 - $258000 bonus equity benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

Note: In the event your application is successful and an offer of employment is made to you any offer of employment will be conditional on the results of a background check performed by a third party acting on our behalf. For more information on how we handle your data please see our Applicant and Candidate Privacy Policy.

At Google DeepMind we value diversity of experience knowledge backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunities regardless of sex race religion or belief ethnic or national origin disability age citizenship marital domestic or civil partnership status sexual orientation gender identity pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation please do not hesitate to let us know.