Red Teaming Lead, Responsibility at DeepMind

New York, New York, United States

DeepMind Logo
Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, TechnologyIndustries

Requirements

  • Demonstrated experience running or managing red teaming or novel testing programs, particularly for AI systems
  • A strong, comprehensive understanding of sociotechnical AI risks from recognized systemic risks to emergent risk areas
  • A solid technical understanding of how modern AI models, particularly large language models, are built and operate
  • Strong program management skills with a track record of successfully delivering complex, cross-functional projects
  • Demonstrated ability to work within cross-functional teams, fostering collaboration, and influencing outcomes
  • Ability to present complex technical findings to both technical and non-technical teams, including senior stakeholders
  • Ability to thrive in a fast-paced environment, and an ability to pivot to support emerging needs
  • Demonstrated ability to identify and clearly communicate challenges and limitations in testing approaches and analyses
  • Direct, hands-on experience in safety evaluations and developing mitigations for advanced AI systems (advantage)

Responsibilities

  • Leading and managing the end-to-end responsibility & safety red teaming programme for Google DeepMind
  • Designing and implementing expert red teaming of advanced AI models to identify risks, vulnerabilities, and failure modes across emerging risk areas such as CBRNe, Cyber and socioaffective behaviors
  • Partnering with external red teamers and specialist groups to design and execute novel red teaming exercises
  • Collaborating closely with product and engineering teams to design and develop innovative red teaming tooling and infrastructure
  • Converting high-level risk questions into detailed testing plans, and implementing those plans, influencing others to support as necessary
  • Working collaboratively alongside a team of multidisciplinary specialists to deliver on priority projects and incorporate diverse considerations into projects
  • Communicating findings and recommendations to wider stakeholders across Google DeepMind and beyond
  • Providing an expert perspective on AI risks, testing methodologies, and vulnerability analysis in diverse projects and contexts

Skills

Red Teaming
AI Safety
Risk Assessment
Vulnerability Identification
Machine Learning
Program Management
Team Leadership
Tool Development
Safety Frameworks

DeepMind

Develops artificial general intelligence systems

About DeepMind

This company leads in the field of artificial general intelligence (AGI), with notable applications across healthcare, energy management, and biotechnology. Their work in early diagnostic tools for eye diseases, optimizing energy usage in major data centers, and groundbreaking contributions to protein structure prediction underlines their commitment to harnessing AI for diverse practical applications. The company's dedication to pushing the boundaries of AI technology not only propels the industry forward but also creates a dynamic and impactful working environment for its employees.

London, United KingdomHeadquarters
2010Year Founded
$4.9MTotal Funding
ACQUISITIONCompany Stage
AI & Machine Learning, BiotechnologyIndustries
1,001-5,000Employees

Benefits

Performance Bonus

Risks

Emerging AI models may challenge DeepMind's current strategies.
Backlash against AI models like Gemini poses reputational risks.
Labeling AI-generated content could increase operational complexity for DeepMind.

Differentiation

DeepMind combines AI, ML, and neuroscience for general-purpose learning algorithms.
DeepMind's AlphaFold model advances protein folding research significantly.
GraphCast by DeepMind offers rapid, accurate ten-day weather forecasts.

Upsides

AI-driven drug discovery is set to grow significantly in 2024.
AlphaCode 2 showcases AI's potential in competitive programming.
DeepMind's AI tools are transforming music creation and meteorology.

Land your dream remote job 3x faster with AI