Research Scientist, SAMBA, DeepMind

Google•New York, NY

9h•$207,000 - $300,000

About The Position

As a Research Scientist on the Sociotechnical Analysis of Model Behavior (SAMBA) team in the Responsible Research Group (R2), you will conduct research on model behaviors that impact people and society. You will design tools and methods for measuring AI’s impact on society, design experiments, and develop measures to characterize model properties relevant to responsibility and safety. You will collaborate closely with Research Scientists and Research Engineers to build frontier evaluations, apply them in practice, and publish results. The role is part of a specialized Responsibility team within Google. Although its reporting structure sits within Google’s broader Trust & Safety organization, the team’s work remains deeply integrated with DeepMind.

Requirements

PhD in Computer Science, Economics, Computational Social Science, Data Science, Political Science, or a related field, or equivalent practical experience.
At least 2 years of experience with statistical concepts, data analysis, and visualization.
At least 2 years of experience with programming languages such as R or Python, relevant libraries such as Pandas, NumPy, or Scikit-learn, or other scripting languages.
At least 2 years of experience with AI evaluation.

Nice To Haves

Experience creating AI evaluations or benchmarks.
Advanced understanding of statistical concepts and ability to perform data analysis and visualization.
Excellent communication and collaboration skills, including the ability to work with researchers from varied backgrounds and communicate through research publications, policy briefs, or presentations for technical and non-technical audiences.
Peer-reviewed publication on AI auditing or evaluation, especially related to societal impact.

Responsibilities

Identify new research areas and questions.
Design and conduct research and experiments.
Develop and test new metrics and measures.
Perform data analysis to synthesize and visualize research findings and evaluation results.
Lead writing results for research publications.