Research Scientist, SAMBA, DeepMind

Google•New York, NY

2d•$207,000 - $300,000

About The Position

As a Research Scientist on the Sociotechnical Analysis of Model Behavior (SAMBA) team in the Responsible Research Group (R2), you will conduct research on model behaviors that impact people and society. You will design tools and methods for measuring the impact of AI on society, design experiments, and develop measures to characterize model properties relevant to responsibility and safety. You will collaborate closely with other Research Scientists and Research Engineers to build frontier evaluations, apply them in practice, and publish results. The position is part of a specialized Responsibility team within Google. Its reporting structure sits within Google's broader Trust and Safety organization, while its work remains deeply integrated with Google DeepMind.

Requirements

PhD in Computer Science, Economics, or a related field, or equivalent practical experience.
At least 5 years of experience with statistical concepts, data analysis, and visualization.
At least 5 years of experience with programming languages such as R or Python, relevant libraries such as Pandas, NumPy, or Scikit-learn, or other scripting languages.
At least 2 years of experience with AI evaluation.
At least 2 years of experience working with industry codebases.

Nice To Haves

Experience creating AI evaluations or benchmarks.
Advanced understanding of statistical concepts and ability to perform data analysis and visualization.
Excellent communication and collaboration skills, including the ability to communicate and work with researchers from varied backgrounds through research publications, policy briefs, or presentations for technical and non-technical audiences.
Peer-reviewed publication on AI auditing or evaluation, especially related to societal impact.

Responsibilities

Identify new research areas and questions.
Design and conduct research and experiments.
Develop and test new metrics and measures.
Perform data analysis to synthesize and visualize research findings and evaluation results.
Lead writing results for research publications.