Group Product Manager, Gemini App, User Intent & Quality

DeepMindMountain View, CA
2d$227,000 - $320,000

About The Position

In this role, you aren't just shipping an app; you are architecting the "Response Quality" standards that will define the AI experience across Google’s multi-billion user ecosystem. While others focus on raw benchmarks, this team wins on the "nuance" of critical user cohorts, transforming Gemini into a trusted, context-aware partner. This is a premier opportunity to lead the shift toward personalized, high-utility alignment that sets the global bar for human-AI collaboration About Us Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority. The Role You will be responsible for the "intelligence and soul" of the Gemini experience. You will define the evaluation frameworks that measure response quality and lead cross-functional efforts to tune the model’s output for Critical User Journeys . This role sits at the high-leverage intersection of DeepMind research and the Gemini App product, directly influencing model behavior by translating complex human needs into the data signals that steer next-generation training runs

Requirements

  • 6+ years of progressive experience in product management, including at least 5 years in senior roles leading consumer products
  • Track record of building consumer products with millions of users that people genuinely love
  • Experience with AI or ML-powered products and a perspective on how AI will change consumer software
  • Comfort with ambiguity and the ability to define product direction in a fast-moving, novel space
  • User-obsessed mindset with a habit of talking to users directly and frequently

Nice To Haves

  • Expertise in User Psychology to articulate why a response feels "right" or "wrong" in context.
  • Data-Obsessed mindset with the ability to find "signal in the noise" within massive evaluation datasets.
  • Quality-First mindset with a high bar for technical ship-readiness.
  • Ability to exercise Strategic Influence across Research, Engineering, and Content teams

Responsibilities

  • Define the Quality Bar: Develop and maintain North Star metrics for Response Quality, defining "helpfulness" across text, code, and multimodal modalities.
  • Cohort-Specific Optimization: Identify the needs of Critical User Cohorts (e.g., power users vs. casual seekers), analyze performance gaps, and prioritize model tuning to address them.
  • Own User Journey Excellence: Ensure the model provides a frictionless, accurate, and delightful experience for the most vital user journeys.
  • Implicit Alignment & Tuning: Partner with Research and Data Operations to steer model outputs through SFT (Supervised Fine-Tuning) and RLHF, translating qualitative feedback into structured data strategies.
  • Evaluation Strategy: Design and scale sophisticated human-in-the-loop and "LLM-as-a-judge" evaluation pipelines to understand model performance in Side-by-Side (SxS) testing.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Manager

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service