Technical Program Manager, AI2, TPU Software

Google•Sunnyvale, CA

2d•$192,000 - $278,000

About The Position

Google is seeking a Technical Program Manager for the Core ML Program Management Office to drive strategy and execution for the TPU ecosystem. The role focuses on scaling production-grade inference and training infrastructure across Jax and PyTorch frameworks and establishing price-performance and total cost of ownership leadership for frontier AI models. The work includes qualifying next-generation TPU hardware, advancing distributed orchestration for agentic workloads and tiered KV-cache management, and expanding support for multimodal, diffusion, physical AI, and world models. The role also fosters developer velocity by automating model onboarding pipelines and optimizing specialized kernel libraries. As a Technical Program Manager at Google, you will lead complex, multidisciplinary projects from start to finish, working with stakeholders to plan requirements, identify risks, manage schedules, and communicate with cross-functional partners. You will explain analyses and recommendations to executives and discuss technical tradeoffs with engineers. The AI and Infrastructure team delivers AI and infrastructure at scale, efficiency, reliability, and velocity for Googlers, Google Cloud customers, and Google users worldwide.

Requirements

Bachelor's degree in a technical field, or equivalent practical experience.
8 years of experience in program management.
Experience with artificial intelligence/machine learning projects, tools, or infrastructure.

Nice To Haves

8 years of experience managing cross-functional or cross-team projects.
Experience with Jax and PyTorch frameworks, OSS models like Qwen and GLM, and inference stacks like vLLM and SGLang.
Experience running production-facing large-scale software programs.

Responsibilities

Develop and execute end-to-end program strategies for complex ML infrastructure, covering scope, resource planning, risk management, and roadmap delivery.
Partner with cross-functional engineering, product, and research teams to define technical milestones and prioritize key platform capabilities.
Drive execution across workstreams, proactively identifying dependencies, mitigating risks, and maintaining alignment on schedules and critical path items.
Provide clear, concise updates and strategic recommendations to leadership and executive stakeholders to align on technical priorities and decisions.
Ensure production readiness and quality standards for hardware/software deployments, supporting large-scale developer adoption and workload efficiency.