Staff AI Engineer, Multimodal Agentic AI for Glasses

Google•San Jose, CA

1d•$207,000 - $300,000

About The Position

Google’s software engineers develop technologies that help billions of users connect, explore, and interact with information. This role is on a team building the next generation of conversational AI: multimodal, agentic AI solutions for smart glasses that provide proactive, trusted experiences combining voice, streaming vision, and physical-world context. Google’s XR team is working to combine AI with lightweight XR devices such as smart glasses and headsets to deliver personalized, conversational, context-aware experiences that augment human intelligence. As a Staff AI Engineer, you will be a primary technical leader responsible for the architecture, strategy, and execution of multimodal agentic AI solutions for smart glasses. You will set technical direction and lead cross-organizational efforts to build and launch trusted, real-time conversational experiences. The role spans foundational capabilities from early research and architectural definition through production launches, and includes multi-quarter technical strategy, system architecture, model and agent quality, and end-to-end quality across core areas.

Requirements

Bachelor’s degree or equivalent practical experience.
8 years of experience in software development.
7 years of experience leading technical project strategy, ML design, and end-to-end machine learning optimization, such as model deployment, model evaluation, data processing, debugging, and fine-tuning.
5 years of experience in one or more of speech/audio, reinforcement learning, ML infrastructure, or another ML specialization.
5 years of experience with design and architecture, and testing and launching software products.
Experience with Generative AI.

Nice To Haves

Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
5 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional or cross-business projects.
Experience with Multimodal Machine Learning.
Experience with large-scale infrastructure.

Responsibilities

Lead complex, ambiguous, high-impact AI initiatives from early research and architectural definition through flagship production launches.
Own multi-quarter technical strategy, system architecture, and end-to-end quality across multiple core pillars.
Improve model and agent quality through data strategy, evaluation frameworks, system prompting, skill and tool use, agent harnesses, and model post-training.
Architect and scale multi-turn, goal-oriented agentic workflows for real-world task assistance, including fact-grounded sourcing, plan decomposition, persistent context tracking, and multi-session continuity.
Define and execute end-to-end strategies for data curation, automated evaluation, system prompting, agent configuration, and post-training of Gemini models across smart glasses use cases.
Address smart glasses use cases including real-time visual grounding, spatial and contextual state reasoning, and proactive multimodal interaction.