Software Engineer, Chrome AI Test Infrastructure

Google • San Francisco, CA

3h

About The Position

Google's software engineers develop the next-generation technologies that change
how billions of users connect, explore, and interact with information and one
another. Our products need to handle information at massive scale, and extend
well beyond web search. We're looking for engineers who bring fresh ideas from
all areas, including information retrieval, distributed computing, large-scale
system design, networking and data storage, security, artificial intelligence,
natural language processing, UI design and mobile; the list goes on and is
growing every day. As a software engineer, you will work on a specific project
critical to Google’s needs with opportunities to switch teams and projects as
you and our fast-paced business grow and evolve. We need our engineers to be
versatile, display leadership qualities and be enthusiastic to take on new
problems across the full-stack as we continue to push technology forward.

Our team manages the testing infrastructure for Chrome’s AI features, while
providing the tooling necessary to evaluate and optimize the underlying models.

In this role, you will scale the testing and evaluation infrastructure for
Gemini in Chrome. You will empower the team to build an autonomous,
task-oriented agent directly within the browser. You will be responsible for
developing the "source of truth" for the project—an end-to-end evaluation suite
used to gate releases, benchmark model quality, and provide deep debugging
insights for the broader engineering organization.
Chrome is dedicated to building a better, more open web. We’re focused on making
a better browser (on both desktop and mobile) to help users take advantage of
all the web has to offer in a safe and secure way.Chrome is available across all
major platforms — iOS, Android, Windows, Mac, Linux and Chrome OS. We also built
Chrome as an open source project so the entire web ecosystem could benefit from
the latest innovations in speed, simplicity and security.

Requirements

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with software development in Python.
• 2 years of experience with test infrastructure and internal tooling development.
• 2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture.

Nice To Haves

• Master's degree or PhD in Computer Science or related technical fields.
• 2 years of experience with data structures and algorithms.
• 2 years of working within Generative AI or Agentic AI technologies.
• Experience developing accessible technologies.

Responsibilities

• Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
• Gain a deep understanding of the AI testing and evaluation infrastructure for Chrome.
• Apply debugging and creative thinking skills to find ways to address infrastructure problems in a new and expanding space.
• Review code developed by other engineers and provide feedback to ensure best practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level