Software Engineer III, Skills Evaluation, Chrome

Google•Kirkland, WA

About The Position

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will enable users, developers, and organizations to safely discover, build, and share high-value AI workflows that act on the web. The team owns the full scope of the Skills in Chrome product, spanning features across Chrome, Gemini, Server, and Evaluations. You will be responsible for building a premier user experience for discovering, creating, and executing Skills that are safe, high-quality, and performant. Chrome is dedicated to building a better, more open web. We’re focused on making a better browser (on both desktop and mobile) to help users take advantage of all the web has to offer in a safe and secure way.Chrome is available across all major platforms — iOS, Android, Windows, Mac, Linux and Chrome OS. We also built Chrome as an open source project so the entire web ecosystem could benefit from the latest innovations in speed, simplicity and security.

Requirements

Bachelor’s degree or equivalent practical experience.
2 years of experience programming in C++, Python, or Kotlin.
1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

Nice To Haves

Master's degree or PhD in Computer Science or related technical fields.
Experience designing, building, and maintaining scalable software platforms, tools, or infrastructure.
Experience with AI model evaluation methodologies, metrics, and pipeline development.
Experience with ML, performance analysis and optimization.
Familiarity with Chrome ecosystem.
Strong analytical, problem-solving, and debugging skills

Responsibilities

Design and implement evaluation pipelines, metrics, and visualization tools, while building automated learning-based testing systems and calibrated auto-raters to improve the efficiency and reliability of evaluation processes.
Implement safety classifiers, conduct adversarial testing, and validate skill performance across various model architectures and browser surfaces, such as AI mode and Gemini in Chrome.
Analyze evaluation results to identify trends and propose data-driven solutions, while collaborating with other AI teams to integrate new use cases and requirements into the framework.
Write high-quality, maintainable code according to Google's best practices, and contribute through active participation in code reviews and design discussions.
Prioritize and manage tasks to ensure the timely delivery of solutions, while contributing to technical documentation and playbooks for the team.