Staff Software Engineer, Emerging On-Prem AI Infrastructure

Google•Sunnyvale, CA

4d•$207,000 - $300,000

About The Position

Google is building the next generation of on-premises AI infrastructure to empower frontier model and AI solution builders. The role involves developing integrated AI infrastructure spanning hardware and software design, workload management, large-scale training and inference workloads, and performance optimization. The engineer will build a new product in a changing environment rather than simply evolve an existing one. The position is part of Google's AI and Infrastructure team, which delivers AI and infrastructure capabilities at scale, efficiency, reliability, and velocity for Google employees, Google Cloud customers, and Google users. The work supports Google's AI models, global services, and developer platforms, across areas including hyperscale computing, TPUs, Vertex AI, networking, data center operations, and systems research.

Requirements

Bachelor's degree or equivalent practical experience.
8 years of experience programming in C++.
5 years of experience testing and launching software products.
5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
3 years of experience with software design and architecture.

Nice To Haves

Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
Experience with or passion for building deep system skills.
Experience with large-scale fleet operations.
Understanding of low-level system software, operating systems, firmware, low-level networking, or hardware.

Responsibilities

Drive project success by setting technical goals and roadmaps.
Mentor software engineers on the team.
Deliver features in a changing environment while working with other Google product areas and teams.
Scope bold, ambiguous problems into tractable projects and deliver results incrementally.
Design and lead development of test infrastructure.
Take central responsibility for diagnostics and troubleshooting of end-to-end supportability issues, uncovering and addressing complex technical problems, and building solutions such as tools and repair automation systems.
Implement and drive continuous improvement using team success metrics, including release-quality metrics and customer-facing operations.