Staff Software Engineer, Cloud ML Compute Services

Google•Kirkland, WA

2d•$207,000 - $300,000

About The Position

Google Cloud software engineers develop technologies that help users connect, explore, and interact with information. This role works on projects critical to Google Cloud, anticipating customer needs, taking ownership, innovating, and addressing technical challenges across the stack. The Cloud ML Compute Services team is building next-generation on-premise AI infrastructure for AI solution builders. The team designs integrated systems spanning hardware, software, and workload management to optimize large-scale training and inference workloads. Its mission is to enable seamless production operations and provide comprehensive visibility into the hardware health of Google's global fleet. The role will help build a new product and shape AI acceleration, cluster interconnects, and networking. Individual pay is determined by job-related skills, experience, and relevant education or training. The US salary range is $207,000–$300,000, with a 20% bonus target, equity, and benefits.

Requirements

Bachelor's degree or equivalent practical experience.
8 years of experience programming in C++.
5 years of experience testing and launching software products.
5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
3 years of experience with software design and architecture.

Nice To Haves

Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional or cross-business projects.

Responsibilities

Set the strategic direction and technical roadmap for scalable, next-generation on-premise AI infrastructure and compute services.
Guide the design and development of complex cloud and systems-level infrastructure across the hardware and software stack, including low-level software, operating systems, firmware, and networking.
Provide technical leadership on a newly formed team, mentor and grow software engineers, and scope ambitious, ambiguous problems into tractable projects.
Define and implement success metrics, integrating service level objectives (SLOs), telemetry, and logs to support seamless production operations and continuous improvement.
Own system troubleshooting and diagnostics, lead specialized efforts to resolve complex technical issues, and build automated repair systems for the global fleet.