Staff Software Engineer, AI/ML
About The Position
Google Cloud software engineers develop technologies that help users connect, explore, and interact with information. In this role, you will work on projects critical to Google Cloud, anticipate customer needs, take ownership, innovate, and apply leadership and versatility to problems across the full stack. The JAX Training Experience team makes distributed LLM training on Google Cloud easy, scalable, and performant. The team is responsible for MaxText, Google's open-source library of performant JAX implementations of LLMs, and collaborates with other teams to optimize workloads on Google Cloud CPUs, GPUs, and TPUs. The team is part of the ML@Scale team in the CBS/CoreML organization. The AI and Infrastructure team delivers AI and infrastructure capabilities at scale, efficiency, reliability, and velocity for Googlers, Google Cloud customers, and Google users worldwide. Its work includes AI models, computing infrastructure, developer platforms, TPUs, Vertex AI, global networking, data center operations, and systems research.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 2 years of experience with applied machine learning, including model development and deployment.
- Experience with large language models (LLMs), NLP, or generative AI.
Nice To Haves
- Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
- 8 years of experience with data structures and algorithms.
- 3 years of experience in a technical leadership role leading project teams and setting technical direction.
- Experience optimizing machine-learning workloads running on CPUs, GPUs, or TPUs.
Responsibilities
- Help make MaxText the best pre- and post-training solution for TPUs on Google Cloud.
- Implement LLM modeling and scaling techniques in MaxText, including multimodal, Physical AI, and world models.
- Build and support JAX and its ecosystem to benefit Google Cloud customers.
- Support new accelerator introductions, including TPUs and GPUs, on Google Cloud, and support MLPerf submissions demonstrating cutting-edge technologies for Gen AI workloads at scale.
- Work closely with product managers and partner teams to deliver high-quality software products and features throughout their lifecycle.
Benefits
- 20% bonus target
- Equity
- Benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
