Principal ML Platform Engineer

Nvidia • Santa Clara, CA

96d • $272,000 - $425,500

About The Position

NVIDIA is at the forefront of innovations in Artificial Intelligence, High-Performance Computing, and Visualization. Our invention—the GPU—functions as the visual cortex of modern computing and is central to groundbreaking applications from generative AI to autonomous vehicles. We are now looking for an ML Platform Engineer to help accelerate the next era of machine learning innovation. In this role, you will architect, scale, and optimize high-performance ML infrastructure used across NVIDIA's AI research and product teams. Your work will empower scientists and engineers to train, fine-tune, and deploy the most advanced ML models on some of the world's most powerful GPU systems. Join a top team passionate about crafting user-friendly platforms for seamless ML development.

Requirements

• BS/MS in Computer Science, Engineering, or equivalent experience.
• 15+ years in software/platform engineering, including 3+ years in ML infrastructure or distributed compute systems.
• Solid understanding of ML training/inference workflows and lifecycle—from data preprocessing to deployment.
• Proficiency in crafting and operating containerized workloads with Kubernetes, Docker, and workload schedulers.
• Experience with ML orchestration tools such as Kubeflow, Flyte, Airflow, or Ray.
• Strong coding skills in languages such as Python, Go, or Rust.
• Experience running Slurm or custom scheduling frameworks in production ML environments.
• Familiarity with GPU computing, Linux systems internals, and performance tuning at scale.

Nice To Haves

• Experience building or operating ML platforms supporting frameworks like PyTorch, TensorFlow, or JAX at scale.
• Deep understanding of distributed training techniques (e.g., data/model parallelism, Horovod, NCCL).
• Expertise with infrastructure-as-code tools (Terraform, Ansible) and modern CI/CD methodologies.
• Passion for building developer-centric platforms with great UX and strong operational reliability.

Responsibilities

• Design, build, and maintain scalable ML platforms and infrastructure for training and inference on large-scale, distributed GPU clusters.
• Develop internal tools and automation for ML workflow orchestration, resource scheduling, data access, and reproducibility.
• Collaborate with ML researchers and applied scientists to optimize performance and streamline end-to-end experimentation.
• Evolve and operate multi-cloud and hybrid (on-prem + cloud) environments with a focus on high availability and performance for AI workloads.
• Define and monitor ML-specific infrastructure metrics, such as model efficiency, resource utilization, job success rates, and pipeline latency.
• Build tooling to support experimentation tracking, reproducibility, model versioning, and artifact management.
• Participate in on-call support for platform services and infrastructure running critical ML jobs.
• Drive the adoption of modern GPU technologies and ensure smooth integration of next-generation hardware into ML pipelines (e.g., GB200, NVLink, etc.)

Benefits

• Equity and benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Industry: Computer and Electronic Product Manufacturing
• Education Level: Master's degree