AIML - ML Infrastructure Engineer, ML Platform & Technology - ML Compute

Apple • Seattle, WA

70d • $171,600 - $302,200

About The Position

As a Senior/Staff Engineer on the Foundation Model Compute Infra team, you will design and scale the scheduling and orchestration systems that power Apple's large-scale foundation model training and inference workloads across TPU clusters. You will drive innovations in resource management, cluster efficiency, and platform reliability, enabling Apple's next-generation AI models to train and serve at scale.

Requirements

• Bachelors in Computer Science, engineering, or a related field
• 5+ years of hands-on experience in building scalable backend systems for training and evaluation of machine learning models
• Proficient in relevant programming languages, like Python or Go
• Strong expertise in distributed systems, reliability and scalability, containerization, and cloud platforms
• Proficient in cloud computing infrastructure and tools: Kubernetes, Ray, PySpark
• Ability to clearly and concisely communicate technical and architectural problems, while working with partners to iteratively find solutions

Nice To Haves

• Advance degrees in Computer Science, engineering, or a related field
• Proficient in working with and debugging accelerators, like: GPU, TPU, AWS Trainium
• Proficient in ML training and deployment frameworks, like: JAX, Tensorflow, PyTorch, TensorRT, vLLM

Responsibilities

• Lead the design and evolution of the scheduling platform that manages large-scale TPU workloads across multi-region clusters, supporting both training and inference.
• Develop topology-aware and quota-aware schedulers to improve cluster utilization, job latency, and fairness.
• Collaborate with Apple Foundation Model team to integrate advanced distributed computing frameworks (Pathways, Ray, Beam, JetStream) into the platform or expose them as reliable, scalable services.
• Automate complex operational workflows for quota updates, job lifecycle management, and resource provisioning to reduce on-call and dev-ops overhead.
• Mentor engineers and partner across teams to influence the direction of Apple's large-scale distributed compute strategy.

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• A range of discounted products and free services
• Reimbursement for certain educational expenses — including tuition
• Discretionary bonuses or commission payments
• Relocation assistance
• Opportunity to participate in Apple's discretionary employee stock programs

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Computer and Electronic Product Manufacturing
• Education Level: Bachelor's degree