Software Development Engineer, Compute Platform

Apple•Seattle, WA

About The Position

People at Apple don't just build products — they craft the kind of experience that has revolutionized entire industries. The diverse collection of our people and their ideas inspire innovation in everything we do. Imagine what you could do here! Join Apple, and help us leave the world better than we found it. The Apple Services Engineering (ASE) team builds and provides systems and infrastructure that power Apple's services (such as iCloud, iTunes, Siri, and Maps). We are the foundation on which Apple's software developers build the products that our customers love. Our services have to scale globally, stay highly available, and "just work." If you love designing, engineering and running systems and infrastructure that will help millions of customers, then this is the place for you! Apple Services Engineering (ASE)'s Compute team is seeking a software engineer comfortable across data and systems to help our batch-focused compute platform make better decisions. The platform runs millions of jobs a day across tens of thousands of hosts and retains a detailed record of how each one behaved. You will turn that record into predictions, optimizations and services the platform can act on, improving both the efficiency of the fleet and the reliability of the workloads that run on it. The work is end to end: you will explore the data, build and validate the model, take it to production, and demonstrate the gains on live clusters. The platform is technically deep, and a prediction only pays off if you understand the systems that will act on it.

Requirements

Strong programming skills in a general-purpose language (Go, Python, C++, or similar), and demonstrated ability to design, debug, and test complex software systems
Working knowledge of distributed systems and operating system fundamentals
Experience instrumenting large-scale infrastructure and analyzing the data it produces — reasoning quantitatively about how CPU, memory, I/O or network consumption behaves and how it scales — and turning that analysis into a decision or a measurable improvement in production
Comfort reasoning quantitatively about production data — distributions and tails, not just averages — and about the risk a wrong estimate creates for a running workload
Track record of owning a project from an ambiguous problem statement through production
Strong communication and organizational skills, including the ability to work directly with customers and to make quantitative results legible and actionable for people who are not data specialists
BS in Computer Science / related fields and 3+ years of experience or MS with 1+ years of experience or PhD

Nice To Haves

Experience building or operating a large-scale compute platform with responsibility for its capacity, efficiency, or performance
Experience improving utilization on a production platform — right-sizing requests from historical usage, oversubscription, bin packing, co-locating batch alongside latency-sensitive work, or reclaiming unallocated capacity. Comparable work on Kubernetes VPA, on runtime or demand prediction feeding an HPC scheduler, or on an in-house equivalent is equally relevant
Experience characterizing workloads at fleet scale, for example grouping jobs into behavioral classes or building the telemetry to do so
Experience shipping a model or heuristic that made automated decisions in production, and owning the outcome
Experience with forecasting, regression, or uncertainty estimation applied to operational time series
Experience modelling how a system's resource consumption scales — for example projecting the network, storage or I/O demand created by growing a compute footprint — and using that to inform capacity or sizing decisions
Experience with Kubernetes / Slurm or a comparable batch scheduling system

Responsibilities

Own features end to end that turn job behavior into decisions the platform acts on — from the initial data analysis through the model or heuristic, the APIs, production serving, and the measurement that proves it worked
Implement your own changes across the stack, from platform services and control plane paths down to node-level resource limits and configuration
Design and run validation in production: shadow mode, staged rollouts, explicit success metrics, and a rollback plan
Have full ownership for the decisions your models make. When a prediction misbehaves, diagnose it, bound the impact, and help fix the system that trusted it
Write and review code, generate and review design documentation
Engage directly with customers and partner teams on their compute needs: understand their workloads, analyze cluster utilization and capacity, and turn that analysis into demand forecasts, node pool configuration and quota decisions that balance customer demand against fleet efficiency
Bring quantitative analysis to open questions across the team — sizing, planning and prioritization decisions where good data changes the answer
Participate in software qualifications and rollouts to production clusters
Participate in an on-call rotation where engineers respond to platform issues for same-day resolution
Work with a wide range of software and hardware engineering teams across Apple to support their workflows or integrate their technology into our platform
Hold yourself and others to a high quality standard expected of Apple products