Machine Learning Engineer, Foundation Model Services

Apple • Santa Clara, CA

7d

About The Position

Do you feel you think differently, are eager to break the status quo, are bold and ambitious, aren’t afraid to take risks and are passionate about building the best-of-class technology? If yes, what better place to be at and do this than Apple? At Apple, “we think different, we push the boundaries of computing and intelligence. We build products that bring smiles to people’s faces”. The Foundation Model Services team, within the Machine Learning Platform Technologies organization, is the backbone of Apple Intelligence. It builds frameworks, services, and tools that power the largest Apple foundation models on servers. Our infrastructure powers a wide gamut of services at Apple including Apple Search, Apple Music, Apple TV, App Store, iMessages, Photos & Camera, Spotlight, Safari, Siri, and upcoming ever-exciting Apple products serving millions of queries every day with incredible low latencies, drawing every ounce of compute from our hardware. As part of this group, you will get a chance to bring Intelligence to billions of users across the world. You will have an opportunity to make a difference in the lives of people. You will have a chance to work on optimizing billions of parameter language and vision and speech models using state-of-the-art technologies and make it run at the scale of Apple.

Requirements

• 5 year+ industry experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics).
• Experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Proficient in building and maintaining systems written in modern languages (eg: Golang, python).
• Bachelor’s degree or higher in Computer Science or related technical field.

Nice To Haves

• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.
• Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

Responsibilities

• Work closely with product teams to build production-grade solutions to launch models serving millions of customers in real time.
• Work alongside the Foundation Model Research team to prototype and develop inference for cutting-edge model architectures.
• Build tools to understand bottlenecks in Inference for different hardwares and use cases.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior