About The Position
The Intelligence Platform team builds scalable, production-grade systems that power high-quality, user-centric intelligence across Apple’s operating systems. We focus on designing and operating large-scale ML systems leveraging Generative AI, Large Language Models, RAG architectures, and emerging agentic AI patterns. Our goal is to deliver reliable, low-latency, and privacy-preserving AI capabilities at scale. DESCRIPTION We are looking for a Software Engineer with strong systems and engineering expertise to build and scale LLM-powered systems in production. This role focuses on designing robust infrastructure for LLM serving, tool-use orchestration, and agentic workflows. You will work at the intersection of ML and systems engineering—translating advanced AI capabilities into efficient, scalable, and reliable systems. You will play a key role in shaping system architecture, optimizing performance, and ensuring production readiness of LLM-driven features across Apple platforms.
Requirements
- Strong software engineering background with experience building distributed systems or large-scale production services.
- Experience deploying and operating ML/LLM systems in production environments.
- Solid understanding of systems design, performance optimization, and scalability trade-offs.
- Proficiency in programming and building reliable backend systems.
- Familiarity with LLM architectures and inference workflows.
Nice To Haves
- Experience with LLM serving systems, inference optimization, batching strategies, or caching (KV/prefix).
- Experience designing agentic systems, tool orchestration frameworks, or multi-turn pipelines.
- Familiarity with RAG systems, retrieval infrastructure, and vector databases.
- Experience with on-device / hybrid ML systems and constraints (latency, memory, privacy).
- Ability to lead system design discussions and influence architecture decisions across teams.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
