Server ML Frameworks Engineer

Apple • Cupertino, CA

2d

About The Position

Apple’s Server ML Frameworks team in Intelligent System Experience enables Apple Intelligence through high-performance, distributed inference of generative AI applications, such as LLMs, on Private Cloud Compute. The team works with custom-built server hardware that brings Apple silicon’s power and security to the data center.

As a senior technical leader, you will set technical direction and software architecture for frameworks that power Apple Intelligence at scale. You will partner across Apple to propose, develop, and evaluate features in new Apple Intelligence models; collaborate with hardware organizations to influence next-generation silicon design; and help define compute and programming models for future server architectures. You will also grow and mentor engineers, establish engineering best practices, and build cross-functional relationships to deliver complex, multi-team initiatives.

Requirements

• BS, MS, PhD in Computer Science or a related field, or equivalent practical experience.
• 3–5 years of experience as a manager or technical leader.
• Experience with GPU kernel development and optimization using compute programming models such as Metal, CUDA, or similar.
• Experience with distributed training or inference techniques.
• Strong system-level programming skills in C/C++, with a solid understanding of operating systems and computer architecture.

Nice To Haves

• Track record in strategic leadership and decision-making.
• Familiarity with Apple framework and API design patterns.
• Experience with graph compilers such as CuTE, CuTile, Triton, OpenXLA, or LLVM.
• Good understanding of LLM and diffusion-based model architectures.

Responsibilities

• Set the technical direction and software architecture for frameworks powering Apple Intelligence at scale.
• Partner with teams across Apple to propose, develop, and evaluate features in new Apple Intelligence models.
• Collaborate with hardware organizations to influence the design of next-generation silicon.
• Help define compute and programming models for future server architectures.
• Grow and mentor a team of engineers.
• Establish engineering best practices.
• Build cross-functional relationships needed to deliver complex, multi-team initiatives.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior