Machine Learning System Software Engineer

Apple • Sunnyvale, CA

3h

About The Position

Join Apple’s Apple Neural Engine (ANE) team to develop high-performance, low-power AI solutions for Apple products, including Vision Pro, iPhone, iPad, and Mac. This role focuses on system software technology and offers the opportunity to take on evolving challenges and responsibilities in a creative, collaborative environment.

As the role progresses, the engineer may demonstrate technical leadership, influence key design decisions, collaborate with and support other engineers, and help guide Apple’s AI-driven capabilities across its ecosystem.

Requirements

• Bachelor of Science degree and at least 3 years of relevant industry experience.
• Experience defining interfaces used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility.
• Deep proficiency in C and C++ in large, production system software.
• Understanding of runtime systems, including process and thread models, memory management, IPC/RPC, and resource lifecycle.
• Understanding of software-hardware interfaces, such as registers, DMA, command queues, or similar accelerator interaction patterns.
• Experience shipping production system software.

Nice To Haves

• Experience building or extending ML runtimes, inference engines, or accelerator driver stacks, such as TensorRT, ONNX Runtime, XLA, Metal, or Vulkan compute.
• Familiarity with Swift, Rust, or another memory-safe systems language.
• Familiarity with ML model compilation pipelines and how runtime APIs interact with compiler outputs, such as graph IR and compiled binaries.
• Experience with multi-client runtime scenarios, including arbitrating hardware access, managing priority/QoS, and handling client lifecycle such as connection, disconnection, and crash recovery.
• Knowledge of neural network inference, including operator execution, tensor memory layout, pipelining, and batching strategies.
• Strong communication skills and experience working across team boundaries, including framework, compiler, and hardware teams.

Responsibilities

• Develop system software technologies for high-performance, low-power AI solutions on Apple products.
• Define interfaces used by other teams or external developers, considering lifecycle, error handling, and forward compatibility.
• Collaborate with and support other engineers, and contribute to technical leadership and design decisions as the role evolves.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level