Applied AI Engineer, Agent Harness

Apple • Cupertino, CA

8h • Onsite

About The Position

Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world’s most widely used AI assistants. It runs on our next generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, and it is built with privacy from the ground up. We build the harness, the foundation that turns a model into an assistant that can act. This is a systems engineering role for people who understand how large language models behave.

A model can't act on its own. The harness runs the agent loop, carries context and tools to the model, executes the tool calls it makes, and streams results back reliably. It spans models running on device and larger models in Private Cloud Compute. It handles everything from single-turn requests to long multi-step tasks that span apps, survive interruptions, and resume cleanly. We're looking for a strong systems engineer who is fluent in how LLMs behave. The work is real-time and resource-constrained: responses must start fast enough for a voice assistant to feel instant, under tight latency, memory, and power limits on everything from Mac and iPhone to Apple Watch. Failures rarely have a single cause. In a typical week you might track down why a streamed response stalls, make tool calls cancel cleanly when the user interrupts, or replay a failed request to tell whether the model, the context, or the runtime was at fault. Every change to the harness changes how the model behaves, so we measure our work with evals, not just tests. You'll join the team that owns the core runtime and work alongside senior engineers and researchers. You'll also partner closely with the modeling, tools, and context teams and with app and framework teams across Apple. You'll take features from design through production and grow your ownership of the system over time. You'll use agent harnesses every day while building one for an assistant used by hundreds of millions of people.

Requirements

• Bachelor's degree in Computer Science or a related field.
• 2+ years of industry experience.
• Strong programming skills in a systems language such as Swift, C++, Rust, Objective-C, or Go.
• Solid foundation in concurrency, inter-process communication, and performance optimization.
• Hands-on experience building LLM-powered systems (agents, tool calling, prompt/context design) through professional work or substantial personal projects.
• Daily use of agentic coding tools (e.g., Claude Code, Codex, Pi) with informed opinions on harness success/failure.
• Ability to communicate clearly and make progress on ambiguous problems.

Nice To Haves

• Experience with Swift and Apple platform development.
• Experience building agent harnesses, orchestration frameworks, or multi-step tool-use systems.
• Experience with model inference integration, streaming protocols, or latency-sensitive client-server systems.
• Experience using evals to diagnose and improve LLM behavior.
• Experience designing APIs or platforms adopted by other engineering teams.
• Familiarity with privacy and security engineering in production systems.
• Active engagement with current research and practice in agent harness design (context engineering, tool use, long-horizon agents) with a record of turning new ideas into practical improvements.

Responsibilities

• Run the agent loop, carry context and tools to the model, execute tool calls, and stream results back reliably.
• Handle tasks from single-turn requests to long multi-step tasks that span apps, survive interruptions, and resume cleanly.
• Optimize for real-time, resource-constrained environments with tight latency, memory, and power limits.
• Track down issues such as stalled streamed responses or tool call cancellations.
• Replay failed requests to diagnose root causes (model, context, or runtime).
• Measure work with evals to understand how changes affect model behavior.
• Own the core runtime and work alongside senior engineers and researchers.
• Partner with modeling, tools, and context teams, as well as app and framework teams.
• Take features from design through production and grow ownership over time.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level