Systems Engineer - Evaluation Engineering

Apple • Cupertino, CA

1d

About The Position

The Systems Engineer will own infrastructure for the Siri Agentic Evaluation Platform, which supports high-throughput agentic simulations, multi-model judging pipelines, and real-time observability across large volumes of tokens and complex data types. The role involves designing an execution engine to coordinate complex evaluation loops and building systems that are deterministic, fault-tolerant, and cost-efficient while handling massive parallel requests across heterogeneous devices, including iPhones, Macs, and iPads.

Requirements

• Master’s degree in computer science or equivalent.
• At least 7 years of experience as a distributed systems engineer, platform engineer, or equivalent.
• Strong proficiency in concurrency- and enterprise-scale languages such as Python (asyncio) or Java.
• Deep expertise designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI).
• Advanced experience with Kubernetes, including orchestration, custom operators, and service meshes such as Istio or Linkerd.
• Experience with a cloud provider such as AWS, GCP, or Azure.

Nice To Haves

• Strong experience modeling complex relational data and trace hierarchies with PostgreSQL, combined with high-throughput analytical query layers.
• Experience designing asynchronous, event-driven architectures using Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams.
• Experience building Agentic RAG platforms or developer-facing infrastructure tooling.
• Proficiency with Terraform for declarative infrastructure management.
• Experience building automated, containerized deployment pipelines using GitHub or ArgoCD, with an emphasis on fast and reliable developer feedback loops.

Responsibilities

• Own infrastructure powering the core evaluation platform.
• Design the execution engine that coordinates complex evaluation loops.
• Build deterministic, fault-tolerant, and cost-efficient systems for massive parallel requests across heterogeneous device types.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior