Engineering Program Manager, Siri Evaluation

Apple • Cupertino, CA

1d

About The Position

As an Engineering Program Manager for Siri Evaluation, you will lead programs that build Siri’s evaluation infrastructure, tooling, and automated evaluators. You will drive evaluation programs end to end, from requirements and system architecture through timelines, milestones, and risk management. In partnership with Engineering, Quality Engineering, Design, and Product teams, you will define the evaluation roadmap, align evaluation needs across Siri features, and scale pipelines to keep pace with model and product development.

You will help ensure evaluation results are reproducible, trustworthy, and actionable so teams can assess model quality and release readiness with confidence. You will identify gaps in coverage, throughput, and turnaround time, and lead efforts to address them. You will provide timely, objective updates on program status, risks, critical issues and mitigations, plan changes, and requests for action, while bringing teams together to support effective discussions and decisions.

Requirements

• At least 5 years of program or project management experience in software development, machine learning, or a related field.
• Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.
• Solid understanding of system architecture and design trade-offs.
• Thorough knowledge of testing, build, and release processes for complex software.
• Experience driving and delivering critical project features involving integration with multiple teams.
• Familiarity with machine learning development workflows, including model evaluation, quality metrics, and data pipelines.
• Proven track record leading and shipping multiple complex cross-functional projects at the same time.
• Ability to navigate ambiguity, identify critical and urgent work, set priorities, and defend trade-offs.
• Excellent written and verbal communication, including concise status reports and issue summaries.
• Ability to facilitate meetings and tailor messaging to different audiences, including executives.
• Experience working cross-functionally with people at all levels of seniority and leadership.

Nice To Haves

• Experience working with voice assistant technologies.
• Experience evaluating large language models (LLMs) or agentic AI systems, such as through benchmarks, human grading, or automated graders.
• Experience scaling evaluation or testing infrastructure, including distributed pipelines, compute planning, or tooling adoption.

Responsibilities

• Lead Siri evaluation programs from requirements and system architecture through timelines, milestones, and risk management.
• Partner with Engineering, Quality Engineering, Design, and Product teams to define the evaluation roadmap and align evaluation needs across Siri features.
• Scale evaluation pipelines to keep pace with model and product development.
• Ensure evaluation results are reproducible, trustworthy, and actionable for assessing model quality and release readiness.
• Identify gaps in evaluation coverage, throughput, and turnaround time, and lead work to close them.
• Communicate timely, objective updates on program status, risks, critical issues and mitigations, plan changes, and requests for action.
• Bring teams together to facilitate discussions and decisions.
• Drive and deliver critical project features involving integration with multiple teams, and lead multiple complex cross-functional projects simultaneously.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level