Engineering Program Manager, Siri Evaluation

Apple • Cupertino, CA

1d

About The Position

As an Engineering Program Manager for Siri Evaluation, you will lead programs that build Siri’s evaluation infrastructure, tooling, and automated evaluators. You will drive evaluation programs end to end, from requirements and system architecture through timelines, milestones, and risk management. In partnership with Engineering, Quality Engineering, Design, and Product teams, you will define the evaluation roadmap, align evaluation needs across Siri features, and scale pipelines to keep pace with model and product development.

You will ensure evaluation results are reproducible, trustworthy, and actionable so teams can assess model quality and release readiness with confidence. You will identify gaps in coverage, throughput, and turnaround time and lead efforts to address them. You will communicate timely, objective updates on program status, risks, critical issues and mitigations, plan changes, and requests for action, while bringing teams together to support effective discussions and decisions.

Requirements

• 5+ years of program or project management experience in software development, machine learning, or a related field.
• BS/MS in Computer Science, Engineering, or a related field.
• Solid understanding of system architecture and design trade-offs, with thorough knowledge of testing, build, and release processes for complex software.
• Experience driving and delivering critical project features involving integration with multiple teams.
• Familiarity with ML development workflows, including model evaluation, quality metrics, and data pipelines.
• Proven track record of leading and shipping multiple complex, cross-functional projects at the same time.
• Ability to navigate ambiguity, identify the most critical and urgent work, set priorities, and defend trade-offs.
• Excellent written and verbal communication, including concise status reports and issue summaries.
• Ability to facilitate meetings and adapt messaging for different audiences, including executives.
• Experience working cross-functionally with people at all levels of seniority and leadership.

Nice To Haves

• Experience working with voice assistant technologies.
• Experience evaluating large language models (LLMs) or agentic AI systems, such as through benchmarks, human grading, or automated graders.
• Experience scaling evaluation or testing infrastructure, including distributed pipelines, compute planning, or tooling adoption.

Responsibilities

• Drive evaluation programs end to end, from requirements and system architecture through timelines, milestones, and risk management.
• Define the evaluation roadmap with Engineering, Quality Engineering, Design, and Product teams.
• Align evaluation needs across Siri features and scale pipelines to keep pace with model and product development.
• Ensure evaluation results are reproducible, trustworthy, and actionable for assessing model quality and release readiness.
• Identify gaps in evaluation coverage, throughput, and turnaround time, and lead work to close them.
• Provide timely, objective updates on program status, risks, critical issues and mitigations, plan changes, and requests for action.
• Bring teams together so the appropriate discussions happen and decisions are made.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior