About The Position

Apple is seeking a hands-on engineering manager to lead the team responsible for the quality, correctness, consistency, and stability of LLM inference in production. The team builds automation frameworks, evaluation methodology, and qualification strategies to validate models, prompts, serving stacks, and infrastructure changes before they reach users, helping Apple deliver frontier AI while protecting quality, safety, and trust. The manager will lead engineers working across quality engineering, distributed systems, and applied ML evaluation. The team qualifies LLM inference and output-correctness automation frameworks for large-scale AI data center deployment and platform validation, ensuring outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change. The role stays close to architecture, design reviews, and technical trade-offs, and partners with ML, inference/performance, distributed systems, and platform teams across Cupertino, Seattle, and other sites. The manager will hire and develop engineers, shape the team's roadmap, establish quality standards, and represent the team to senior leadership and partners. Success requires technical depth, strong people-management skills, and the ability to navigate ambiguity and the probabilistic, non-deterministic nature of generative outputs.

Requirements

  • 8 or more years of experience in software and/or ML systems development, or equivalent experience.
  • 3 or more years of engineering management experience.
  • A proven track record of delivering complex, large-scale projects across multiple teams or organizations.
  • Experience architecting test, qualification, or evaluation strategy for large-scale distributed systems, ideally ML serving or inference platforms.
  • Hands-on experience with one or more compiled languages such as C, C++, Objective-C, or Swift.
  • Proficiency in a scripting language such as Python.
  • Ability to drive a strategy or project from an initial idea through production, set clear priorities, and deliver on schedule with measurable outcomes.
  • B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.

Nice To Haves

  • Experience with machine learning and LLMs, including practical applications and frameworks such as PyTorch, Hugging Face Transformers, or comparable inference and serving stacks.
  • Familiarity with LLM serving and inference optimization, including batching, KV-cache, quantization, speculative decoding, distributed or multi-accelerator serving, and GPU-accelerated software.
  • Experience using AI or LLMs to improve testing, such as test-case generation, defect detection, or reducing manual QA effort.
  • Experience with CI/CD, Kubernetes, containers, cloud-native systems, and integrating automated evaluations into release pipelines.
  • Experience with observability and distributed tracing for ML systems, such as Splunk, Prometheus, Grafana, LangSmith, or similar tools, and monitoring for model drift.
  • Experience validating agentic workflows, including tool use, function calling, and multi-turn coherence.
  • A track record of hiring, developing, and retaining strong engineers, and leading change across multiple sites.

Responsibilities

  • Lead a team spanning quality engineering, distributed systems, and applied ML evaluation.
  • Build and qualify LLM inference and output-correctness automation frameworks for large-scale AI data center deployment and platform validation.
  • Validate that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change.
  • Stay involved in architecture, design reviews, and technical trade-offs.
  • Partner with ML engineers, inference and performance engineers, distributed systems teams, and platform teams across multiple sites.
  • Hire and develop engineers and shape the team's roadmap.
  • Define quality bars and qualification strategies where they do not yet exist.
  • Represent the team to senior leadership and partners.
  • Drive technical strategy and delivery in an ambiguous, fast-paced environment.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service