About The Position

Apple is building next-generation AI data center infrastructure for large language model services at scale and seeks a senior engineer to own the correctness, consistency, and stability of LLM inference in production. The engineer will design and build automation frameworks, evaluation methods, and qualification strategies to assess models, prompts, serving stacks, and infrastructure changes before deployment. The role leads qualification of LLM inference and output-correctness automation for large-scale AI data center deployment and platform validation. It includes architecting qualification systems for generative AI, agentic workflows, and tool-using models, and validating output correctness, consistency, and stability as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change. This hands-on AI systems engineering role sits at the intersection of machine learning, distributed systems, and quality engineering. The engineer will write production-quality software in Python, C++, and/or Swift; apply statistical and machine-learning evaluation methods to validate data and model behavior; and build AI-assisted QA tools. The role partners with ML, inference and performance, distributed systems, and platform engineers, and helps define what correct and stable LLM inference means at scale despite generative output's probabilistic nature. It requires working through ambiguity, establishing quality standards, and delivering rigorous results on tight schedules.

Requirements

  • At least 1 year of experience with hardware and/or software development lifecycle processes.
  • At least 1 year of experience in one or more compiled languages, such as C, C++, or Objective-C/Swift.
  • Proficiency in one or more scripting languages, such as Python, Go, or JavaScript.
  • Experience using AI/LLMs to improve testing, such as test-case generation, defect detection, or reducing manual QA effort.
  • Familiarity with LLM serving and inference optimization, including batching, KV-cache, quantization, speculative decoding, and distributed or multi-accelerator serving.
  • Familiarity with GPU-accelerated software.
  • Experience with CI/CD, Kubernetes, containers, and cloud-native systems, including integrating automated evaluations into release pipelines.
  • Experience with machine learning and LLMs, their common practical applications, and commonly used frameworks such as PyTorch, Hugging Face Transformers, or comparable inference/serving stacks.
  • Experience with observability and distributed tracing for ML systems, such as Splunk, Prometheus, Grafana, or LangSmith, and monitoring for model drift.
  • B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, or Computer Science, or equivalent experience.

Nice To Haves

  • 5+ years using one or more scripting languages: Python, Go, or JavaScript.
  • 5+ years of experience working with and building operating systems.
  • 2+ years of experience in LLM testing/development.

Responsibilities

  • Lead qualification of LLM inference and output-correctness automation for large-scale AI data center deployment and platform validation.
  • Architect qualification systems for generative AI, including agentic workflows and tool-using models.
  • Validate that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change.
  • Write production-quality software in Python, C++, and/or Swift.
  • Apply statistical and machine-learning evaluation methods to validate data and model behavior.
  • Build AI-assisted QA tooling to make testing smarter and faster.
  • Partner with ML engineers, inference and performance engineers, distributed systems engineers, and platform teams.
  • Provide quality guidance on defining correctness and stability for LLM inference at scale.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service