Apple Services Engineering is building a scientific foundation for evaluating LLMs, agentic systems, and human-AI interaction. The team develops rigorous, scalable evaluation methods that help teams determine what to measure, whether a change helped, why a system failed, and whether it is ready to ship. The Applied Scientist will help build self-service evaluation tools, SDKs, and AI-powered capabilities that enable engineers across Apple to evaluate AI features independently, quickly, and correctly. The role develops methods that improve evaluation quality and help engineers interpret results and determine next steps. When an appropriate method does not exist, the scientist will extend existing research or develop new methods, then share findings through publications and internal research reports. Working with measurement scientists, ML researchers, platform engineers, and research engineers, the scientist will co-develop methods, ensure tools provide valid and trustworthy signals, and bring difficult problems into the team's research agenda. The role also defines the assumptions, failure modes, and validation tests needed for methods to work reliably without expert oversight and to be incorporated into evaluation SDKs and APIs used across Apple. The successful candidate applies scientific depth and practical judgment to method selection, experiment design, diagnosis on real-world data, and clear communication of what evaluation results do and do not support.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Education Level
Ph.D. or professional degree