AIML - Sr Data Scientist, Evaluation
About The Position
Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? Within the evaluation organization, the mission of Data Science and Insights team is to guide product development, decisions and directions through principled evaluation and rigorous use of data. You will partner with various engineering teams to improve search quality and guide feature development with data, to deliver amazing search experiences across iPhone, iPad, HomePod, Mac, Watch, tv, across dozens of languages. Research and develop evaluation methods to improve the quality of Siri's user facing products. Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that Siri engineering will use every day. Work with large, complex data sets. Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed. Conduct analysis that includes data gathering and requirements specification, processing, analysis, ongoing work, and presentations. Build and prototype analysis pipelines iteratively to provide insights at scale. Develop comprehensive knowledge of Siri Search data structures and metrics, advocating for changes where needed for product development. Partner closely with Siri search engineering teams on core machine learning algorithms and systems that are part of Siri's ability to understand and respond to requests. You should be passionate about building outstanding products. This position involves a wide variety of skills and innovation.
Requirements
- Hands-on experience with online AB testing platform. Experience designing, analyzing and interpreting experiments.
- Hands-on experience with on-device logging and metrics development.
- Experience with large language models, leveraging LLM for evaluation and product improvement.
- Ph.D. in machine learning, computer science, statistics, operations research or related areas.
- 8 years of relevant work experience.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Computer and Electronic Product Manufacturing
Education Level
Ph.D. or professional degree
Number of Employees
5,001-10,000 employees
