AIML - Sr Machine Learning Engineer, Modeling Evaluation & Data

Apple • Cupertino, CA

7h

About The Position

At Apple, we blend world-class hardware, software, and services to produce a
tight ecosystem of products used by billions of people around the world. Machine
Learning and AI models are integrated throughout our ecosystem to enhance the
user experience. Ensuring a delightful end to end user experience requires
well-thought out data curation, rigorous evaluation methodology, and a high
signal north star metric. Guiding feature development across the entire product
life cycle requires partnering closely with modeling teams, engineers, design,
and others. At Apple’s scale, it’s paramount that methods scale across
platforms, user-model mediums, and languages.

DESCRIPTION

Advance the performance of Apple Intelligence Large Language Models, across
Apple platforms, languages, and modalities. Advise the data training and product
roadmap for Foundation Models. Source novel datasets and run ablation studies to
inform training hill-climbing. Identify high signal relevant public benchmark
datasets to guide model development. Prototype and productionalize LLM-based
applications to improve model development life cycle. Design detailed evaluation
methodologies in close partnership with engineering and product teams to support
critical go/no-go decisions. Develop and evangelize robust metrics for
hillclimbing. Regularly present to partner teams and executive sponsors, both at
a technical and high level.

Requirements

• Bachelors degree and 7+ years of work experience in Data Science, Machine Learning, or Engineering.
• Experience training and evaluation LLMs.
• Strong intuition for metrics, including their strengths and shortcomings.
• A track record of positive impact on shipped products.

Nice To Haves

• Strong communication skills and experience persuading both technical audiences and high level executive audiences.
• Passion for Apple products.

Responsibilities

• Advance the performance of Apple Intelligence Large Language Models, across Apple platforms, languages, and modalities.
• Advise the data training and product roadmap for Foundation Models.
• Source novel datasets and run ablation studies to inform training hill-climbing.
• Identify high signal relevant public benchmark datasets to guide model development.
• Prototype and productionalize LLM-based applications to improve model development life cycle.
• Design detailed evaluation methodologies in close partnership with engineering and product teams to support critical go/no-go decisions.
• Develop and evangelize robust metrics for hillclimbing.
• Regularly present to partner teams and executive sponsors, both at a technical and high level.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees