AIML - Sr Data Scientist, Data and ML Innovation

Apple Inc. • Cupertino, CA

38d

About The Position

We are a group of data scientists, partnering with ML researchers and engineers who develop foundation models that power Apple Intelligence features. We are pushing the boundaries of data science by developing novel techniques to evaluate the performance and capabilities of Foundational Models. In addition, we leverage data mining expertise to identify characteristics of training data that influence the performance of these models. If you are an accomplished data scientist, who wants to expand your influence in this fast evolving and exciting space of Generative AI, this is a great opportunity for you.As a Sr Data Scientist partnering with ML Researchers, you will bring your inquisitive mind and outstanding technical skills to unlock insights about the drivers that improve effectiveness of foundation models. Some projects that you are likely to drive are: Assess existing foundation models evaluation techniques and improve them to suit Apple's use cases. Studying loss patterns of models and attributing them to the drivers across the life cycle of model development from pre-training to SFT to RL. Defining training data quality metrics and assessing quality of training data to ensure it positively impacts model performance. Driving interpretability of ablation studies, documenting takeaways and driving a hypothesis driven experimentation strategy. Building tools and automation process using LLMs to scale data science projects.Deep understanding of foundation model training and development life cycle. Experience with developing model evaluation simulation environments Experience generating synthetic data for foundation model training. Experience with prompt optimization for improving in context learning performance of LLMs. Building and deploying end to end Data Science/ML pipelines.

Requirements

• Deep understanding of foundation model training and development life cycle.
• Experience with developing model evaluation simulation environments
• Experience generating synthetic data for foundation model training.
• Experience with prompt optimization for improving in context learning performance of LLMs.
• Building and deploying end to end Data Science/ML pipelines.

Nice To Haves

• PhD degree preferred.

Responsibilities

• Assess existing foundation models evaluation techniques and improve them to suit Apple's use cases.
• Studying loss patterns of models and attributing them to the drivers across the life cycle of model development from pre-training to SFT to RL.
• Defining training data quality metrics and assessing quality of training data to ensure it positively impacts model performance.
• Driving interpretability of ablation studies, documenting takeaways and driving a hypothesis driven experimentation strategy.
• Building tools and automation process using LLMs to scale data science projects.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Computer and Electronic Product Manufacturing
• Education Level: Ph.D. or professional degree
• Number of Employees: 5,001-10,000 employees