Applications of ML Engineering Manager

Apple • San Francisco, CA

4d

About The Position

Apple Services Engineering (ASE) powers many AI features across App Store, Music, Video and more. We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating systemic biases and maintain safe and trustworthy experiences across our AI tools and models. We are hiring a Manager in Responsible Development & Safety, to shape policies and model and application evaluation processes, to ensure safe and responsible deployment of Apple Services' user-facing features. You will build guidelines for internal engineering, human evaluation, and safety research teams, identify risks and contribute to mitigation strategies for new product features and functions. The role involves collaborating with engineering, research, and product teams to assess and measure the impact of ASE features. Your role involves ensuring safety best practices, reviewing AI model performance, and providing guidance. You'll use your expertise in technology's societal implications to improve the safety development ecosystem as a manager of a small team developing and conducting safety evaluations.

Requirements

• Ph.D., J.D. or equivalent experience in Computer Science, Machine Learning, and/or Human-Computer Interaction
• 5+ years proven experience with AI product and/or user policies in multiple regions of the world
• Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.).
• Experience working with large datasets, annotation tools, or model-evaluation pipelines.
• Ability to design taxonomies, categorization schemes, or structured rating frameworks.
• Strong ability to stitch together qualitative and quantitative findings into actionable guidance.

Nice To Haves

• A strong understanding of the challenges and issues in the fields of Responsible AI and/or Safety, through AI and society experience (e.g. relevant governance, policy, legal or research).
• Experience working directly with LLMs, LMMs, and generative AI and agentic systems, in a development and/or evaluation capacity.
• Experience leading new teams working on innovative initiatives within a well-established organization.
• 5+ years experiences with AI evaluations, managed with a diverse sets of collaborators, such as Product, Engineering, Security, and Legal teams.
• Experience navigating and assessing complex societal questions related to technology development, including balancing the benefits and risks of research and applications.
• Strong management skills, including the ability to communicate effectively in tight turnaround times.
• Excellent experience collaborating with technical stakeholders and highly interdisciplinary teams.
• Strong communication skills, both written and verbal.

Responsibilities

• Shape and support implementation of safety policies defined by AI Product teams.
• Collaborate with AIML, Product & Design, Privacy, Human-centered AI, policy leads, and business owners to define model and application evaluation requirements, set priorities, and scope and manage execution of AI /ML model and application evaluations.
• Work with Senior Managers to set objectives and key results and the long-term strategy for safety evaluation, including benchmarks, automated methods, and ongoing monitoring of safety performance of AI models.
• Lead a team of individual contributors.
• Develop new programming and generate opportunities for ASE to regularly engage with Policy, Legal, and Privacy teams.
• Develop and document standard processes through working with machine learning engineers and experts, and where appropriate, external organizations.

Benefits

• Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition.
• Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: Ph.D. or professional degree
• Number of Employees: 5,001-10,000 employees