Multimodal LLMs Research Engineer

Apple • Sunnyvale, CA

3d

About The Position

Apple’s centralized applied research and engineering group develops Computer Vision and Machine Perception technologies across Apple products, balancing advanced research with product delivery. The role focuses on the full lifecycle of multimodal large language model development, from early ideation and data definition to model training and fine-tuning. The candidate will contribute to research in multimodal LLMs and advanced areas such as agentic AI, reasoning, and large-scale model evaluation, spanning foundational concepts and practical applications.

The position involves developing, implementing, and enhancing multimodal foundation models, including training or fine-tuning models from scratch or using existing technologies to improve performance and capabilities. The engineer will work with cross-functional partners to define data and infrastructure requirements for robust model evaluation, stay current with advances in AI, machine learning, and computer vision, and apply those advances to ongoing innovation. Depending on research expertise and project scope, opportunities may include publishing papers or patents.

Requirements

• Bachelor of Science degree and at least 3 years of relevant industry experience.
• Demonstrated track record through publications, patents, and/or shipped relevant features.
• Strong Python programming experience.
• Strong PyTorch and/or JAX programming experience.
• Ability to effectively use AI code development tools to accelerate development.
• Ph.D. with a relevant research background, or M.S. with relevant industry experience.
• Strong publication record in relevant venues such as CVPR, ICCV, ECCV, NeurIPS, ICML, or ICLR.
• Technical leadership experience guiding technical efforts across diverse teams or individuals.
• Experience shipping multimodal LLMs in products.

Responsibilities

• Develop, implement, and enhance multimodal foundation models.
• Train or fine-tune multimodal LLMs from scratch or by leveraging existing technologies to optimize performance and capabilities.
• Collaborate with cross-functional partners to define data and infrastructure requirements for robust evaluation of model designs and developments.
• Stay current with advances in AI, machine learning, and computer vision and apply them to foster innovation.
• Depending on research expertise and project scope, publish papers and/or patents.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level