Multimodal LLMs Research Engineer

Apple • Sunnyvale, CA

3d

About The Position

Apple’s centralized applied research and engineering group develops Computer Vision and Machine Perception technologies across Apple products, balancing advanced research with product delivery. The role focuses on multimodal inputs and large language models, spanning the full development lifecycle from early ideation and data definition through model training and fine-tuning. The engineer will drive research projects from foundational concepts to practical applications, with opportunities to publish papers and/or patents depending on research expertise and project scope.

Requirements

• Bachelor’s degree and 7+ years of relevant industry experience, or a master’s degree and 5+ years of relevant industry experience, or a Ph.D. and 3+ years of relevant industry experience.
• Demonstrated track record through publications, patents, and/or shipped relevant features.
• Strong Python programming experience.
• Strong PyTorch and/or JAX programming experience.
• Ability to effectively use AI code development tools to accelerate the development process.
• Experience shipping multimodal LLMs in products.

Nice To Haves

• Strong publication record in relevant venues such as CVPR, ICCV, ECCV, NeurIPS, ICML, and ICLR.
• Technical leadership experience guiding technical efforts across diverse teams or individuals.
• Expertise in advanced topics such as agentic AI, reasoning, and large-scale model evaluation.

Responsibilities

• Develop, implement, and enhance multimodal foundation models, including training or fine-tuning multimodal LLMs from scratch or using existing technologies to optimize performance and capabilities.
• Collaborate with cross-functional partners to define data and infrastructure requirements for robust evaluation of model designs and development.
• Stay current with advancements in AI, machine learning, and computer vision, and apply them to foster innovation.
• Drive research projects spanning foundational concepts and practical applications.
• Potentially publish papers and/or patents, depending on research expertise and project scope.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior