Machine Learning Research Engineer, Text Generation

Apple • Cupertino, CA

75d

About The Position

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build or service we create, we deliver is the result of us making each other's ideas stronger. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you'll do more than join something - you'll add something. Text generation is a key enabler for accelerated text input and intelligent interaction on Apple platforms. Our team is working on redefining user interaction with generative models for text generation. If you want to be part of an ambitious, organized and collaborative team that ships user experiences with pioneering ML, partnered with the best UI designs, come join the Input Experience NLP team. Our work has been highlighted in multiple WWDC keynotes including Intelligent Input in 2023, Writing Tools and Smart Reply in 2024! We exemplify Apple's outstanding integration of hardware and software to create seamless input experiences. You will have the opportunity to go from building offline pioneering NLP models to optimization of the models for different hardware backends and user interfaces that make the experience magical. Our vision always includes a deep dedication to strengthening Apple's privacy policy by achieving all of the above on device with powerful ML. As a key pillar of Apple Intelligence, input experience will be the main area where you bring impact to billions of users with your ML expertise, engineering passion, and programming skills. You will work with a hard-working and dedicated set of outstanding ML and software engineers on a wide range of most advanced text generation technologies such as context-augmented text rewriting, safety-controlled text composition, free-form text transformation, personalized smart interactions, etc. Our team has been working in this area for years and own the NLP and ML text input stack for the keyboard input that includes auto correction, predictive typing on all Apple platforms. We also work on full stack ML applied to NLP and expose these key technologies across Apple on device and also to third party applications through the Natural-Language framework. If you want to amplify your strong ML and NLP skills into user experiences that will reach every person around you, this is the perfect opportunity!

Requirements

• Familiar with model compression algorithms including quantization, pruning, and distillations.
• Experience optimizing large diffusion models or language models.
• Experience with hardware architecture and software & hardware co-design.
• Experience deploying large ML models in real-world products.
• Actively programming with high-quality codes across complex and large repositories.
• Familiar with common NLP algorithms and applications, including tokenization, language modeling, text decoding, and text classification.
• Experience in multi-modal modeling.

Nice To Haves

• Presenting plans, progress, and results or demos regularly and concisely.

Responsibilities

• Redefine user interaction with generative models for text generation.
• Collaborate with a team to ship user experiences with pioneering ML.
• Optimize NLP models for different hardware backends and user interfaces.
• Strengthen Apple's privacy policy through on-device ML.
• Work on advanced text generation technologies such as context-augmented text rewriting and personalized smart interactions.
• Own the NLP and ML text input stack for keyboard input including auto correction and predictive typing.
• Expose key technologies across Apple and to third-party applications through the Natural-Language framework.

What This Job Offers

• Industry: Computer and Electronic Product Manufacturing
• Number of Employees: 5,001-10,000 employees