AIML Resident - Knowledge Answer Quality u0026 Richness

Apple Inc. • Santa Clara, CA

50d

About The Position

Imagine what you could do here! At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Combining groundbreaking machine learning research with next-generation hardware, our teams take user experiences to the next level.Apple's AIML Residency is a year-long program inviting experts in various fields to apply their own domain expertise to innovate and build revolutionary machine learning and AI-based products and experiences. As AI-based solutions spread across fields, the need for domain experts to understand machine learning and apply their expertise in ML settings grows. Residents will have the opportunity to attend ML and AI courses, learn from an Apple mentor closely involved in their program, collaborate with fellow residents, gain hands-on experience working on high-impact projects, publish in world-class academic conferences, and partner with Apple teams across hardware, software, and services. The AIML Answers, Knowledge and Information team is creating groundbreaking technology for AI, ML, and NLP! The features we create redefine how hundreds of millions of people use their computers and mobile devices to search and find what they are looking for. Our universal search engine powers search features across a variety of Apple products, including Siri, Spotlight, Safari, Messages and Lookup. We also develop pioneering LLM-based generative AI technologies to power innovative features in both Apple's devices and services on the cloud. As a Resident on this team, you'll conduct large-scale ML and deep learning research and development. Your Ru0026D efforts aim to improve Open Domain Question Answering (using both structured knowledge graph data and unstructured web data), Summarization, and the fundamental building blocks of Artificial Intelligence. This involves developing sophisticated LLMs to: understand user queries, retrieve and rank relevant documents across multiple sources, and synthesize information to provide users with a direct answer that best satisfies their intent and information seeking needs. Additionally, you'll research and develop the state-of-the-art LLMs for summarizing personal data such as emails, messages, and notifications. Residents collaborate with researchers and data scientists to develop, fine-tune, and evaluate domain specific LLMs for various tasks and applications in Apple's AI powered products. Our team also conducts applied research to transfer the latest research in generative AI to production ready technologies.Ideal candidates will also have academic, research, or industry experience in one of the following: Large Language Models / Generative AI, Machine Learning u0026 ML Research, Natural Language Processing/Conversational AI, Search, or Information Retrieval. Thesis, capstone project, internship, co-op, and/or proven experience in these fields qualifies

Requirements

• Experience in various pioneering techniques related to LLM fine-tuning in 1 or more of the following areas:
• Supervised Fine-tuning (SFT) with Rejection Sampling
• Preference-based fine-tuning techniques (e.g RLHF, Reward model, DPO, PPO, GRPO etc.)
• Parameter efficient fine-tuning techniques (e.g LoRA)
• Hallucination reduction and factual accuracy improvements
• Designing and implementing safety guardrails
• One or more scientific publications in various conferences and journals

Nice To Haves

• Academic, research, or industry experience in one of the following: Large Language Models / Generative AI, Machine Learning u0026 ML Research, Natural Language Processing/Conversational AI, Search, or Information Retrieval. Thesis, capstone project, internship, co-op, and/or proven experience in these fields qualifies

Responsibilities

• Conduct large-scale ML and deep learning research and development
• Improve Open Domain Question Answering (using both structured knowledge graph data and unstructured web data), Summarization, and the fundamental building blocks of Artificial Intelligence
• Develop sophisticated LLMs to: understand user queries, retrieve and rank relevant documents across multiple sources, and synthesize information to provide users with a direct answer that best satisfies their intent and information seeking needs
• Research and develop the state-of-the-art LLMs for summarizing personal data such as emails, messages, and notifications
• Collaborate with researchers and data scientists to develop, fine-tune, and evaluate domain specific LLMs for various tasks and applications in Apple's AI powered products
• Conduct applied research to transfer the latest research in generative AI to production ready technologies

What This Job Offers

• Career Level: Entry Level
• Industry: Computer and Electronic Product Manufacturing
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees