Applied AI Engineer II

Microsoft • Redmond, WA

101d • $100,600 - $199,000

About The Position

As an Applied AI Engineer II you will play a pivotal role contributing to the development and integration of cutting-edge AI technologies into Microsoft products and services, ensuring they are inclusive, ethical, and impactful. You will collaborate across product, research and engineering teams to bring innovative solutions to life, applying your expertise in machine learning, data science, and AI to solve complex problems. Your work will directly influence product direction and customer experiences. We are in an era of unprecedented innovation and openness. As Microsoft continues to lead in AI, we are seeking individuals to help tackle some of the most exciting and meaningful challenges in the field. Our vision is to build a truly open architecture platform that enables users to summon tailored AI agents to drive real-world outcomes. We are looking for an Applied AI Engineer II to join our team. This role will combine AI knowledge with applied science expertise, and demonstrate a growth mindset and customer empathy. Join us in shaping the future of AI agents. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field OR equivalent experience
• 1+ years of experience with generative AI OR LLM/ML algorithms
• Ability to pass Microsoft Cloud Background Check upon hire and every two years thereafter

Nice To Haves

• Experience with MLOps Workflows, including CI/CD, monitoring, and retraining pipelines
• Familiarity with modern LLMOps frameworks (e.g., LangChain, PromptFlow)
• 1+ year of experience developing and deploying live production systems
• Experience across the product lifecycle from ideation to shipping

Responsibilities

• Build collaborative relationships with product and business groups to deliver AI-driven impact
• Research and implement state-of-the-art using foundation models, prompt engineering, RAG, graphs, multi-agent architectures, as well as classical machine learning techniques
• Fine-tune foundation models using domain-specific datasets
• Evaluate model behavior on relevance, bias, hallucination, and response quality via offline evaluations, shadow experiments, online experiments, and ROI analysis
• Build rapid AI solution prototypes, contribute to production deployment of these solutions, debug production code, support MLOps/AIOps
• Contribute to papers, patents, and conference presentations
• Translate research into production-ready solutions and measure their impact through A/B testing and telemetry that address customer needs
• Use data to identify gaps in AI quality, uncover insights and implement PoCs to show proof of concepts
• Demonstrate deep expertise in AI subfields (e.g., deep learning, Generative AI, NLP, multi-modal models) to translate cutting-edge research into practical, real-world solutions that drive product innovation and business impact
• Share insights on industry trends and applied technologies with engineering and product teams
• Apply a deep understanding of fairness and bias in AI by proactively identifying and mitigating ethical and security risks
• Design, develop, and integrate generative AI solutions using foundation models and more
• Deep understanding of small and large language models architecture, Deep learning, fine tuning techniques, multi-agent architectures, classical ML, and optimization techniques to adapt out-of-the-box solutions to particular business problems
• Embody our culture and values

Benefits

• Industry leading healthcare
• Educational resources
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Professional, Scientific, and Technical Services
• Education Level: Bachelor's degree