Principal AI Software Engineer
About The Position
Would you like to work on a product that transforms Microsoft AI technologies and a modern-work suite to help millions of users work better and faster together? Do you enjoy working with teams that leverage AI to create fast and useful solutions for end-users? The future of work is being redefined with AI agents acting as digital co-workers. Microsoft is leading this transformation with M365, Copilot Studio, and Azure AI Foundry. As part of this team, you will help build Agent 365— an enterprise-grade solution that secures, governs, and manages AI agents with the same rigor and familiarity as human employees. As a Principal AI Software Engineer, you will collaborate with a diverse multi-discipline, multi-site team delivering end-to-end solutions and end user experiences across the M365 ecosystem designing the state of the art SWE agentic harness autonomously building highly scalable Azure service architecture, featuring a React-based UI that will delight our customers. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Nice To Haves
- Proven experience in developing and deploying large language models (LLMs): Demonstrated expertise in working with state-of-the-art LLMs, including their training, fine-tuning, and application in natural language processing tasks
- Practical experience in prompt engineering and evaluation, with the ability to design, refine, and test prompts to improve model accuracy, reliability, and usability.
- Experience with Agent based architectures, frameworks and technologies (such as MCP, A2A protocol, Langchain, Azure AI Foundry).
- Proficiency in Python for data science workflows, leveraging libraries such as NumPy, Pandas, scikit-learn, Matplotlib, and Jupyter for data analysis, experimentation, and rapid prototyping.
- Exposure to Deep Neural Network training and inference and experience in one or more deep learning frameworks (PyTorch, TensorFlow, etc.).
- Experienced in web application development frameworks, such as React.
- Experience delivering a Cloud SaaS product on Azure, AWS or GCP.
- Excellent communication and collaboration skills to work effectively across disciplines and partner teams.
Responsibilities
- Design implement, evaluate, and deploy AI-powered autonomous execution applications and services
- Develop and fine-tune large language models (LLMs) and other deep learning models
- Write clean, maintainable, and scalable code for model training, evaluation, and inference pipelines
- Optimize AI models for performance, latency, and cost efficiency in production environments
- Apply prompt engineering to enhance model outputs and performance
- Collaborate and partner with cross-functional teams to integrate the latest from Entra ID, M365, and other Microsoft technologies
- Stay current with emerging research, tools, and frameworks in AI/ML to drive innovation.
- Rapidly prototype and iterate on new ideas to stay ahead in the agent platform race
- Provide technical leadership and guidance to a team of software engineers
Benefits
- Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
