Software Engineer AI Data Platform - CoreAI

Microsoft • Redmond, WA

1d

About The Position

The GenAI Infrastructure and Solutions team is building large-scale GenAI training infrastructure, LLM-based solutions and tools. We provide the infrastructure for teams in CoreAI and other Microsoft Groups to fine-tune LLMs and serve agentic workload for their own scenarios. As a Software Engineer, you will work on the infrastructure and tools to support large scale model fine-tuning, evaluation, and inference. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. This role is targeting an immediate start date.

Requirements

• Bachelor's Degree in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
• OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
• These requirements include but are not limited to the following specialized security screenings:
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 1+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, TypeScript or Python
• OR equivalent experience.
• Proven software development experience in C#, C++, Python, or similar languages.
• Reliable experience with containerization tools (e.g., Docker, Kubernetes).
• Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring.
• Proven experience with distributed systems and cloud-based infrastructure.
• Proven experience with DevOps practices (CI/CD, automated testing, deployment, etc.).

Responsibilities

• Collaborates with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.
• Designs, builds and improves the services with high scalability and reliability.
• Contributes to the deployment and monitoring of services in production environments.
• Participates in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.

Benefits

• Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees