Software Engineer AI Infra

Microsoft,
$102,100 - $261,000Hybrid

About The Position

Microsoft AI is looking for a Software Engineer AI Infra to help build State-of-the-Art Large Language Models (LLMs). The ideal candidate will bring positive energy, empathy, and kindness, along with being highly effective. This role involves building world-class consumer experiences and products in a fast-paced environment. The engineer will contribute to the development of AI models powering innovative products, working across engineering, research, model architecture, data curation, training and inference infrastructures, evaluation protocols, alignment, and reinforcement learning from human feedback (RLHF). The Microsoft AI team's mission is to empower every person and organization to achieve more, fostering a growth mindset, innovation, and collaboration. This role is part of an initiative to push AI boundaries towards Humanist Superintelligence, ensuring AI remains controllable, safety-aligned, and anchored to human values, amplifying human potential while maintaining human control. The goal is to deliver breakthroughs benefiting society, advancing science, education, and global well-being, with the opportunity to impact billions of users. The team seeks brilliant, ambitious, and low-ego individuals to work on the next generation of models.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Nice To Haves

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Experience with generative AI.
  • Experience with distributed computing.
  • Experience in leading technical projects and supporting architectural decisions with data.

Responsibilities

  • Develop software systems for pre-training, post-training infra, such as benchmarking systems, evaluation, router, backend systems.
  • Gather data and insights to develop the pretraining compute roadmap.
  • Actively contribute to the development of AI models that are powering our innovative products.
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
  • Enjoy working in a fast-paced, design-driven, product development cycle.
  • Embody our Culture and Values.

Benefits

  • Certain roles may be eligible for benefits and other compensation.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service