Microsoft Foundry helps developers and organizations build, deploy, and operate AI solutions at scale. The engineering team builds infrastructure to make model training and inference faster, more reliable, and more efficient for customers. This role joins the Foundry training team to improve pre-training and post-training systems. The engineer will own a training component and help optimize agents using interaction trajectories, tool-use data, and feedback. Microsoft is hiring at both Software Engineer II and Senior Software Engineer levels. The position involves profiling and optimizing training-system performance, shipping tested changes with reproducible benchmarks, and reducing training step time and memory use while preserving restart correctness, model quality, and numerical correctness. It also involves building secure, tenant-isolated systems with automated testing, observability, reliable recovery, and safe releases, as well as providing operational support and improving services using production feedback. The role aims to improve throughput, latency, and cost, pursue near-linear throughput scaling where workloads permit across agreed GPU and node configurations, and validate convergence and held-out model and agent quality. Quality validation includes multi-turn task completion, tool-use correctness, and reward-exploitation checks for reinforcement learning.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level