Research Intern - AI /Machine Learning Numerics & Efficiency

Microsoft•Redmond, WA
•$6,810 - $14,610•Onsite

About The Position

As part of Microsoft’s Systems Planning and Architecture (SPARC) group, the Research Intern will contribute to research in advanced machine learning systems, with a focus on numerics, data types, and compute technologies for next-generation AI workloads at Azure scale. The role involves collaborating across Azure teams to explore approaches to model efficiency, including low-precision formats, quantization strategies, ML kernel development, and benchmarking emerging model architectures and hardware capabilities. The intern will evaluate, prototype, and analyze algorithmic and numerical techniques to improve the performance, cost, and efficiency of training and inference for large-scale models. The internship offers hands-on experience with Azure AI and hardware technologies, and opportunities to develop expertise in ML systems, emerging data types, kernel optimization, reinforcement learning, and performance modeling. Research Interns work with mentors and other researchers, present findings, and contribute to the research community during a 12-week internship.

Requirements

  • Currently enrolled in a Doctorate Degree program in Computer Science, Electrical Engineering, or a related STEM field.
  • Be physically located at the manager’s Microsoft worksite for the duration of the internship.
  • Submit at least two reference letters, a cover letter, and relevant work or research samples.

Nice To Haves

  • Experience programming in Python and/or C/C++.
  • Strong understanding of transformer-based model architectures, including attention mechanisms, KV cache behavior, and common training and inference bottlenecks.
  • Experience with modern ML frameworks and runtimes such as PyTorch, Hugging Face Transformers, SGLang, or vLLM.
  • Expertise in GPU/NPU kernel development using CUDA, Triton, ROCm, or comparable frameworks, and experience bringing models up quickly on a new stack.
  • Working knowledge of low-precision numerics such as FP8, INT8/4, MX formats, and NVFP4; quantization methods; or hardware–software co-design for large-scale model efficiency.
  • Practical experience with large-scale model evaluation, including benchmarking state-of-the-art LLMs and fine-tuning large models using SFT or RL.
  • Demonstrated analytical and problem-solving skills and an interest in ML systems and computational performance.
  • Strong communication and collaboration skills, with the ability to work effectively across research and engineering teams.

Responsibilities

  • Research and explore advanced machine learning systems, numerics, data types, and compute technologies for AI workloads at Azure scale.
  • Collaborate with Azure teams to investigate approaches to model efficiency, including low-precision formats, quantization strategies, ML kernel development, and benchmarking.
  • Evaluate, prototype, and analyze algorithmic and numerical techniques for improving the performance, cost, and efficiency of large-scale model training and inference.
  • Collaborate with mentors, fellow Research Interns, and researchers.
  • Present findings and contribute to the research community.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service