Research Intern - AI /Machine Learning Numerics & Efficiency

Microsoft•Mountain View, CA
•Onsite

About The Position

As part of Microsoft’s Systems Planning and Architecture (SPARC) group, the Research Intern will contribute to research and exploration in advanced machine learning systems, focusing on the numerics, data types, and compute technologies that support next-generation AI workloads at Azure scale. The intern will collaborate across Azure teams to investigate approaches to model efficiency, including low-precision formats, quantization strategies, ML kernel development, benchmarking, and analysis of emerging model architectures and hardware capabilities. The role involves evaluating, prototyping, and analyzing algorithmic and numerical techniques to improve the performance, cost, and efficiency of training and inference for large-scale models. Findings will inform decisions about compute platforms, acceleration strategies, and system-level optimizations, including internal silicon efforts, software runtimes, and industry partnerships. The internship offers hands-on experience with Azure AI and hardware technologies and opportunities to develop expertise in ML systems, emerging data types, kernel optimization, reinforcement learning, and performance modeling. During the 12-week internship, the intern will be paired with mentors, collaborate with other interns and researchers, present findings, and participate in the research community. Research internships are offered year-round and typically begin in the summer. Interns are expected to be physically located at their manager’s Microsoft worksite for the internship’s duration. Applicants must submit at least two reference letters, a cover letter, and relevant work or research samples.

Requirements

  • Currently enrolled in a doctorate degree program in Computer Science, Electrical Engineering, or a related STEM field.
  • Must be physically located at the manager’s Microsoft worksite for the duration of the internship.
  • Submit a minimum of two reference letters, a cover letter, and relevant work or research samples.

Nice To Haves

  • Experience programming in Python and/or C/C++.
  • Strong understanding of transformer-based model architectures, including attention mechanisms, KV cache behavior, and common training and inference bottlenecks.
  • Experience with modern ML frameworks and runtimes such as PyTorch, Hugging Face Transformers, SGLang, or vLLM.
  • Expertise in GPU/NPU kernel development using CUDA, Triton, ROCm, or comparable frameworks, and fast model bring-up on a new stack.
  • Working knowledge of low-precision numerics (FP8, INT8/4, MX formats, NVFP4, etc.), quantization methods, or hardware–software co-design considerations for large-scale model efficiency.
  • Practical experience with large-scale model evaluation, including benchmarking state-of-the-art LLMs and fine-tuning large models through SFT or RL.
  • Demonstrated analytical and problem-solving skills, with an interest in ML systems and computational performance.
  • Proficient communication and collaboration skills, with the ability to work effectively across research and engineering teams.

Responsibilities

  • Research and explore advanced machine learning systems, with a focus on numerics, data types, and compute technologies for Azure-scale AI workloads.
  • Collaborate across Azure teams to investigate model-efficiency approaches, including low-precision formats, quantization strategies, and ML kernel development.
  • Benchmark and analyze emerging model architectures and hardware capabilities.
  • Evaluate, prototype, and analyze algorithmic and numerical techniques to improve training and inference performance, cost, and efficiency for large-scale models.
  • Present research findings and collaborate with mentors, other Research Interns, and researchers.
  • Contribute to research that informs decisions about compute platforms, acceleration strategies, and system-level optimizations.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service