GPU Kernel Engineer

Advanced Micro Devices, Inc•Santa Clara, CA

About The Position

As a core member of AMD’s team, the GPU Kernel Engineer develops and optimizes deep learning frameworks for AMD GPUs. The role focuses on improving GPU kernel performance, accelerating deep learning models, and enabling training and inference at scale across multi-GPU and multi-node systems. The engineer collaborates with internal GPU software teams and open-source communities to integrate compiler technologies and contribute upstream to AMD’s AI software ecosystem.

Requirements

  • Bachelor’s degree and/or working toward a Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Strong C++ development skills in Linux environments.
  • Ability to work collaboratively and independently, define goals, manage development efforts, and deliver high-quality solutions.
  • Strong problem-solving skills, a proactive approach, and understanding of software engineering best practices.

Nice To Haves

  • Proficiency in C++ and/or Python, with demonstrated ability to debug, profile, and optimize performance-critical code.
  • Hands-on experience with SGLang or similar LLM inference frameworks.
  • Background in compiler design or familiarity with LLVM, MLIR, or ROCm.
  • Experience running and scaling workloads on large-scale heterogeneous CPU and GPU clusters using distributed training or inference strategies.
  • Experience contributing to or integrating optimizations into PyTorch, TensorFlow, or other deep learning frameworks.
  • Working knowledge of HIP, CUDA, or other GPU programming models; experience with GCN/CDNA architecture is preferred.

Responsibilities

  • Enhance the performance of TensorFlow, PyTorch, and SGLang on AMD GPUs through upstream open-source contributions.
  • Profile and tune large-scale training and inference models for AMD hardware.
  • Design, implement, and optimize high-performance GPU kernels using HIP, Triton, or other relevant tools.
  • Collaborate with internal compiler and GPU math library teams to align kernel optimizations with full-stack performance goals.
  • Support optimization, feature development, and scaling of the SGLang LLM framework across AMD GPU platforms.
  • Tune and scale performance across multi-GPU and multi-node environments, including inference parallelism and collective communication strategies.
  • Work with external maintainers to understand framework needs, propose optimizations, and upstream contributions.
  • Use modern software engineering practices in debugging, profiling, test-driven development, and CI integration.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service