Principal Software Development Engineer - AI/ML

Advanced Micro Devices, Inc•San Jose, CA

About The Position

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them. AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward. THE ROLE: We are seeking a highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler and performance optimizations that enable state-of-the-art AI training and inference workloads on AMD GPU platforms. You will work at the intersection of compiler technology, machine learning frameworks, GPU architecture, and performance engineering, contributing to the ROCm software ecosystem and ONNX Runtime execution stack. The ideal candidate combines deep compiler expertise with hands-on experience optimizing AI workloads, and thrives in a fast-paced environment collaborating across architecture, kernel, runtime, and framework teams. THE PERSON: You are passionate about building high-performance AI software and solving complex optimization challenges. You possess strong compiler fundamentals, GPU programming expertise, and a proven ability to improve performance for large-scale AI models. You enjoy collaborating with architecture, compiler, runtime, and machine learning teams to deliver innovative solutions that scale across current and future AMD GPU platforms. You have a strong sense of ownership, excellent problem-solving skills, and a track record of driving meaningful performance improvements across software stacks.

Requirements

Strong proficiency in C++ and object-oriented software development.
Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.
Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.
Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.
Experience profiling and optimizing performance-critical software systems.
Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.
Strong analytical, communication, and problem-solving skills.

Responsibilities

Work with AMD’s architecture specialists to improve future products
Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
Develop scalable solutions that improve portability and performance across AMD GPU architectures.
Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.
Implement, validate, and maintain ONNX operators and microbenchmark test suites.
Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.
Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.
Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.
Drive performance characterization and benchmarking across pre-silicon and post-silicon environments.