Staff Software Development Engineer

Advanced Micro Devices, Inc•San Jose, CA

13h

About The Position

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. MTS SOFTWARE DEVELOPMENT ENGINEER THE ROLE: AMD is seeking a high-caliber AI Software Engineer to join a fast-moving team dedicated to building high-performance inference software for AMD GPUs. In this role, you will contribute to the entire inference stack, from low-level GPU kernel optimizations to large-scale deployment. You will be at the forefront of AI deployment, working on systems that serve over a trillion tokens a day across thousands of GPUs. THE PERSON: The ideal candidate is a technical powerhouse with a deep background in GPU systems and performance engineering. You are comfortable navigating the complexities of low-level memory management as well as system level mindset. You are a relentless optimizer and is passionate about pushing the theoretical limits of hardware.

Requirements

Proven track record in GPU software engineering, with specific expertise in C++, CUDA, HIP.
Deep understanding of GPU architecture, low-level memory management, synchronization, and performance-critical code paths.
Hands-on experience with ML inference frameworks and deploying models at scale in production environments.
A Master’s degree or PhD in Computer Science, Computer Engineering, or a related field with a focus on Computer Graphics, Systems, or AI.

Nice To Haves

Familiarity with shader pipeline optimizations, compiler dispatch handling, and GPU profiling.
Experience in distributed systems and real-time networking protocols for high-performance computing.

Responsibilities

Design and implement high-performance GPU kernels and software layers to optimize AI inference across the AMD hardware portfolio.
Develop and maintain end-to-end inference stacks and serving infrastructure capable of handling massive throughput and low latency.
Identify and resolve performance bottlenecks within the graphics driver, compiler, and ML frameworks.
Collaborate with cross-functional teams to align software capabilities with next-generation GPU architectures.
Benchmark and profile complex AI workloads to ensure industry-leading performance and stability.