AI Solution Integration Principal Engineer (SW)

Advanced Micro Devices, Inc • Austin, TX

1d

About The Position

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

THE ROLE:
The AI Customer Engineering organization is looking for a Principal AI Solution Integration Engineer to help customers achieve best‑in‑class performance for AI training and inference workloads on AMD GPU platforms. This is a hands‑on, customer‑facing role leading full-stack debug of complex AI issues on performance, scale, and production readiness for large AI workloads.
THE PERSON:
Ideal candidate would be a senior technologist in AI who can reason across model behavior, ROCm software, system software, and GPU microarchitecture to continuously improve performance benchmarks. Debug complex performance and stability issues across application, framework, runtime, driver, and system layers. Expert in Data Center GPU and AI domains with good understanding of AI workload optimization through different layers of a system including GPU micro-architecture. Experience in in working with different owners of the functional code stack as well as the ability to drive issues to resolutions with innovative solutions.

Requirements

• Proven years experience in GPU computing, AI infrastructure, or low‑level systems software.
• Deep hands‑on experience with the ROCm software stack and Linux‑based GPU systems.
• Strong understanding of GPU microarchitecture and memory systems, with the ability to reason from uArch behavior to software outcomes.
• Proven track record debugging issues across application/workload, runtime, driver, firmware and hardware layers.
• Experience supporting or deploying large‑scale AI training/inference clusters with best-in-class performance
• Excellent technical communication skills across customers, executives, and engineering teams.

Nice To Haves

• Prior experience influencing GPU, firmware, or platform architecture based on field learnings.
• Familiarity with AI workload characteristics (LLMs, distributed training, large‑scale inference).
• Experience with OEM/ODM server platforms, BMC/SMC, and system telemetry.
• Background in performance modeling, reliability analysis, or large‑scale system validation.

Responsibilities

• Own end‑to‑end integration and full‑stack debugging of AI workloads across customer production environments, spanning AI frameworks (PyTorch, Triton, Megatron‑LM, vLLM), ROCm runtime, compilers, math and communication libraries, Linux kernel, GPU drivers, and firmware.
• Serve as the technical escalation point for complex, production‑blocking issues in large‑scale, multi‑node and multi‑rack GPU deployments, addressing performance, correctness, and system stability.
• Diagnose and resolve issues across the ROCm stack, including HIP runtime and kernels, ROCm libraries (hipBLASLt, hipSPARSE, hipSOLVER, CK), collective communication (RCCL, SHMEM, Infinity Fabric), and observability tooling.
• Drive workload tuning, scaling optimization, and performance improvements for large‑scale training and inference workloads.
• Correlate GPU microarchitecture behavior (compute, memory hierarchy, HBM, scheduling, power and thermal limits) with symptoms observed at the application, runtime, and driver layers.
• Partner closely with silicon, firmware, and DFx teams to influence future debug, observability, and platform capabilities.
• Act as a trusted technical advisor to strategic customers, leading cross‑functional war rooms and translating ambiguous system symptoms into clear root-cause analyses and resolution paths.
• Mentor senior engineers, promoting advanced debugging techniques, system‑level thinking, and best practices across teams.

Benefits

• AMD benefits at a glance.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree
• Number of Employees: 5,001-10,000 employees