Software Development Engineer - AI Workload Optimization

Advanced Micro Devices, Inc • Austin, TX

4h

About The Position

AMD is seeking a technical leader for its AI Software group to define and drive end-to-end software optimization strategy, delivering industry-leading performance for top-tier customers. The role sits at the intersection of architecture, customer engagement, and software engineering, optimizing AMD’s software stack—from ROCm and compilers to high-level AI frameworks—for demanding AI workloads. The successful candidate will shape workload optimization strategy, work with customers and cross-functional teams, and contribute technical leadership across the AI ecosystem.

Requirements

• Deep software development experience and experience in a high-level technical leadership role, such as Fellow or equivalent.
• Deep expertise in AI frameworks, including PyTorch, JAX, vLLM, or SGLang, and the ROCm software stack.
• Proven history of optimizing distributed inference and training at scale across multi-node and multi-GPU environments.
• Mastery of performance profiling tools such as TorchProfiler, ROCm Profiler, or Nsight, and hardware-level performance modeling.
• Strong understanding of modern model architectures, including Transformers, Attention, and KV Cache, and optimization techniques such as quantization, speculative decoding, and FlashAttention.
• Demonstrated ability to drive cross-functional initiatives in fast-paced, ambiguous environments.
• This role is not eligible for visa sponsorship.

Nice To Haves

• Master’s degree or Bachelor’s degree in computer science, electrical engineering, or a related field, or equivalent experience.
• Demonstrated research or applied experience in AI/ML, including deep learning, model training or inference optimization, large language models, or computer vision.

Responsibilities

• Set the technical vision and roadmap for workload optimization across the AI software stack.
• Lead profiling, analysis, and tuning of large-scale LLM, diffusion, multimodal, and MoE models for strong out-of-the-box performance on AMD hardware.
• Partner with top customers and hyperscalers to understand workload requirements and deliver architectural improvements and software optimizations.
• Collaborate with hardware architecture, compiler, and framework teams to influence future silicon features based on AI workload trends.
• Drive development of tools and frameworks for performance estimation, modeling, and automated reporting.
• Represent AMD in industry forums and open-source communities.
• Mentor and support the development of AMD technical leaders and engineers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed