Fellow Software Development Eng (MI-450 Fleet Management)

Advanced Micro Devices, Inc•San Jose, CA

8d•Hybrid

About The Position

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. AMD is looking for a Fellow in Infrastructure Management who is passionate about complex AI solutions, Infrastructure management software that manages GPU clusters supporting large foundation model training, high-performance inference services, multi-tenant GPU sharing and scheduling. You will be a member of a core team of incredibly talented industry specialists and will work with the very latest hardware and software technology.

Requirements

The ideal candidate should be passionate about software engineering, system design, infrastructure management and possess leadership skills to drive sophisticated issues to resolution.
Able to communicate effectively and work optimally with different teams across AMD.

Responsibilities

Lead the technical vision, strategy, and architectural direction of our Infrastructure management software that manages our GPU clusters supporting large foundation model training, high-performance inference services, multi-tenant GPU sharing and scheduling.
Architect and implement GPU node orchestration, failure detection, auto-remediation, auto-scaling of clusters. Design infrastructure software that can support different distributed training frameworks PyTorch, Megatron, JAX, Tensorflow and different distributed inference frameworks like SGLang, VLLM, Ray. Design and deliver software that can manage different scale-up and scale out transport protocols and deliver the best network performance.
Architect telemetry, observability, and profiling systems (Prometheus/Thanos, Open Telemetry, Mimir) to measure GPU health and cluster efficiency. Architect monitoring systems that can investigate network congestion, latency spikes, scheduling inefficiencies, system bottlenecks.
Architect our Infrastructure management software for scale, efficiency and deliver industry leading GPU cluster utilization that is highly reliable and self-healing. Deliver infrastructure services that reduce job latencies for Slurm and Kubernetes clusters, improve scheduling efficiencies, and reduce operational cost.
Design and deliver AI Agents that can troubleshoot complex infrastructure problems without any human intervention and reduce OPEX cost and MTTR. Design and deliver AI Agents that can proactively identify nodes that are bound to fail before they fail.
Define our long-term infrastructure management roadmap, drive cross-team initiatives, and deliver. Mentor Principal Engineers, Technical staff across teams. Work with external partners and vendors to develop and deliver the most comprehensive infrastructure solution for AMD.