Software Engineer – AI Inference and Performance Optimization

Advanced Micro Devices, Inc•Austin, TX

About The Position

Join AMD’s CG-AIM team to develop and optimize AI inference software for AMD platforms. Work with architecture and engineering teams to improve performance, efficiency, and scalability across AI workloads. The role involves developing AI inference software, runtimes, and workloads; analyzing performance bottlenecks; and implementing improvements to latency, throughput, and memory efficiency. The position is located in Austin, Texas, or Markham, Ontario, Canada, and is not eligible for visa sponsorship.

Requirements

  • Strong software development, debugging, and problem-solving skills.
  • Strong C/C++ and Python development skills.
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

Nice To Haves

  • Experience with AI frameworks, inference runtimes, and performance profiling.
  • Familiarity with GPU programming, parallel computing, and memory optimization.
  • Experience with PyTorch, ONNX Runtime, ROCm, HIP, or similar technologies.

Responsibilities

  • Develop and optimize AI inference software, runtimes, and workloads.
  • Identify bottlenecks and improve latency, throughput, and memory efficiency.
  • Integrate and validate improvements with architecture and software teams.
  • Build benchmarks and automated tests to track performance and correctness.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service