Senior Software Workload Optimization Engineer

NVIDIA•Seattle, WA
•$150,000 - $351,000•Hybrid

About The Position

NVIDIA’s numerics team develops techniques to make large language models more efficient. The Senior Software Workload Optimization Engineer independently leads investigations into AI workloads and helps improve how effectively GPU systems perform useful work. The work may include reducing the GPU hours required to evaluate models and will evolve as priorities and bottlenecks change. The engineer analyzes workloads as systems: measuring performance, identifying limits to useful throughput, implementing improvements, and validating results. The role involves working with workload owners to understand requirements, test improvements, and support deployment. Success means measurably reducing GPU resources needed to deliver useful results across workloads. Expertise in quantization algorithms is not required.

Requirements

  • Experience analyzing and improving the performance of compute-intensive software.
  • Bachelor’s degree or equivalent experience.
  • At least 5 years of relevant experience; the posting also states 3 or more years of relevant experience.
  • Ability to reason about and optimize parallelism strategies, including tensor, data, pipeline, context, and expert parallelism, to balance throughput, communication overhead, and GPU resource use.
  • Ability to investigate unfamiliar code and systems and work directly with code owners to land end-to-end optimizations.
  • Understanding of GPU architecture and factors that affect utilization and application performance.
  • Experience using profiling, benchmarking, and measurement to guide optimization decisions.
  • Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers.

Nice To Haves

  • Experience optimizing AI training, inference, evaluation, or other large-scale GPU workloads.
  • Experience with GPU programming or machine learning frameworks and performance tools.
  • Experience improving workload scheduling, batching, data pipelines, or multi-GPU configurations.
  • Familiarity with collecting and interpreting GPU telemetry.
  • Experience with energy-proportional computing or performance optimization under power, energy, or thermal design power budgets.
  • Experience with model quantization or numerical methods.

Responsibilities

  • Investigate the performance of evaluation and other AI workloads across GPU systems.
  • Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation.
  • Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes.
  • Assess how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization.
  • Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput.
  • Design clear benchmarks and measurements that account for tradeoffs among throughput, latency, resource use, and the quality or correctness of results.
  • Partner with workload owners to understand requirements, test improvements, and help deploy solutions.
  • Independently prioritize and drive optimization projects from investigation through measurable results.

Benefits

  • Equity
  • Benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service