Nvidia-posted 5 months ago
$120,000 - $189,750/Yr
Entry Level
Santa Clara, CA
Computer and Electronic Product Manufacturing

At NVIDIA, we are at the forefront of the constantly evolving field of large language models, and their application in agentic and reasoning use cases. As the scale and complexity of these LLM systems continues to increase, we are seeking outstanding engineers to join our team and help shape the future of LLM inference. Our team is dedicated to pushing the boundaries of what's possible with LLMs by improving the algorithmic performance and efficiency of systems that represent them. We constantly reflect on how to improve these systems, developing new inference algorithms and protocols, improving existing models, and seamlessly integrating improvements to ensure NVIDIA's solutions can efficiently handle large-scale, sophisticated tasks.

  • Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.
  • Conduct in-depth analysis, profiling, and optimization of agentic LLM workloads to significantly reduce request latency and increase request throughput while maintaining workflow fidelity.
  • Design and implement scalable systems to accelerate agentic workflows and efficiently handle sophisticated datacenter-scale use cases.
  • Advise future iterations of NVIDIA software, hardware, and system by engaging with a diverse set of teams at NVIDIA and external partners and formalizing the strategic requirements presented by their workloads.
  • BS, MS, PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field (or equivalent experience).
  • Experience in deep learning and deep learning systems design.
  • Proficiency in Python and C++ programming.
  • Strong understanding of computer architecture, and GPU/parallel datacenter computing fundamentals.
  • Proven interest in analyzing, modeling, and tuning application performance.
  • Experience in building large-scale LLM inference systems, especially those involving compound AI.
  • Experience with processor and system-level performance modeling.
  • GPU programming experience with CUDA or OpenCL.
  • Equity and benefits.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service