[Reactor] Founding Engineer, ML Inference

Cox ExponentialSan Francisco, CA
4dOnsite

About The Position

We're looking for a Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is a highly technical, high-impact role focused on squeezing every drop of performance from real-time generative media models. You'll work across the model-serving stack, designing novel inference frameworks, optimizing inference performance, and shaping Reactor's competitive edge in ultra-low-latency, high-throughput environments. We want to establish new inference frameworks in this domain and you will be able to own this part of our stack.

Requirements

  • Strong foundation in systems programming, with a track record of identifying and resolving bottlenecks
  • Deep expertise in the ML infrastructure stack: PyTorch, TensorRT, TransformerEngine, Nsight, ONNX Runtime
  • Model compilation, quantization (INT8/FP16), and advanced serving architectures
  • Working knowledge of GPU hardware (NVIDIA) and the ability to dive deep into the stack as needed
  • Strong understanding of transformer architectures and modern ML model optimization techniques

Responsibilities

  • Drive our frontier position on real-time model performance for diffusion models
  • Design and implement a high-performance in-house inference runtime
  • Implement optimizations using torch.compile, custom CUDA kernels, and specialized inference frameworks
  • Optimize neural network models for inference through quantization, pruning, and architectural modifications while maintaining accuracy
  • Profile and benchmark model performance to identify computational bottlenecks
  • Collaborate directly with model partner teams to directly integrate their models into our platform

Benefits

  • Competitive San Francisco salary and meaningful early equity.
  • We sponsor visas. We are committed to working through the process together for the right candidates. If you're currently outside the US, we're also committed to helping you relocate to the US throughout this process.
  • We offer generous health, dental, and vision coverage, and relocation support as needed.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service