Forward Deployed Engineer

Deep Infra Inc. • Palo Alto, CA

74d

About The Position

DeepInfra is building the foundation for companies to use modern AI in production — simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere. We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk. DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel and Nvidia.

Requirements

• Customer-facing engineering with an owned technical outcome at an infrastructure or ML platform company.
• Strong Python skills.
• Dual-audience presence with commercial instinct — credible with a skeptical staff engineer, clear with a CFO, and able to tell a technical objection from a procurement one.

Nice To Haves

• Hands-on experience with inference internals: vLLM, SGLang, or TRT-LLM, batching, KV cache math, quantization.
• Experience with agentic or coding-assistant workloads at scale.
• Prefix-cache-heavy long context workloads.
• Diffusion image/video, ASR/TTS, or multi-LoRA serving.
• Open-source contributions to vLLM or SGLang.
• Deep NVLink/InfiniBand topology knowledge.

Responsibilities

• Own the technical win and the POC timeline, working closely with Sales and Engineering, from call one.
• Design and run reproducible benchmark harnesses (TTFT, ITL, throughput/GPU, p95/p99) and quality-parity evals.
• Run head-to-head bake-offs against leading AI providers — and win them.
• Tune model-to-hardware deployments on B200/B300/GB300 NVL72.
• Build cost-per-token models and write migration plans.
• Handle enterprise security and compliance review, and get deployments to launch readiness.
• Own account health post-signature, driving usage reviews and expansion.
• Turn what you learn into reusable benchmark reports, reference architectures, and AE enablement material.

Benefits

• Define DeepInfra's Forward Deployed Engineering function from day one and have a direct impact on its direction.
• Work directly with co-founders and the inference team on the deals that matter most.
• Join a small, high-performing team where your work ships quickly and reaches customers around the world.
• Help shape how enterprises adopt some of the world's leading open-source AI models.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed