Forward Deployed Engineer

Novita AI•San Mateo, CA

13d

About The Position

Novita AI is an AI & Agent Cloud platform for builders. We provide a unified platform for Model APIs, GPU Cloud, and Agent Sandbox infrastructure, helping developers and enterprises build, deploy, and scale production AI systems without managing complex infrastructure. Today, thousands of teams rely on Novita to power AI agents, coding tools, multimodal applications, and large-scale inference workloads. As a Forward Deployed Engineer (FDE), you’ll work at the intersection of engineering, customer success, and product. You’ll partner closely with customers to understand their AI workloads, deploy solutions, troubleshoot production issues, and influence the evolution of our platform. You will act as an extension of our customers’ engineering teams, helping them integrate model APIs, GPU infrastructure, and sandbox environments into real-world applications. This role is ideal for someone who enjoys wearing multiple hats—software engineer, solutions architect, product thinker, and trusted technical advisor.

Requirements

Strong software engineering fundamentals.
Proficiency in Python and at least one additional programming language.
Experience building or deploying cloud-native applications.
Familiarity with Docker, Kubernetes, Linux, and networking concepts.
Strong debugging and problem-solving skills in production environments.
Excellent communication skills and ability to work directly with customers.
Ability to operate with ambiguity and move quickly in a startup environment.

Nice To Haves

Experience with AI/ML infrastructure, LLMs, or inference systems.
Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.
Experience working with GPUs, CUDA, or large-scale compute systems.
Background in solutions engineering, developer relations, or customer-facing engineering roles.
Experience building AI agents, coding agents, or sandboxed execution environments.
Prior startup experience or experience as an early engineer.
Professional working proficiency in Mandarin Chinese.

Responsibilities

Work directly with customers to understand their AI products, technical requirements, and business goals.
Deploy and integrate Novita AI products, including: Model APIs and inference endpoints, Dedicated model hosting, GPU cloud infrastructure, Agent sandbox environments
Debug production issues across APIs, networking, containers, GPUs, and distributed systems.
Build customer-specific solutions, integrations, demos, and prototypes.
Travel to customer sites when necessary and collaborate closely with their engineering teams.
Translate customer feedback into product requirements and work with internal engineering teams to improve our platform.
Create reusable tooling, automation, and reference implementations that benefit future customers.
Support proof-of-concepts (PoCs) and help customers successfully move into production.