Senior Forward Deployed Engineer II (AI/ML)

DigitalOcean•Boston, MA

1d•$167,000 - $209,000•Remote

About The Position

DigitalOcean is seeking a Senior Forward Deployed Engineer (FDE) to operationalize production AI-native and agentic workloads at scale. The role serves as a technical lead for strategic AI-native customers and platform initiatives, working across Product Engineering, AI Infrastructure, and Customer Implementation. The FDE partners with enterprises, startups, infrastructure vendors, and internal engineering teams to deploy, optimize, and scale production AI systems on DigitalOcean’s AI-Native Cloud. The position covers inference engines, runtime systems, orchestration frameworks, and AI-native applications, with an emphasis on scalability, reliability, latency, and workload economics. The FDE also validates new platform capabilities under real-world workloads, identifies operational insights and architectural gaps, and feeds findings to Product Engineering and Research teams. The role develops reusable deployment frameworks, benchmarking systems, automation tools, and AI starter kits to turn field experience into repeatable deployment patterns. The role is remote and may require travel up to 30% for customer engagements, onsite workshops, ecosystem partnerships, conferences, and internal collaboration. The stated salary range is $167,000–$209,000. A bonus may be available, and eligible employees may receive equity compensation and participate in the Employee Stock Purchase Program.

Requirements

Experience designing and operationalizing production AI systems, including inference workloads, agentic runtimes, orchestration frameworks, and AI-native applications.
Hands-on experience with inference and serving frameworks such as vLLM, SGLang, Ray Serve, NVIDIA Dynamo, llm-d, or equivalent systems.
Experience with LLM optimization techniques such as continuous batching, quantization, KV-cache optimization, and speculative decoding.
Deep expertise with NVIDIA and AMD GPU platforms and related software ecosystems, including CUDA, ROCm, TensorRT, Triton, NCCL, RCCL, NVLink, XGMI, and RoCE.
Strong proficiency with Kubernetes, distributed systems, networking, storage systems, Infrastructure as Code, and large-scale AI infrastructure architectures.
Experience with AI orchestration and agent frameworks such as LangGraph, CrewAI, MCP ecosystems, LlamaIndex, OpenAI Agents SDK, or similar runtime systems.
Understanding of workflow orchestration, deployment systems, memory patterns, and AI-native application architectures.
Strong production coding skills in Python or Go, including experience building tooling, automation systems, deployment workflows, benchmarking frameworks, and operational platforms.
Ability to benchmark and optimize AI infrastructure for scalability, reliability, GPU efficiency, runtime performance, latency, and workload economics.
Ability to establish technical credibility with CTOs, principal architects, Product Engineering teams, and ecosystem partners while managing high-impact production deployments and strategic technical initiatives.

Nice To Haves

6+ years of experience in Forward Deployed Engineering, ML Engineering, Applied AI Engineering, AI Infrastructure, Technical Consulting, or equivalent customer-facing engineering roles supporting production AI systems.
Experience building deployment standards, technical enablement programs, platform adoption frameworks, or ecosystem integration strategies across customer-facing and engineering organizations.
Active contribution to open-source AI, infrastructure, orchestration, or developer tooling ecosystems.
Experience collaborating with GPU vendors, infrastructure providers, model vendors, or ecosystem partners on benchmarking, optimization, technical validation, or launch readiness initiatives.

Responsibilities

Partner with strategic AI-native enterprises and AI startups to architect, deploy, optimize, and scale production AI and agentic systems on DigitalOcean’s AI-Native Cloud.
Support complex migrations, production-ready proofs of concept, deployment acceleration, and long-term workload expansion across inference and runtime platforms.
Optimize distributed inference and runtime performance through benchmarking, GPU efficiency tuning, KV-cache optimization, speculative decoding, prefill/decode disaggregation, multi-node deployments, and latency and cost optimization.
Validate AI-native platform capabilities, including inference engines, runtimes, orchestration systems, GPU platforms, and deployment workflows, and surface operational insights, architectural gaps, and scaling bottlenecks to Product Engineering and Research teams.
Build benchmarking systems, automation tools, AI starter kits, deployment frameworks, operational playbooks, fine-tuning workflows, and reference architectures.
Collaborate with GPU vendors, model providers, infrastructure partners, and ISVs on co-development, technical validation, optimization, and launch readiness.
Enable customer-facing and partner teams with validated deployment patterns, benchmarking insights, operational playbooks, reference architectures, demos, and technical guidance.
Travel up to 30% for customer engagements, strategic onsite workshops, ecosystem partnerships, conferences, and internal collaboration.