Senior Forward Deployed Engineer II (AI/ML)
About The Position
DigitalOcean is seeking a Senior Forward Deployed Engineer to operationalize production AI-native and agentic workloads at scale. The role serves as a technical lead for strategic AI-native customers and platform initiatives, working across Product Engineering, AI Infrastructure, and customer implementation. The engineer will partner with AI-native enterprises, startups, infrastructure vendors, and internal teams to deploy, optimize, and scale production AI systems on DigitalOcean’s AI-Native Cloud. Work spans inference engines, runtime systems, orchestration frameworks, and AI-native applications, with an emphasis on scalability, reliability, latency, and workload economics. The role also validates new platform capabilities under real-world workloads, identifies operational insights and architectural gaps, and provides feedback to Product Engineering and Research. It builds reusable deployment frameworks, benchmarking systems, automation tooling, and AI starter kits to turn field learning into repeatable deployment patterns. Travel of up to 30% is required for customer engagements, workshops, ecosystem partnerships, conferences, and internal collaboration.
Requirements
- Experience designing and operationalizing production AI systems, including inference workloads, agentic runtimes, orchestration frameworks, and AI-native applications.
- Hands-on experience with inference and serving frameworks such as vLLM, SGLang, Ray Serve, NVIDIA Dynamo, or llm-d, or equivalent systems.
- Experience with LLM optimization techniques such as continuous batching, quantization, KV-cache optimization, and speculative decoding.
- Deep expertise with NVIDIA and AMD GPU platforms and software ecosystems, including CUDA, ROCm, TensorRT, Triton, NCCL, RCCL, NVLink, XGMI, and RoCE.
- Proficiency with Kubernetes, distributed systems, networking, storage systems, Infrastructure as Code, and large-scale AI infrastructure architectures.
- Experience with AI orchestration and agent frameworks such as LangGraph, CrewAI, MCP ecosystems, LlamaIndex, or OpenAI Agents SDK, or similar runtime systems.
- Understanding of workflow orchestration, deployment systems, memory patterns, and AI-native application architectures.
- Strong production coding skills in Python or Go, including experience building tooling, automation systems, deployment workflows, benchmarking frameworks, or operational platforms.
- Ability to benchmark and optimize AI infrastructure for scalability, reliability, GPU efficiency, runtime performance, latency, and workload economics.
- Ability to establish technical credibility with CTOs, principal architects, Product Engineering teams, and ecosystem partners while managing high-impact production deployments and strategic technical initiatives.
Nice To Haves
- 6+ years of experience in Forward Deployed Engineering, ML Engineering, Applied AI Engineering, AI Infrastructure, Technical Consulting, or equivalent customer-facing engineering roles supporting production AI systems.
- Experience building deployment standards, technical enablement programs, platform adoption frameworks, or ecosystem integration strategies across customer-facing and engineering organizations.
- Active contribution to open-source AI, infrastructure, orchestration, or developer tooling ecosystems.
- Experience collaborating with GPU vendors, infrastructure providers, model vendors, or ecosystem partners on benchmarking, optimization, technical validation, or launch readiness.
Responsibilities
- Architect, deploy, optimize, and scale production AI and agentic systems for strategic AI-native enterprises and startups on DigitalOcean’s AI-Native Cloud.
- Support complex migrations, production-ready proofs of concept, deployment acceleration, and workload expansion across inference and runtime platforms.
- Benchmark and optimize distributed inference and runtime performance, including GPU efficiency, KV-cache optimization, speculative decoding, prefill/decode disaggregation, multi-node deployments, latency, and cost.
- Validate AI-native platform capabilities, including inference engines, runtimes, orchestration systems, GPU platforms, and deployment workflows, and share operational insights and scaling gaps with Product Engineering and Research.
- Build benchmarking systems, automation tooling, AI starter kits, deployment frameworks, operational playbooks, finetuning workflows, and reference architectures.
- Collaborate with GPU vendors, model providers, infrastructure partners, and ISVs on co-development, technical validation, optimization, and launch readiness.
- Enable customer-facing and partner teams with validated deployment patterns, benchmarking insights, operational playbooks, reference architectures, demos, and technical guidance.
- Travel up to 30% for customer engagements, strategic onsite workshops, ecosystem partnerships, conferences, and internal collaboration.
Benefits
- Reimbursement for relevant conferences, training, and education.
- Access to LinkedIn Learning courses.
- Employee Assistance Program.
- Local Employee Meetups.
- Flexible time-off policy.
- Possible bonus based on company and individual performance.
- Equity compensation for eligible employees, including equity grants upon hire.
- Option to participate in the Employee Stock Purchase Program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
