Senior Forward Deployed Engineer II (AI/ML)
About The Position
DigitalOcean is seeking a Senior Forward Deployed Engineer to operationalize production AI-native and agentic workloads at scale. The role serves as a technical lead for strategic AI-native customers and platform initiatives, working at the intersection of Product Engineering, AI Infrastructure, and Customer Implementation. The engineer partners with AI-native enterprises, startups, infrastructure vendors, and internal teams to deploy, optimize, and scale production AI systems on DigitalOcean’s AI-Native Cloud. The work spans inference engines, runtime systems, orchestration frameworks, and AI-native applications, with emphasis on scalability, reliability, latency, and workload economics. The FDE also acts as an early user of new platform capabilities, validating them against real workloads and sharing operational insights and architectural gaps with Product Engineering and Research. The role builds reusable deployment frameworks, benchmarking systems, automation tooling, AI starter kits, operational playbooks, fine-tuning workflows, and reference architectures. Success is assessed through production workload adoption, time-to-production, platform improvements, adoption of FDE-built assets, and customer and ecosystem enablement. The position is remote and may require travel up to 30%.
Requirements
- Experience designing and operationalizing production AI systems, including inference workloads, agentic runtimes, orchestration frameworks, and AI-native applications.
- Hands-on experience with inference and serving frameworks such as vLLM, SGLang, Ray Serve, NVIDIA Dynamo, llm-d, or equivalent systems.
- Experience with LLM optimization techniques such as continuous batching, quantization, KV-cache optimization, and speculative decoding.
- Deep expertise with NVIDIA and AMD GPU platforms and related software ecosystems, including CUDA, ROCm, TensorRT, Triton, NCCL, RCCL, NVLink, XGMI, and RoCE.
- Strong proficiency with Kubernetes, distributed systems, networking, storage systems, Infrastructure as Code, and large-scale AI infrastructure architectures.
- Experience with AI orchestration and agent frameworks such as LangGraph, CrewAI, MCP ecosystems, LlamaIndex, OpenAI Agents SDK, or similar runtime systems.
- Understanding of workflow orchestration, deployment systems, memory patterns, and AI-native application architectures.
- Strong production coding skills in Python or Go, including experience building tooling, automation systems, deployment workflows, benchmarking frameworks, and operational platforms.
- Ability to benchmark and optimize AI infrastructure, focusing on scalability, reliability, GPU efficiency, runtime performance, latency, and workload economics.
- Ability to establish technical credibility with CTOs, principal architects, Product Engineering teams, and ecosystem partners while managing high-impact production deployments and strategic technical initiatives.
Nice To Haves
- Six or more years of experience in Forward Deployed Engineering, ML Engineering, Applied AI Engineering, AI Infrastructure, Technical Consulting, or equivalent customer-facing engineering roles supporting production AI systems.
- Experience building deployment standards, technical enablement programs, platform adoption frameworks, or ecosystem integration strategies across customer-facing and engineering organizations.
- Active contribution to open-source AI, infrastructure, orchestration, or developer tooling ecosystems.
- Experience collaborating with GPU vendors, infrastructure providers, model vendors, or ecosystem partners on benchmarking, optimization, technical validation, or launch readiness initiatives.
Responsibilities
- Partner with strategic AI-native enterprises and AI startups to architect, deploy, optimize, and scale production AI and agentic systems on DigitalOcean’s AI-Native Cloud.
- Support complex migrations, production-ready proofs of concept, deployment acceleration, and long-term workload expansion across inference and runtime platforms.
- Benchmark and optimize distributed inference and runtime performance, including GPU efficiency, KV-cache use, speculative decoding, prefill/decode disaggregation, multi-node deployments, latency, and cost.
- Validate AI-native platform capabilities, including inference engines, runtimes, orchestration systems, GPU platforms, and deployment workflows, using real-world workloads.
- Identify and communicate operational insights, architectural gaps, and scaling bottlenecks to Product Engineering and Research teams.
- Build deployment frameworks, benchmarking systems, automation tooling, AI starter kits, operational playbooks, fine-tuning workflows, and reference architectures.
- Collaborate with GPU vendors, model providers, infrastructure partners, and ISVs on co-development, technical validation, optimization, and launch readiness.
- Enable customer-facing and partner teams with validated deployment patterns, benchmarking insights, operational playbooks, reference architectures, demos, and technical guidance.
- Travel up to 30% for customer engagements, strategic onsite workshops, ecosystem partnerships, conferences, and internal collaboration.
Benefits
- Reimbursement for relevant conferences, training, and education.
- Access to LinkedIn Learning courses.
- Employee Assistance Program.
- Local Employee Meetups.
- Flexible time off policy.
- Potential performance-based bonus.
- Equity compensation for eligible employees, including equity grants upon hire.
- Option to participate in the Employee Stock Purchase Program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
