Senior Forward Deployed Engineer II (AI/ML)
About The Position
DigitalOcean is seeking a Senior Forward Deployed Engineer to operationalize production AI-native and agentic workloads at scale. The role serves as a technical lead for strategic AI-native customers and platform initiatives, working at the intersection of Product Engineering, AI Infrastructure, and Customer Implementation. The engineer partners with AI-native enterprises, startups, infrastructure vendors, and internal teams to deploy, optimize, and scale production AI systems on DigitalOcean’s AI-Native Cloud. The position covers inference engines, runtime systems, orchestration frameworks, and AI-native applications, with a focus on scalability, reliability, latency, and workload economics. The engineer also acts as an early real-world user of new platform capabilities, validating products, identifying operational insights and architectural gaps, and sharing feedback with Product Engineering and Research teams. The role develops reusable deployment frameworks, benchmarking systems, automation tooling, AI starter kits, operational playbooks, and reference architectures. Success is evaluated through customer production adoption, time-to-production, product influence, adoption of FDE-built assets, and enablement of customer-facing teams and ecosystem partners. Travel of up to 30% is expected for customer engagements, workshops, partnerships, conferences, and internal collaboration. This is a remote role.
Requirements
- Experience designing and operationalizing production AI systems, including inference workloads, agentic runtimes, orchestration frameworks, and AI-native applications.
- Hands-on experience with inference and serving frameworks such as vLLM, SGLang, Ray Serve, NVIDIA Dynamo, or llm-d, or equivalent systems.
- Experience with LLM optimization techniques such as continuous batching, quantization, KV-cache optimization, and speculative decoding.
- Deep expertise with NVIDIA and AMD GPU platforms and associated software ecosystems, including CUDA, ROCm, TensorRT, Triton, NCCL, RCCL, NVLink, XGMI, and RoCE.
- Strong proficiency with Kubernetes, distributed systems, networking, storage systems, Infrastructure as Code, and large-scale AI infrastructure architectures.
- Experience with AI orchestration and agent frameworks such as LangGraph, CrewAI, MCP ecosystems, LlamaIndex, OpenAI Agents SDK, or similar runtime systems.
- Understanding of workflow orchestration, deployment systems, memory patterns, and AI-native application architectures.
- Strong production coding skills in Python or Go, with experience building tooling, automation systems, deployment workflows, benchmarking frameworks, and operational platforms.
- Proven ability to benchmark and optimize AI infrastructure, focusing on scalability, reliability, GPU efficiency, runtime performance, latency, and workload economics.
- Ability to establish technical credibility with CTOs, principal architects, Product Engineering teams, and ecosystem partners while managing high-impact production deployments and strategic technical initiatives.
Nice To Haves
- 6+ years of experience in Forward Deployed Engineering, ML Engineering, Applied AI Engineering, AI Infrastructure, Technical Consulting, or equivalent customer-facing engineering roles supporting production AI systems.
- Experience building deployment standards, technical enablement programs, platform adoption frameworks, or ecosystem integration strategies across customer-facing and engineering organizations.
- Active contribution to open-source AI, infrastructure, orchestration, or developer tooling ecosystems.
- Experience collaborating with GPU vendors, infrastructure providers, model vendors, or ecosystem partners on benchmarking, optimization, technical validation, or launch readiness initiatives.
Responsibilities
- Partner with strategic AI-native enterprises and AI startups to architect, deploy, optimize, and scale production AI and agentic systems on DigitalOcean’s AI-Native Cloud.
- Support complex migrations, production-ready proofs of concept, deployment acceleration, and long-term workload expansion across inference and runtime platforms.
- Optimize distributed inference and runtime performance through benchmarking, GPU efficiency tuning, KV-cache optimization, speculative decoding, prefill/decode disaggregation, multi-node deployments, and latency and cost optimization.
- Validate DigitalOcean AI-native platform capabilities, including the Inference Engine, runtimes, orchestration systems, GPU platforms, and deployment workflows, and report operational insights, architectural gaps, and scaling bottlenecks to Product Engineering and Research teams.
- Build benchmarking systems, automation tooling, AI starter kits, deployment frameworks, operational playbooks, finetuning workflows, and reference architectures.
- Collaborate with GPU vendors, model providers, infrastructure partners, and ISVs on co-development, technical validation, optimization, and launch readiness.
- Enable customer-facing technical teams and partner teams with validated deployment patterns, benchmarking insights, operational playbooks, reference architectures, demos, and technical guidance.
- Travel up to 30% for customer engagements, strategic onsite workshops, ecosystem partnerships, conferences, and internal collaboration.
Benefits
- Reimbursement for relevant conferences, training, and education.
- Access to LinkedIn Learning courses.
- Employee Assistance Program.
- Local employee meetups.
- Flexible time off policy.
- Possible performance-based bonus.
- Equity compensation for eligible employees, including equity grants upon hire.
- Option to participate in the Employee Stock Purchase Program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
