Software Engineer, Machine Learning Infrastructure

DoorDash USA•Sunnyvale, CA

About The Position

The GenAI Platform team builds the centralized AI infrastructure that powers every Generative AI use case at DoorDash — Search, Recommendations, Fraud, Chatbots, Merchant tools, and more. We are part of the Machine Learning Platform (MLP) org, which powers critical real-time decision-making for millions of orders each day. Our team owns: LLM Gateway — unified access to OpenAI, Anthropic, Google, and open-weights models with cost attribution, guardrails, and multi-region deployment across DoorDash, Wolt, Deliveroo, and SevenRooms MCP Gateway — authentication, tool registry, and rate limiting for MCP servers across the company Agent Gateway — infrastructure for building and deploying AI agents with tool access, streaming, and observability Evals Platform — evals with human annotation, LLM-as-a-judge, auto-calibration, and custom use-case-specific UIs for human annotation and debugging Project Slingshot (Open-Weights Models) — fine-tuning, online inference, and batch inference for open-weights LLMs We are a team of 6 engineers in a high-growth phase — every AI product team at DoorDash is building with GenAI and we need to scale our infrastructure to match. You will join the GenAI Platform team to build the foundational infrastructure layer that every AI product team at DoorDash depends on. You'll rotate across areas — agents, evals, open-weights models, and gateways — gaining broad exposure to the GenAI stack while going deep on the problems that matter most. You're excited about this opportunity because you will… Use your backend, data, and ML infrastructure expertise to help build a high-quality GenAI platform Build and improve the reliability, scalability, and monitoring of our GenAI infrastructure, including the LLM Gateway, MCP Gateway, fine-tuning systems, and model serving Build scalable, high-performance ML pipelines — from retrieval (e.g., RAG) to batch inference — that adapt quickly to new technologies Develop an easy-to-use platform that supports fast iteration and deployment of products powered by Generative AI, including AI agents and evals Collaborate with ML Engineers and Product Engineers across DoorDash, Wolt, Deliveroo, and SevenRooms to evolve the platform for their use cases Shape the direction of DoorDash's centralized GenAI platform that supports all business functions

Requirements

B.S., M.S., or Ph.D. in Computer Science or equivalent
Strong backend engineering skills — you can design APIs, build reliable services, and reason about distributed systems
Strong fundamentals in computer science and Python
2+ years of industry experience in software engineering
Experience building and deploying machine learning systems in production
Experience building infrastructure in cloud environments (AWS or GCP) — especially backend services at scale
Comfortable using AI coding tools to move fast, while applying strong engineering judgment
Problem solver who thrives on 0→1 initiatives and can navigate across multiple interconnected systems

Responsibilities

Use your backend, data, and ML infrastructure expertise to help build a high-quality GenAI platform
Build and improve the reliability, scalability, and monitoring of our GenAI infrastructure, including the LLM Gateway, MCP Gateway, fine-tuning systems, and model serving
Build scalable, high-performance ML pipelines — from retrieval (e.g., RAG) to batch inference — that adapt quickly to new technologies
Develop an easy-to-use platform that supports fast iteration and deployment of products powered by Generative AI, including AI agents and evals
Collaborate with ML Engineers and Product Engineers across DoorDash, Wolt, Deliveroo, and SevenRooms to evolve the platform for their use cases
Shape the direction of DoorDash's centralized GenAI platform that supports all business functions

Benefits

a 401(k) plan with employer matching
16 weeks of paid parental leave
wellness benefits
commuter benefits match
paid time off and paid sick leave in compliance with applicable laws (e.g. Colorado Healthy Families and Workplaces Act)
medical, dental, and vision benefits
11 paid holidays
disability and basic life insurance
family-forming assistance
a mental health program