Senior Software Engineer – AI Infrastructure
About The Position
The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. It provides the foundation for the agent platform, ensuring model inference, orchestration, and execution layers are reliable, observable, and performant under real-world load. Working with the Agent Systems team and infrastructure partners, the team owns the core primitives that enable agents to operate safely across internal systems. The environment is high-scale and high-stakes, serving millions of users with strict reliability, latency, and correctness standards. This is a production-oriented role combining systems thinking with applied ML infrastructure experience. The engineer will build high-performance Rust services and infrastructure for AI agent systems, and help turn experimental prototypes into hardened production systems.
Requirements
- 5+ years of experience building and operating high-scale production systems.
- Strong proficiency in Rust and systems-level programming.
- Deep understanding of distributed systems, reliability engineering, and performance optimization.
- Experience operating services serving millions of users or handling high-throughput workloads.
- Familiarity with ML infrastructure, model serving, or MLOps in production environments.
- Experience designing observability, monitoring, and failure recovery systems.
- Strong collaboration skills working across infrastructure and applied engineering teams.
- A high-ownership mindset in a high-stakes production environment.
Nice To Haves
- Experience building infrastructure for agent-based or LLM-powered systems.
- Background in high-performance networking, async systems, or low-latency architectures.
- Experience with container orchestration and cloud-native infrastructure.
- Familiarity with evaluation frameworks and model performance monitoring at scale.
- Experience working in fast-moving 0→1 or platform-building teams.
Responsibilities
- Design and build the infrastructure layer powering AI agent systems in production.
- Develop high-performance Rust services for model inference, orchestration, and execution.
- Architect scalable systems capable of supporting millions of users and high request throughput.
- Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
- Define guardrails, observability, and failure handling for agent-driven workflows.
- Optimize latency, throughput, and cost across inference and orchestration layers.
- Partner with the Agent Systems team to translate experimental prototypes into hardened production systems.
- Contribute to foundational infrastructure decisions in a high-scale, high-impact environment.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
