Senior Production Engineer, Managed AI
About The Position
Crusoe is hiring a Senior Production Engineer for its Production Engineering team, which ensures the reliability and scalability of Crusoe’s AI-optimized cloud platform. The role focuses on building and operating managed AI services at scale, drawing on distributed systems experience and hands-on work with large language models. It is central to delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive customer workloads. The engineer will design and operate managed AI services, build automation and reliability tooling for distributed AI pipelines and inference services, define and improve SLIs and SLOs, and collaborate with AI, platform, and infrastructure teams to optimize training and inference clusters. The role also involves automating observability and performance tuning, investigating reliability issues using telemetry, logs, and profiling, and contributing to distributed systems architecture for AI-first environments.
Requirements
- Strong software engineering background, including experience building production-grade systems beyond scripting or Bash.
- Demonstrated experience in distributed systems design and implementation.
- Hands-on work with large language models (LLMs) or AI/ML infrastructure.
- SRE mindset and experience, including defining and measuring SLIs/SLOs, building monitoring and observability systems, driving performance and reliability improvements, and designing fault-tolerant systems and automated testing strategies.
- Proficiency in at least one modern programming language: Python, Go, Java, or C++.
- Familiarity with Kubernetes or container orchestration platforms.
- Strong collaboration and communication skills.
- Ability to thrive in a fast-paced, mission-driven environment.
Nice To Haves
- Experience scaling inference or training workloads for LLMs.
Responsibilities
- Design and operate reliable managed AI services, focusing on serving and scaling LLM workloads.
- Build automation and reliability tooling for distributed AI pipelines and inference services.
- Define, measure, and improve SLIs and SLOs across AI workloads.
- Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
- Automate observability by building telemetry and performance-tuning strategies for latency-sensitive AI services.
- Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
- Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments.
Benefits
- Industry-competitive pay.
- Restricted Stock Units (RSUs).
- Health insurance options including HDHP and PPO, vision, and dental coverage for employees and dependents.
- Employer contributions to HSA accounts.
- Paid parental leave.
- Paid life insurance and short-term and long-term disability coverage.
- Teladoc.
- 401(k) with a 100% match up to 4% of salary.
- Generous paid time off and holiday schedule.
- Cell phone reimbursement.
- Tuition reimbursement.
- Subscription to the Calm app.
- MetLife Legal.
- Company-paid commuter benefit of $300 per month.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
