Senior Cloud/ML Ops Engineer
About The Position
Infrastructure Engineers build the foundation for Ivo’s entire platform. Customers are cagey about their contracts, so each customer gets their isolated environment with containers, database, VPC, etc. Things break. Regions go down. Cloud and LLM providers have “incidents.” Customers still expect us to hit our SLAs. We’re looking for an Cloud/MLOps Engineer as part of Infrastructure team to own and evolve our Kubernetes platform across AWS/GCP/Azure, design and operate multi-cluster / multi-region architectures with failover and disaster recovery strategies adhering to secure cluster isolation boundaries, build internal tooling for cluster provisioning and lifecycle management, standardizing environments (dev → staging → prod), design strategies to isolate ML vs API workloads while optimizing for cost, performance, and reliability, implement security and compliance controls at the platform layer with RBAC, workload identity, secrets management while preserving data isolation aligned with residency requirements and auditability for enterprise customers, and partner with SRE + ML teams to ensure SLOs are realistic and enforceable and models are deployed in production environments. This isn’t a “keep the lights on” role. You’ll be building the system that keeps the company running. In addition to helping us run a solid, high-performance distributed system, we’d love someone who’s as excited about LLMs as we are. You’d be deeply embedded into the engineering team and highly encouraged to push the frontiers.
Requirements
- Deep, hands-on experience with Kubernetes in production (you’ve debugged it at 2am, not just deployed to it)
- Strong experience with infrastructure as code (Pulumi, Terraform, etc.)
- Strong understanding of cluster architecture, scheduling, networking, storage primitives and failure modes in distributed systems
- Experience managing multi-cluster or multi-region setups with Github CI/CD
Nice To Haves
- Experience working in a startup environment is preferred but not required.
- Are excited about the adventure of building a company!
Responsibilities
- Own and evolve our Kubernetes platform across AWS/GCP/Azure
- Design and operate multi-cluster / multi-region architectures with failover and disaster recovery strategies adhering to secure cluster isolation boundaries
- Build internal tooling for cluster provisioning and lifecycle management, standardizing environments (dev → staging → prod)
- Design strategies to isolate ML vs API workloads while optimizing for cost, performance, and reliability
- Implement security and compliance controls at the platform layer with RBAC, workload identity, secrets management while preserving data isolation aligned with residency requirements and auditability for enterprise customers
- Partner with SRE + ML teams to ensure SLOs are realistic and enforceable and models are deployed in production environments
Benefits
- The USD salary range for this role is $250K-$325K. Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
