Senior Software Engineer, Cluster Orchestration
About The Position
As part of the Cluster Orchestration team, you will play a key role in advancing CoreWeave’s orchestration platform including SUNK (Slurm on Kubernetes) and beyond our Kubernetes-native foundation that powers AI training and inference at scale. This is an opportunity to help shape one of the most critical layers of the AI cloud: ensuring workloads run seamlessly, reliably, and efficiently across massive GPU clusters. By building the systems that eliminate infrastructure bottlenecks and create new orchestration capabilities, you will directly empower customers to innovate faster and push the boundaries of what’s possible with AI. About the role: As a Senior Software Engineer I (IC3), you will own multiple services within the orchestration platform. You’ll lead design/code reviews, decompose projects into milestones, and drive measurable improvements in reliability and performance. You’ll define SLIs/SLOs for your services, strengthen operational practices, and mentor IC1/IC2 engineers. Your work will ensure customers see consistent improvements in throughput, latency, and system resilience.
Requirements
- ~3–5 years of professional software engineering experience building distributed systems or cloud services.
- Strong coding in Go (Python or C++ a plus) with solid CS fundamentals.
- Hands-on experience running Kubernetes at production scale.
- Familiarity with observability stacks (Prometheus, Grafana, OpenTelemetry).
- Proven ability to improve service reliability and performance using metrics (P95/P99 latency, throughput, error budgets).
Nice To Haves
- Familiarity with orchestration and workflow technologies such as Ray, Kubeflow, Kueue, Istio, Knative, or Argo Workflows
- Experience with distributed workloads, GPU-based applications, or ML pipelines.
- Knowledge of scheduling concepts like quota enforcement, pre-emption, and scaling strategies.
- Exposure to reliability practices including SLOs, alarms, and post-incident reviews.
Responsibilities
- Own multiple services within the orchestration platform
- Lead design/code reviews
- Decompose projects into milestones
- Drive measurable improvements in reliability and performance
- Define SLIs/SLOs for your services
- Strengthen operational practices
- Mentor IC1/IC2 engineers
- Ensure customers see consistent improvements in throughput, latency, and system resilience.
Benefits
- Medical, dental, and vision insurance - 100% paid for by CoreWeave
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Ability to Participate in Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Family-Forming support provided by Carrot
- Paid Parental Leave
- Flexible, full-service childcare support with Kinside
- 401(k) with a generous employer match
- Flexible PTO
- Catered lunch each day in our office and data center locations
- A casual work environment
- A work culture focused on innovative disruption
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
1,001-5,000 employees
