Senior Software Engineer, Cluster Orchestration

CoreWeaveSunnyvale, CA
7d$139,000 - $204,000Hybrid

About The Position

As part of the Cluster Orchestration team, you will play a key role in advancing CoreWeave’s orchestration platform including SUNK (Slurm on Kubernetes) and beyond our Kubernetes-native foundation that powers AI training and inference at scale. This is an opportunity to help shape one of the most critical layers of the AI cloud: ensuring workloads run seamlessly, reliably, and efficiently across massive GPU clusters. By building the systems that eliminate infrastructure bottlenecks and create new orchestration capabilities, you will directly empower customers to innovate faster and push the boundaries of what’s possible with AI. About the role: As a Senior Software Engineer I (IC3), you will own multiple services within the orchestration platform. You’ll lead design/code reviews, decompose projects into milestones, and drive measurable improvements in reliability and performance. You’ll define SLIs/SLOs for your services, strengthen operational practices, and mentor IC1/IC2 engineers. Your work will ensure customers see consistent improvements in throughput, latency, and system resilience.

Requirements

  • ~3–5 years of professional software engineering experience building distributed systems or cloud services
  • Strong coding in Go (Python or C++ a plus) with solid CS fundamentals
  • Hands-on experience running Kubernetes at production scale
  • Familiarity with observability stacks (Prometheus, Grafana, OpenTelemetry)
  • Proven ability to improve service reliability and performance using metrics (P95/P99 latency, throughput, error budgets)

Nice To Haves

  • Familiarity with orchestration and workflow technologies such as Ray, Kubeflow, Kueue, Istio, Knative, or Argo Workflows
  • Experience with distributed workloads, GPU-based applications, or ML pipelines
  • Knowledge of scheduling concepts like quota enforcement, pre-emption, and scaling strategies
  • Exposure to reliability practices including SLOs, alarms, and post-incident reviews

Responsibilities

  • Own multiple services within the orchestration platform
  • Lead design/code reviews
  • Decompose projects into milestones
  • Drive measurable improvements in reliability and performance
  • Define SLIs/SLOs for your services
  • Strengthen operational practices
  • Mentor IC1/IC2 engineers
  • Ensure customers see consistent improvements in throughput, latency, and system resilience.

Benefits

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

1,001-5,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service