Senior Software Engineer, Compute Infrastructure

Databricks•San Francisco, CA

11h

About The Position

At Databricks, the Compute Infrastructure organization builds and operates the foundation that runs all Data, AI and stateful workloads across all major clouds. Our platform launches tens of millions of VMs per day, operates thousands of Kubernetes clusters, and must deliver extreme elasticity, reliability and cost efficiency. As a Senior Software Engineer on the Compute Infra team, you will design and build the systems that power Databricks’ compute infrastructure to enable engineers to quickly launch and scale world-class products.

Requirements

BS (or higher) in Computer Science or related field
5+ years of experience designing and building large-scale distributed systems
Strong proficiency in one or more languages such as Java, Scala, Go, or C++
Experience with service-oriented architectures and large scale distributed systems
Familiarity with cloud platforms (AWS, Azure, GCP) and container/orchestration technologies (Kubernetes, Docker)
Track record of shipping infrastructure that supports mission-critical workloads at scale

Responsibilities

Develop the compute abstractions that provide powerful capabilities for all Databricks workloads, enabling engineers to build world-class products with high velocity and best-in-class performance
Design the workload orchestration and scheduling systems that orchestrates all types of workloads (serving, batch, stateful, GPU) with high performance and efficiency
Scale the fleet management systems that launch and configure millions of VMs every day across cloud providers
Raise the technical and operational bar through strong design practices, testing, and a culture of engineering excellence and platform mindset.
Lead cross-team initiatives that span product and infrastructure surface areas.