Engineering Manager, Spark Connect
About The Position
At Databricks, we are building the world’s best data and AI infrastructure platform so our customers can solve the world’s toughest problems. Founded by engineers and deeply customer-obsessed, we take on hard technical challenges across the stack — and we’re only getting started. The Spark Platform organization builds the core technologies that power Databricks and the Apache Spark ecosystem. Spark Connect is a critical component of Databricks Serverless and a strategic open source investment that shapes the future developer experience of Spark. We are looking for an Engineering Manager to lead the Spark Connect team. This leader will own the Databricks Spark Connect platform, drive reliability and execution for a critical Serverless component, and lead our open source Spark Connect strategy in Apache Spark. This includes owning the OSS roadmap, partnering across teams, and driving adoption of Spark Connect in the open source ecosystem.
Requirements
- 10+ years of experience in distributed systems, infrastructure, or data platforms.
- 3+ years of experience managing high-performing engineering teams.
- Strong technical depth and a track record of owning critical production systems.
- Experience leading cross-functional initiatives and influencing technical direction.
- Passion for open source, developer platforms, and large-scale systems.
Responsibilities
- Lead the team responsible for Spark Connect, a critical component of Databricks Serverless.
- Own platform reliability, scalability, and operational excellence.
- Drive Databricks’ technical leadership in open source Spark Connect.
- Define and execute the strategy for OSS Spark Connect adoption and ecosystem growth.
- Partner across product, runtime, serverless, and OSS stakeholders to shape roadmap and architecture.
- Hire and grow a strong engineering team with high technical and operational standards.
Benefits
- At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
