Lead Databricks Architect

RingcentralBelmont, CA
76d$176,750 - $252,500

About The Position

RingCentral is looking for a seasoned Lead Databricks Architect / Engineer to lead our Databricks initiative. This role will own the technical strategy, architecture, and execution roadmap, and will partner with engineering, data science, and infrastructure teams to ensure a seamless integration. The position involves defining and driving the Databricks strategy, roadmap, and architecture, including data ingestion, storage, compute, governance, and security. The successful candidate will evaluate and implement best practices for large-scale distributed data processing in Databricks, optimize performance, cost, and scalability of data pipelines, and establish monitoring, reliability, and operational standards in the new environment.

Requirements

  • 10+ years in data engineering / big data roles, with at least 3+ years of Databricks experience.
  • Proven success in migrating large Hadoop ecosystems (multi-petabyte scale preferred) to Databricks or equivalent cloud-based data platforms.
  • Deep expertise in Spark, Delta Lake, SQL, and Databricks runtime.
  • Strong understanding of cloud data architectures (AWS, Azure, or GCP) including storage (S3, ADLS, GCS), compute, networking, and security.
  • Experience with data governance, cataloging, lineage, and compliance (e.g., Alation, Collibra, Purview).
  • Proficiency in Python, SQL, and Scala for building and optimizing ETL/ELT pipelines.
  • Strong knowledge of modern data platform patterns (Lakehouse, ML/AI integration, streaming).
  • Excellent communication and leadership skills-comfortable leading cross-functional teams through complex transformations.

Nice To Haves

  • Prior leadership as lead engineer / architect on cloud data migration projects.
  • Experience with CI/CD for data pipelines, Infrastructure as Code, and DevOps practices.
  • Exposure to machine learning workflows and MLOps in Databricks.
  • Certifications: Databricks Certified Data Engineer Professional / Solutions Architect, Cloud Provider Certifications (AWS, Azure, GCP).

Responsibilities

  • Define and drive the Databricks strategy, roadmap, and architecture, including data ingestion, storage, compute, governance, and security.
  • Evaluate and implement best practices for large-scale distributed data processing in Databricks.
  • Optimize performance, cost, and scalability of data pipelines during and after migration.
  • Partner with data engineers, data scientists, and platform teams to ensure business continuity and minimal disruption during cutover.
  • Establish monitoring, reliability, and operational standards in the new environment.
  • Provide technical leadership, mentorship, and hands-on guidance to the engineering team.
  • Collaborate with cloud vendors (AWS, Azure, or GCP) to ensure alignment with platform best practices.

Benefits

  • Comprehensive medical, dental, vision, disability, life insurance
  • Health Savings Account (HSA), Flexible Spending Account (FSAs) and Commuter benefits
  • Voluntary supplemental health coverage and life insurance
  • 401K match and ESPP
  • Paid time off and paid sick leave
  • Paid parental and pregnancy leave
  • Family-forming benefits (IVF, Preservation, Adoption etc.)
  • Emergency backup care (Child/Adult/Pets)
  • Employee Assistance Program (EAP) with counseling sessions available 24/7
  • Free legal services that provide legal advice, document creation and estate planning
  • Employee bonus referral program
  • Student loan refinancing assistance
  • Employee 1:1 coaching, perks and discounts program

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Senior

Industry

Publishing Industries

Education Level

Bachelor's degree

Number of Employees

1,001-5,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service