Databricks Architect - R01573990

Brillio•San Francisco, CA
•$140,000 - $150,000•Onsite

About The Position

The Data Architect will design and build scalable, high-performance data solutions using Databricks and leading cloud data platforms. The role develops and maintains ETL pipelines, data models, and data warehousing solutions to support analytics, reporting, and business intelligence. It also focuses on automating data workflows, improving performance, ensuring data quality and security, and translating business requirements into technical architecture. The position is based in San Jose, California, and seeks a candidate local to California. It is a full-time role and does not offer sponsorship.

Requirements

  • At least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms.
  • Advanced proficiency with the Databricks platform and ecosystem.
  • Expertise designing and developing ETL pipelines using SQL and Python.
  • Expert-level SQL, including advanced query optimization.
  • Proficiency in Python for data engineering and automation.
  • Comprehensive knowledge of data warehousing concepts and design patterns.
  • Experience with data modeling techniques and best practices.
  • Hands-on experience with PL/SQL and T-SQL.
  • Ability to develop and maintain stored procedures for data transformation.
  • Experience with performance tuning and troubleshooting in distributed data environments.
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline.
  • Candidate must be local to California; the role does not offer sponsorship.

Nice To Haves

  • Experience with Azure Data Lake, AWS S3, or Google BigQuery.
  • Familiarity with Delta Lake and lakehouse architecture concepts.
  • Knowledge of CI/CD practices for data engineering pipelines.
  • Working experience with Scala or Java in data engineering contexts.
  • Exposure to data governance, cataloging, and lineage tools.
  • Databricks Certified Data Engineer Associate or Professional certification.
  • Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer.

Responsibilities

  • Design and architect scalable, high-performance data solutions using Databricks and leading cloud data platforms.
  • Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks for data ingestion, transformation, and loading.
  • Implement data models and data warehousing solutions that support analytics, reporting, and business intelligence.
  • Automate and streamline data workflows to improve system efficiency and reduce processing times.
  • Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components.
  • Ensure data quality, consistency, and security across data assets and platforms.
  • Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions.
  • Document architecture designs, data flows, and best practices.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service