Databricks Architect
About The Position
o Databricks (notebooks, clusters, jobs, repos, Delta Lake, Unity Catalog). o Azure cloud services: ADLS, Azure Data Factory / Synapse pipelines, Azure Key Vault, Azure DevOps, Azure Monitor/Log Analytics. o SQL (advanced query optimization, analytic functions, MPP concepts). Design target data models, Delta Lake storage patterns, partitioning, and clustering strategies to meet performance and cost goals. Own the technical setup and configuration of Databricks on Azure (workspaces, clusters, jobs, pools, repos, secret scopes, etc.). Drive integration with Azure services including Azure Data Lake Storage (ADLS), Azure Data Factory / Synapse pipelines, Azure Key Vault, Azure DevOps, Azure Monitor, and others as required. Implement and enforce governance using Unity Catalog (where applicable) for data access, lineage, and catalog management.
Requirements
- Databricks (notebooks, clusters, jobs, repos, Delta Lake, Unity Catalog).
- Azure cloud services: ADLS, Azure Data Factory / Synapse pipelines, Azure Key Vault, Azure DevOps, Azure Monitor/Log Analytics.
- SQL (advanced query optimization, analytic functions, MPP concepts).
Responsibilities
- Design target data models, Delta Lake storage patterns, partitioning, and clustering strategies to meet performance and cost goals.
- Own the technical setup and configuration of Databricks on Azure (workspaces, clusters, jobs, pools, repos, secret scopes, etc.).
- Drive integration with Azure services including Azure Data Lake Storage (ADLS), Azure Data Factory / Synapse pipelines, Azure Key Vault, Azure DevOps, Azure Monitor, and others as required.
- Implement and enforce governance using Unity Catalog (where applicable) for data access, lineage, and catalog management.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
