Azure Databricks Architect with Oil & Gas

Codetech • Houston, TX

11h • Onsite

About The Position

Lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions using Azure Databricks. Drive data engineering best practices, mentor team members, and collaborate with business stakeholders to deliver scalable, secure, and high-performance data solutions. The role supports an Azure-based data analytics ecosystem.

Requirements

• 10 years of experience in data engineering and data platform delivery.
• Strong experience leading Azure-based cloud data transformation programs.
• Proven expertise in enterprise-scale Databricks implementations.
• Experience mentoring teams and driving technical governance.
• Azure Databricks and PySpark.
• Apache Spark, Python, SQL, and T-SQL.
• Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
• Delta Lake and Databricks Workflows.
• Data modeling and data warehousing.
• Azure DevOps, data governance, and security.
• Performance tuning and optimization.
• CI/CD and automation frameworks.

Nice To Haves

• Unity Catalog.
• Airflow.
• Power BI.
• Lakehouse architecture.
• DataOps/MLOps exposure.
• Stakeholder management and client-facing communication skills.

Responsibilities

• Lead development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark.
• Architect and optimize data ingestion, transformation, and consumption layers.
• Design data models, data dictionaries, and reusable data products.
• Implement data governance, quality, security, and compliance standards.
• Optimize Spark workloads, Databricks jobs, and overall platform performance.
• Collaborate with business users, data scientists, and cross-functional teams to translate requirements into technical solutions.
• Mentor and guide data engineers and junior team members.
• Drive CI/CD automation and DevOps best practices for data platforms.
• Support Data Lakehouse architecture and enterprise analytics initiatives.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed