Databricks Developer

TalentOla • Coral Springs, FL

4d

About The Position

We are looking for a skilled Databricks Developer to build and optimize data solutions on the Databricks platform, leveraging Azure cloud services to deliver scalable and high-performance data pipelines. The role involves developing data pipelines and workflows, managing data assets, optimizing workloads, and collaborating with stakeholders to implement scalable data solutions.

Requirements

• 6+ years of experience in data engineering or a similar role.
• Strong hands-on expertise with Databricks, including Delta Lake, Unity Catalog, and PySpark.
• Advanced SQL skills, including query optimization and performance tuning.
• Experience with Azure cloud services, such as Azure Data Factory, Azure Data Lake Storage, or Azure Synapse.
• Strong understanding of performance optimization techniques within Databricks.
• Knowledge of Medallion architecture.
• Ability to work independently and collaborate effectively with cross-functional teams.

Nice To Haves

• Experience with data migration projects.
• Familiarity with CI/CD pipelines and DevOps practices.
• Knowledge of other orchestration tools such as Apache Airflow.

Responsibilities

• Develop and optimize data pipelines and workflows using Databricks and PySpark.
• Work with Delta Lake for reliable and performant data storage and processing.
• Manage and govern data assets using Unity Catalog.
• Write and optimize complex SQL queries for data transformation and analytics.
• Collaborate with stakeholders to design and implement scalable data solutions.
• Monitor and tune Databricks workloads for performance and cost efficiency.
• Document solutions and contribute to engineering best practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed