ETL Databricks Data Engineer

Capgemini•Atlanta, GA

9h•Hybrid

About The Position

We are seeking a ETL Databricks Data Engineer to join our team and help build robust, scalable data solutions. This role involves designing and maintaining data pipelines, optimizing ETL processes, and collaborating with cross-functional teams to ensure data integrity and accessibility.

Requirements

5 years of professional experience in data engineering or related roles.
Strong proficiency in Databricks (including Spark-based data processing).
Advanced programming skills in Python.
Expertise in SQL for querying and data modeling.
Familiarity with Azure Cloud and Azure Data Factory (ADF).
Understanding of ETL frameworks, data governance, and performance tuning.
Knowledge of CI/CD practices and version control tools (e.g., Git).
Exposure to BI tools such as Power BI or Tableau for data visualization.

Responsibilities

Design, develop, and maintain scalable data pipelines and ETL processes using Databricks.
Create and optimize Python scripts for data transformation, automation, and integration tasks.
Develop and fine-tune SQL queries for data extraction, transformation, and loading.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
Ensure data integrity, security, and compliance with organizational standards.
Participate in code reviews and contribute to best practices in data engineering.

Benefits

Flexible work
Healthcare including dental, vision, mental health, and well-being programs
Financial well-being programs such as 401(k) and Employee Share Ownership Plan
Paid time off and paid holidays
Paid parental leave
Family building benefits like adoption assistance, surrogacy, and cryopreservation
Social well-being benefits like subsidized back-up child/elder care and tutoring
Mentoring, coaching and learning programs
Employee Resource Groups
Disaster Relief