Senior Data Engineer

Capgemini • Atlanta, GA

1d • Hybrid

About The Position

We are seeking an experienced Databricks Platform Architect who can work with our client(s) in defining and delivering end to end analytics and data science solutions on the Databricks Lakehouse Platform. Has experience and extensively worked with Iceberg for open table format workloads and cross-platform interoperability between Databricks, Snowflake and Microsoft Fabric. Has good experience in designing SQL and Spark based Transformations on Databricks, the person needs to be experienced enough to showcase the technical maturity on various aspects of data architecture and advise the customer on a architecture that complements Databricks Iceberg along with interoperability.

Requirements

• Experience with Databricks Lakehouse Platform.
• Extensive experience with Iceberg for open table format workloads.
• Experience with cross-platform interoperability between Databricks, Snowflake and Microsoft Fabric.
• Good experience in designing SQL and Spark based Transformations on Databricks.
• Technical maturity on various aspects of data architecture.
• Proven track record of designing and deploying large scale data platforms on Azure and Databricks.
• Strong understanding of data modeling (star/snowflake schemas), ELT/ETL patterns, and data governance.
• Excellent communication skills: ability to lead technical discussions and present to executive stakeholders.
• Good Understanding of the DBT based ETL processing.
• Databricks Certified Data Engineer Associate (or higher).
• Certification in at least one major cloud provider (AWS/Azure/GCP).

Nice To Haves

• Databricks Certified Data Architect Professional.

Responsibilities

• Building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.
• Designing and deploying large scale data platforms on Azure and Databricks.
• Designing SQL and Spark based Transformations on Databricks.
• Advising the customer on an architecture that complements Databricks Iceberg along with interoperability.

Benefits

• Paid time off based on employee grade (A-F), depending on grade: Vacation: 12-25 days
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed