Data Engineer - Azure, Databricks

Capgemini • Chicago, IL

3d • Remote

About The Position

Capgemini is looking to hire a senior Azure Databricks Data Engineer with Martech experience in Cinncinnati Ohio. This role involves providing L1.5, L2, and L3 production support for Azure and Databricks-based data pipelines and applications. The engineer will troubleshoot failures, conduct root-cause analysis, and maintain documentation. Responsibilities also include monitoring system health, optimizing Spark/Databricks workloads, executing production changes, and collaborating with various teams to drive platform reliability and automation.

Requirements

• 6-7 years of experience in data engineering with strong expertise in Azure Data Factory/Synapse, ADLS Gen2, Azure SQL, Key Vault, and Databricks (Spark, Delta Lake, Unity Catalog).
• Hands-on proficiency in PySpark and SQL, with strong debugging skills for production data pipelines.
• Martech experience
• Good understanding of ITIL processes including Incident, Problem, and Change Management.
• Experience with Azure Monitor, Log Analytics, and CI/CD platforms (Azure DevOps/Git).
• Strong analytical, communication, and documentation skills.
• Ability to work in on-call or high-severity incident environments.

Responsibilities

• Provide L1.5, L2, and L3 production support for Azure and Databricks-based data pipelines and applications.
• Troubleshoot failures related to ingestion, transformations, scheduling, performance, and schema drift.
• Conduct root-cause analysis, implement permanent fixes, and maintain runbooks, SOPs, and knowledge articles.
• Monitor system health, SLAs, job performance, and platform costs using Azure and Databricks observability tools.
• Optimize Spark/Databricks workloads including cluster tuning, Delta Lake optimization, and job performance enhancements.
• Execute controlled production changes and participate in incident, problem, and change management processes.
• Collaborate with engineering, operations, and business teams to implement automation and drive platform reliability.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed