Lead Data Engineer - Databricks Architect

Capgemini•Atlanta, GA
•$102,523 - $183,760

About The Position

Capgemini is seeking an experienced Databricks Lead Architect to lead the design, architecture, and delivery of enterprise-scale data platforms and modern analytics solutions. The role combines hands-on technical leadership with engagement of senior client stakeholders to drive business outcomes. The architect will establish data architecture practices, guide engineering teams, and deliver secure, high-performance data solutions using Databricks and cloud-native technologies. The position also contributes to client strategy and pre-sales activities.

Requirements

  • 12+ years of experience in Data Engineering, Data Platforms, and Analytics solutions.
  • 4+ years of hands-on experience designing, architecting, and delivering enterprise data solutions using Databricks.
  • Proven experience serving as a Lead Architect across multiple complex data transformation engagements.
  • Ability to independently define, design, and implement end-to-end modern data architectures leveraging Databricks and cloud-native technologies.
  • Extensive experience leading and mentoring large teams of data engineers, developers, and technical leads.
  • Expert-level hands-on development experience with PySpark, Python, and distributed data processing frameworks.
  • Strong expertise in advanced SQL development, performance tuning, and data modeling.
  • Hands-on experience with at least two major cloud platforms: Azure, AWS, or Google Cloud Platform (GCP).
  • Proven success designing and deploying Delta Lake solutions in production environments.
  • Experience building scalable batch and real-time data pipelines that ingest and process large volumes of structured, semi-structured, and unstructured data.
  • Strong understanding of data architecture principles, database design, data governance, and performance optimization.
  • Experience working directly with senior business and technology stakeholders, including executive leadership.

Responsibilities

  • Architect and deliver scalable, secure, high-performance data platforms using Databricks and cloud-native technologies.
  • Establish data architecture standards, frameworks, and best practices across programs and client engagements.
  • Lead technical strategy, solution design, and architecture reviews for enterprise data initiatives.
  • Provide technical leadership and mentorship to engineering teams throughout the software development lifecycle.
  • Design and optimize data ingestion, transformation, storage, and consumption patterns using modern lakehouse architectures.
  • Collaborate with business and technical stakeholders to define data strategies aligned with organizational objectives.
  • Drive governance, security, reliability, and performance best practices across the data ecosystem.
  • Support pre-sales activities, solution proposals, and executive-level client discussions as a trusted advisor.

Benefits

  • Paid time off, including vacation (12–25 days depending on employee grade), company-paid holidays, personal days, and sick leave.
  • Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
  • Retirement savings plans, such as a 401(k) in the U.S. or RRSP in Canada.
  • Life and disability insurance.
  • Employee assistance programs.
  • Other benefits as provided by local policy and eligibility.
  • The role may be eligible for variable incentives, bonuses, or commissions, depending on the position and applicable laws.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service