About The Position

Capgemini is seeking a Senior Databricks Engineer with a strong ability to independently design, build, and deploy end-to-end data architectures, including implementation of the Databricks Medallion Architecture. The ideal candidate will provide technical leadership, guide architectural decisions, and mentor junior data engineers and developers within a hybrid offshore/onshore delivery model.

Requirements

  • 6+ Years of Experience in Data Engineering
  • At least four years of experience designing and delivering data engineering solutions with Databricks
  • Expert level hands on development knowledge in PySpark/Python
  • Expert level hands on SQL development skills
  • Hands on cloud platform experience in two of the following cloud platforms: Azure, AWS, Google Cloud
  • Prior expertise deploying Delta Lake Solutions into production
  • Experience extracting value from large and complex sets of data from various sources and databases
  • Solid grasp of database engineering and design principles
  • Experienced in managing senior client stakeholders

Nice To Haves

  • Familiarity with CI/CD methods desired
  • Background working with orchestration tools, such as Airflow
  • Strong knowledge of Unity Catalog
  • Past or current experience with an ETL tools such as Infomatica, Talend, Matillion desired
  • Delta Sharing and Marketplace Expertise
  • Experience working with Databricks Apps
  • Working knowledge of Databricks Genie, AI/BI and Databricks Data Visualization Capabilities
  • Conceptual, Logical and Physical Data Modeling Experience Preferred

Responsibilities

  • Define and deploy an end to end data architecture that includes Databricks medallion architecture
  • Leading large teams of engineers and developers to deploy Databricks solutions
  • Must be able to manage senior client stakeholders

Benefits

  • Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service