Data Engineer

Capgemini • Bridgewater, NJ

5d • $70,000 - $120,000 • Onsite

About The Position

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.

Requirements

• 6+ Years of Experience in Data Engineering
• At least four years of experience designing and delivering data engineering solutions with Databricks
• Ability to independently define and deploy an end to end data architecture that includes Databricks medallion architecture
• Experience leading large teams of engineers and developers to deploy Databricks solutions
• Expert level hands on development knowledge in PySpark/Python
• Expert level hands on SQL development skills
• Hands on cloud platform experience in two of the following cloud platforms: Azure, AWS, Google Cloud
• Prior expertise deploying Delta Lake Solutions into production
• Experience extracting value from large and complex sets of data from various sources and databases
• Solid grasp of database engineering and design principles
• Background working with orchestration tools, such as Airflow
• Strong knowledge of Unity Catalog
• Experienced in managing senior client stakeholders
• Delta Sharing and Marketplace Expertise
• Experience working with Databricks Apps
• Working knowledge of Databricks Genie, AI/BI and Databricks Data Visualization Capabilities

Nice To Haves

• Familiarity with CI/CD methods desired
• Past or current experience with an ETL tools such as Infomatica, Talend, Matillion desired

Responsibilities

• Building reliable and scalable data infrastructure
• Enabling organizations to derive meaningful insights
• Enabling organizations to make data-driven decisions
• Unlocking the value of their data assets
• Designing and delivering data engineering solutions with Databricks
• Defining and deploying an end-to-end data architecture that includes Databricks medallion architecture
• Leading large teams of engineers and developers to deploy Databricks solutions
• Extracting value from large and complex sets of data from various sources and databases
• Deploying Delta Lake Solutions into production
• Working with orchestration tools, such as Airflow
• Working with Databricks Apps
• Utilizing Databricks Genie, AI/BI and Databricks Data Visualization Capabilities

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed