Data Engineer (Pyspark)

Capgemini • New York, NY

2d • $80,420 - $106,050 • Onsite

About The Position

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Requirements

• Databricks (Unity Catalog, Delta Live Tables, Workflows, Asset Bundles)
• Apache Spark
• Scala
• Apache Iceberg
• Delta Lake

Responsibilities

• Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Databricks (Unity Catalog, Delta Live Tables, Workflows, Asset Bundles), Apache Spark, and Scala to process large volumes of structured and unstructured data.
• Architect and manage data lake house solutions leveraging Apache Iceberg and Delta Lake for table format management, versioning, time travel, and efficient data storage and retrieval at scale.
• Build and maintain robust backend data services and APIs, integrating Databricks with downstream systems, enabling real-time and batch data consumption across enterprise platforms.
• Collaborate with data architects, analysts, and engineering teams to define data models, establish best practices, and drive continuous improvement across the data platform.

Benefits

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed