Lead Data Engineer

Capgemini•Bridgewater, NJ

About The Position

Capgemini is seeking a highly skilled and experienced Data Engineer Lead to support and lead their data platform for a major consumer product and retail company. The ideal candidate will be responsible for overseeing the customer sub domain within the company's data platform, which supports various data acquisition, data exchange, and data management capabilities. This role requires expertise in cutting-edge technologies, including AI-related frameworks and implementations, to drive productivity gains. Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.

Requirements

Minimum of 7 years of experience in data engineering, with at least 3 years in a leadership role.
Customer (Retail stores) and product (Retail product) domain experience and expertise is mandatory.
Proficiency in data technologies (e.g., DBx, pySpark), data warehousing, ETL processes, and Microsoft Azure cloud platform.
Strong programming skills in languages such as Python and SQL.
Strong analytical and problem-solving abilities, with a focus on delivering high-quality solutions.
Azure Data Technologies: Azure Data Lake, Azure Databricks, Azure Data Factory, Azure SQL Database, Microsoft Fabric (Learning on the job).
Big Data Technologies: Pyspark, Multi-Threading.
ETL tools like - Azure Data factory, Declarative pipelines, Auto loaders, Python and SparkSQL.
Preferred to have background on AI, Large Language Models (LLMs), NLP, Prompt engineering.

Nice To Haves

Certifications: Relevant certifications in data engineering, cloud platforms, or AI/ML.
Industry Experience: Experience in the consumer product and retail industry is a plus.
Project Management: Familiarity with agile methodologies and project management tools.

Responsibilities

Oversee the development, enhancement, and maintenance of the data platform, ensuring it meets the needs of the business.
Design and implement robust data acquisition and integration processes to ensure seamless data flow from various sources.
Develop and maintain data management practices, including data governance, data quality, and data security.
Implement AI-related frameworks and advanced analytics to enhance data processing and provide actionable insights.
Develop and optimize data solutions specifically tailored to customer, consumer and product data, ensuring high-quality data for personalized marketing, customer and product insights, and improved customer experiences.
Lead and mentor a team of data engineers, providing guidance and support to ensure high performance and professional growth.
Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.
Stay updated with the latest industry trends and technologies and proactively identify opportunities to leverage new tools and techniques to improve the data platform.

Benefits

Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs
Other benefits as provided by local policy and eligibility

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume