Senior Data Engineer
About The Position
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
Requirements
- Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience
- Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
- Programming experience with Python, Shell scripting and SQL
- Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
- Solid experience implementing solutions on AWS based data lakes.
- Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch
- Serverless application development using AWS Lambda
- Experience in AWS data lake/data warehouse/business analytics
- Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
- Knowledge of ETL/ELT
- End-to-end data solutions (ingest, storage, integration, processing, access) on AWS
- Good understanding of Lakehouse/data cloud architecture
Nice To Haves
- AWS Solutions Architect or AWS Developer Certification preferred
Responsibilities
- Designing, building and maintaining efficient, reusable, and reliable architecture and code.
- Build reliable and robust Data ingestion pipelines (within AWS, on-prem to AWS ,etc.)
- Ensure the best possible performance and quality of high scale data engineering project
- Participate in the architecture and system design discussions
- Independently perform hands on development and unit testing of the applications.
- Collaborate with the development team and build individual components into complex enterprise web systems.
- Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.
- Responsible to identify and resolve any performance issues
- Keep up to date with new technology development and implementation
- Participate in code review to make sure standards and best practices are met.
- Architect and implement CI/CD strategy for EDP
- Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)
- Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
- Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift
- Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case
Benefits
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
