AWS Data Engineer

Capgemini • New York, NY

3d • $80,420 - $106,050 • Hybrid

About The Position

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Requirements

• Design and implement scalable data architectures using AWS services (S3, Redshift, Glue, Athena, EMR, DynamoDB).
• Build, optimize, and maintain ETL/ELT pipelines for structured and unstructured data.
• Develop real-time and batch ingestion pipelines using AWS Glue, Lambda, Kinesis, or Kafka.
• Utilize Spark, AWS EMR/Glue, Python, or Scala to build transformation workflows.
• Implement data quality checks, validation rules, and automated error-handling mechanisms.
• Ensure data is optimized for analytics, BI, and ML use cases.
• Build and maintain data lakes on Amazon S3 and data warehouses on Redshift/Snowflake.
• Create and optimize database schemas, partitioning, compression, and performance tuning.
• Manage metadata, cataloging, and data lineage via AWS Glue Data Catalog or similar tools.
• Implement CI/CD pipelines for data workflows using CodePipeline, CodeBuild, GitHub Actions, or Jenkins.
• Use Infrastructure-as-Code (IaC) tools like CloudFormation or Terraform to automate provisioning.
• Monitor pipelines and infrastructure using CloudWatch, CloudTrail, and AWS Config.
• Apply AWS security best practices, including IAM roles, KMS encryption, VPC networking, and Secrets Manager.
• Maintain compliance with organizational data governance and regulatory standards.
• Ensure data privacy, retention policies, and audit requirements are met.
• Partner with data scientists, analysts, and business teams to understand data requirements.
• Provide technical guidance on AWS data capabilities and architectural best practices.
• Troubleshoot pipeline failures, performance bottlenecks, and data quality issues.

Responsibilities

• Design and implement scalable data architectures using AWS services (S3, Redshift, Glue, Athena, EMR, DynamoDB).
• Build, optimize, and maintain ETL/ELT pipelines for structured and unstructured data.
• Develop real-time and batch ingestion pipelines using AWS Glue, Lambda, Kinesis, or Kafka.
• Utilize Spark, AWS EMR/Glue, Python, or Scala to build transformation workflows.
• Implement data quality checks, validation rules, and automated error-handling mechanisms.
• Ensure data is optimized for analytics, BI, and ML use cases.
• Build and maintain data lakes on Amazon S3 and data warehouses on Redshift/Snowflake.
• Create and optimize database schemas, partitioning, compression, and performance tuning.
• Manage metadata, cataloging, and data lineage via AWS Glue Data Catalog or similar tools.
• Implement CI/CD pipelines for data workflows using CodePipeline, CodeBuild, GitHub Actions, or Jenkins.
• Use Infrastructure-as-Code (IaC) tools like CloudFormation or Terraform to automate provisioning.
• Monitor pipelines and infrastructure using CloudWatch, CloudTrail, and AWS Config.
• Apply AWS security best practices, including IAM roles, KMS encryption, VPC networking, and Secrets Manager.
• Maintain compliance with organizational data governance and regulatory standards.
• Ensure data privacy, retention policies, and audit requirements are met.
• Partner with data scientists, analysts, and business teams to understand data requirements.
• Provide technical guidance on AWS data capabilities and architectural best practices.
• Troubleshoot pipeline failures, performance bottlenecks, and data quality issues.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed