AWS/Kafka Data Engineer - Senior Software Engineer

Capgemini • Chicago, IL

1d • Hybrid

About The Position

Capgemini is hiring an experienced software and data engineering professional to design, build, and deploy real-time and batch data pipelines that integrate disparate ERP systems with downstream data lakes and platforms. The role uses AWS, Apache Kafka and related streaming technologies to process and transform high-volume change data capture (CDC) and transactional data.

The engineer will build Java and Spring Boot microservices and integration layers, deploy containerized applications using Docker and Kubernetes, optimize relational database environments, and manage infrastructure as code and CI/CD pipelines. The role also includes setting up monitoring, application performance management, logging, and alerting to support pipeline health and transactional accuracy. This is a hybrid role based in Atlanta, Dallas, Chicago, Nashville, or New Jersey.

Requirements

• 10+ years of software or data engineering experience.
• Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python.
• Expertise in AWS Managed Kafka for data and integration.
• Experience designing and configuring AWS Managed Kafka.
• Experience with PostgreSQL, MySQL, SQL Server, and Oracle.

Responsibilities

• Design, build, and deploy real-time and batch data pipelines integrating ERP systems with downstream data lakes and platforms.
• Use Apache Kafka, Kafka Connect, and Kafka Streams or Apache Flink to process and transform high-volume CDC and transactional data.
• Build resilient microservices and integration layers with Java and Spring Boot to orchestrate data flows and enterprise APIs.
• Package applications in Docker containers and manage deployments, service discovery, and orchestration using Kubernetes.
• Optimize environments using PostgreSQL, MySQL, SQL Server, and Oracle.
• Manage infrastructure as code using Terraform or AWS CloudFormation.
• Build automated CI/CD deployment pipelines using GitHub Actions.
• Set up end-to-end monitoring, APM, log management, and alerting using tools such as DataDog, New Relic, or Splunk.

Benefits

• Paid time off, including vacation (12–25 days depending on employee grade), company-paid holidays, personal days, and sick leave, according to policy.
• Medical, dental, and vision coverage, or provincial healthcare coordination in Canada.
• Retirement savings plans, such as 401(k) in the U.S. or RRSP in Canada.
• Life and disability insurance.
• Employee assistance programs.
• The role may be eligible for variable incentives, bonuses, or commissions, depending on position and applicable laws.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed