Senior Data Engineer

Capgemini • Chicago, IL

25d • Onsite

About The Position

As a Senior Data Engineer, you will design and build distributed data‑processing solutions and highly scalable database systems to support various business use cases, including reporting, product analytics, marketing optimization, and financial reporting. You will contribute as part of a self‑organized team of experienced data engineers working in a challenging and innovative environment, creating the foundation for decision‑making at a company that processes billions of events per day.
You will investigate, design, and implement solutions for complex technical challenges. You will also provide guidance, direction, and leadership to the development team to help achieve project goals.

Requirements

• 6–8 years of professional experience as a Data Engineer.
• Strong experience with Apache Spark, including techniques for optimizing Spark workloads.
• Solid experience with Spark Structured Streaming.
• Strong knowledge of Spark SQL and query performance optimization.
• Hands‑on experience with Terraform and Databricks Asset Bundles.
• Ability to work independently, prioritize effectively, and proactively identify improvement opportunities.
• Comfortable working in a loosely defined scope, contributing to both execution and prioritization.
• Excellent communication skills and experience collaborating with both technical and non‑technical teams.
• Ability to clear a HackerRank coding test.

Nice To Haves

• Experience with application development and Databricks Apps.
• Comfort working in Linux environments.
• Background in financial markets such as market making, trading, or related domains.
• Databricks certification.

Responsibilities

• Obtain tasks from the Project Lead or Team Lead (TL), prepare functional and design specifications, and review them with all stakeholders.
• Ensure that assigned areas are delivered within set deadlines and meet required quality standards.
• Provide effort estimations, align task duration with the manager, and contribute to the project plan for your assigned scope.
• Analyze alternative solutions and make implementation decisions based on technical expertise and experience.
• Lead the functional and architectural design for assigned areas, ensuring alignment with architectural and design requirements.
• Identify area‑level risks and implement appropriate mitigation plans.
• Resolve crisis situations within your area of responsibility (AOR).
• Initiate and conduct code reviews; create and enforce code standards, conventions, and guidelines.
• Suggest technical and functional improvements to enhance the product.
• Continuously improve your professional skills.
• Collaborate effectively with cross‑functional teams.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed