Lead Software Engineer

Mastercard • O'fallon, MO

1d

About The Position

At Mastercard, we’re shaping the future of data integrity and trust to empower organization wide Data and Analytics platforms. We are looking for a hands-on Data Engineer with strong software engineering skills to design and implement scalable, cloud-based solutions that ensure the accuracy, consistency, and reliability of our data pipelines. This role is highly technical—about 70% coding—and will evolve to lead AI-driven data processing initiatives. If you’re passionate about building robust data systems, working with cutting-edge technologies like Databricks, PySpark, and AWS, and want to make a global impact, we’d love to hear from you.

Requirements

• Strong software engineering background with experience in data engineering roles.
• Proficiency in: PySpark, Databricks, and Python for pipeline development.
• AWS cloud services (S3, Glue, Lambda, Redshift).
• Working experience of Graph databases and G-Sql.
• Workflow orchestration tools (Apache Airflow, AWS Step Functions).
• Advanced SQL for validation and reconciliation.
• Ability to design and deploy solutions for streaming and batch data.
• Excellent problem-solving and communication skills.

Nice To Haves

• Experience with AI/ML-based anomaly detection.
• Exposure to CI/CD pipelines and DevOps practices.
• Exposure to master data management platform
• Knowledge of Scala or advanced Python.

Responsibilities

• Develop & Optimize: Build and maintain data processing and data quality frameworks using PySpark, Databricks, and Python.
• Design & Deploy: Architect and implement ETL/ELT pipelines leveraging AWS services (S3, Glue, Lambda, Redshift) and streaming data solutions.
• Monitor & Automate: Implement data quality checks, anomaly detection, and workflow orchestration using Apache Airflow, AWS Step Functions, and Unix shell scripting.
• Collaborate: Work closely with data engineers, scientists, and business stakeholders to define standards and resolve data issues.
• Lead & Mentor: Provide technical guidance to junior engineers and contribute to best practices across the team.
• Future Focus: Drive adoption of AI-based tools for anomaly detection and predictive data quality improvements.

Benefits

• insurance (including medical, prescription drug, dental, vision, disability, life insurance)
• flexible spending account and health savings account
• paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave)
• 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire
• 10 annual paid U.S. observed holidays
• 401k with a best-in-class company match
• deferred compensation for eligible roles
• fitness reimbursement or on-site fitness facilities
• eligibility for tuition reimbursement

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed