Senior Data Engineer
Mastercard•O'fallon, MO
•$115,000 - $184,000•Onsite
About The Position
The Enterprise Data Quality team is seeking a Senior Data Engineer to help build and scale Mastercard's next-generation Data Quality platform. This role focuses on designing and developing high-performance data pipelines, data quality frameworks, and cloud-native data solutions that improve trust, reliability, and usability of enterprise data assets. The ideal candidate is passionate about solving complex data challenges, leveraging modern big data technologies, and driving continuous innovation in a fast-paced, collaborative environment.
Requirements
- Advanced experience designing and developing scalable data pipelines using Spark, Scala, Python, Java, Databricks, and AWS Services.
- Strong expertise in data engineering, data quality frameworks, data warehousing, ETL/ELT processes, Nifi and large-scale distributed data processing environments.
- Advanced SQL skills and experience working with technologies such as Oracle, PostgreSQL, Iceberg, Ozone, Hadoop, and object storage platforms.
- Experience implementing data quality controls, validation frameworks, observability, monitoring, and incident resolution processes to improve data reliability and trust.
- Strong communicator and collaborator, capable of working effectively with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to deliver business outcomes.
Nice To Haves
- Experience applying Artificial Intelligence (AI), Machine Learning (ML), statistical modeling, and anomaly detection techniques to data quality, monitoring, and operational efficiency use cases.
- Familiarity with Deep Learning concepts, predictive analytics, pattern recognition, and AI/ML frameworks such as TensorFlow, PyTorch, or similar technologies.
- Experience leveraging Generative AI and AI-assisted development tools to improve engineering productivity, automate processes, accelerate delivery, and enhance solution quality.
- Demonstrate intellectual curiosity, a growth mindset, and a passion for continuous learning, innovation, and evaluating emerging technologies to solve complex business and data challenges.
- Relevant cloud, data engineering, big data, AI/ML, or analytics certifications are a plus.
Responsibilities
- Design, develop, and maintain scalable, high-performance data pipelines using Spark, Scala/Python/Java, Databricks, Hadoop, and cloud-native technologies to support enterprise data and analytics platforms.
- Partners with Data Strategists, Data Stewards, Product Owners, Architects, and Engineering teams to solve complex data challenges and deliver enterprise data quality and data engineering solutions.
- Implement and support data quality frameworks, validation controls, monitoring, observability, and automated remediation capabilities to improve data trust, reliability, and business outcomes.
- Develop and optimize data processing solutions using AWS services, SQL, data warehouses, and data lakes while ensuring performance, scalability, security, and operational excellence.
- Apply AI/ML techniques, anomaly detection, predictive analytics, and statistical modeling to enhance data quality monitoring, intelligent threshold recommendations, alert reduction, and root cause analysis.
- Perform production support, troubleshoot complex data issues, conduct root cause analysis, and independently resolve incidents while maintaining platform stability and service reliability.
- Contribute to architecture, engineering standards, and continuous innovation by evaluating emerging technologies, Generative AI capabilities, and best practices that improve data quality, developer productivity, and operational efficiency.
Benefits
- insurance (including medical, prescription drug, dental, vision, disability, life insurance)
- flexible spending account and health savings account
- 16 weeks of new parent leave
- up to 20 days of bereavement leave
- 80 hours of Paid Sick and Safe Time
- 25 days of vacation time
- 5 personal days
- 10 annual paid U.S. observed holidays
- 401k with a best-in-class company match
- deferred compensation for eligible roles
- fitness reimbursement or on-site fitness facilities
- eligibility for tuition reimbursement
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
