Lead Data Engineer

Mastercard•O'fallon, MO

1d•Onsite

About The Position

Mastercard is the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. As a Test Lead Engineer in Data collection & Engineering (DC&E), you will have the opportunity to test high performance data pipelines which load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.

Requirements

10 to 12 years of development and testing experience in Data Warehouse related projects in product or service based organization
Expertise in ETL testing in end-to-end DW projects in Big Data environment using Spark
Experience of programming language like Java/ Python/ Unix scripting to build and enhance test automation framework
Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
Experience of working in Agile teams
Strong analytical skills required for doing data analysis and defect management process
Strong communication skills - both verbal and written - and strong relationship, collaboration skills and organisational skills
Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

Nice To Haves

Experience of working on Nifi will be an added advantage

Responsibilities

Test data pipeline using automated test framework and perform data analysis
Follow MasterCard Quality Assurance and Quality Control processes
Leverage new technologies and approaches to innovating with increasingly large data sets
Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems
Perform assigned tasks and production incident independently
Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency

Benefits

insurance (including medical, prescription drug, dental, vision, disability, life insurance)
flexible spending account and health savings account
16 weeks of new parent leave
up to 20 days of bereavement leave
80 hours of Paid Sick and Safe Time
25 days of vacation time
5 personal days
10 annual paid U.S. observed holidays
401k with a best-in-class company match
deferred compensation for eligible roles
fitness reimbursement or on-site fitness facilities
eligibility for tuition reimbursement