Senior Data Engineer - Data and AI Platform

Visa•Foster City, CA

8h•Hybrid

About The Position

The Data and Artificial Intelligence Platform (DAP) group is a key component of Visa's Technology organization that provides the enabling technology and processes to handle Visa's data assets and deliver valuable information, products, and services to customers. DAP delivers secure, high-quality and easy-to-use Visa core data assets as a service, together with reliable and scalable data platform as a service, to enable Visa and our partners to rapidly and efficiently innovate data-driven business products and services to lead the digital payment industry. Areas of focus include Business Intelligence and Analytics, Artificial Intelligence, Machine Learning, Data as a Service, and Platform as a Service etc. The portfolio comprises of over 60 data products & platforms for various external clients and internal lines of business. We provide services on behalf of traditional bank customers to millions of cardholders and merchants globally. Our application development is on the cutting edge of technology, and we are viewed as innovative leaders within our industry. Essential Functions: Design code and systems that touch 40% of the world population while influencing Visa’s internal standards for scalability, security, and reusability Design, develop, and maintain robust and scalable data pipelines and ETL processes Ensure data services are highly available, secure, scalable, and resilient. Improve and support production systems, ensuring that production issues are promptly resolved Collaborate multi-functionally to create design artifacts and develop best-in-class software solutions for multiple Visa technical offerings Leverage innovative technologies to build the next generation of Payment Services, Transaction Platforms, Real-Time Payments, and Buy Now Pay Later Technology Opportunities to make a difference on a global or local scale through mentorship and continued learning opportunities Adhere to established software development guidelines, security standards and responsible use of Gen AI tools and frameworks Begins to develop and design architect solutions, considering integrations with other solutions. Provides relevant knowledge on the development of user documentation of solutions and follows standard processes in user documentation. This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Requirements

2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience
Strong programming skills in at least two of the following languages: Java, Python, Go, Scala, C, SQL, Spark, Big Data.
Experience utilizing GenAI technologies in software development.
Hands-on experience developing data processing pipeline, feature extraction, production deployment and monitoring.
Expertise with Apache Spark, Kafka, Hadoop, Hive, Trino, Presto, Apache Airflow and NoSQL databases like Hbase working with PB level data volume.
Knowledge of Linux/Unix with ability to develop shell scripts, scripting for job scheduling using Airflow and strong data analysis skills using SQL and knowledge of Database technologies like MySQL, Postgres etc.
The ability to develop and use Application Program Interfaces (APIs), a set of routines, protocols, and tools for building software applications that specify how software components should interact and are used when programming graphical user interface (GUI) components.
Knowledge of and the ability to use database software (e.g., applications, web-based applications, information systems) to maintain, modify, and output data.

Nice To Haves

3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD).
Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef desirable.

Responsibilities

Design code and systems that touch 40% of the world population while influencing Visa’s internal standards for scalability, security, and reusability
Design, develop, and maintain robust and scalable data pipelines and ETL processes
Ensure data services are highly available, secure, scalable, and resilient.
Improve and support production systems, ensuring that production issues are promptly resolved
Collaborate multi-functionally to create design artifacts and develop best-in-class software solutions for multiple Visa technical offerings
Leverage innovative technologies to build the next generation of Payment Services, Transaction Platforms, Real-Time Payments, and Buy Now Pay Later Technology
Opportunities to make a difference on a global or local scale through mentorship and continued learning opportunities
Adhere to established software development guidelines, security standards and responsible use of Gen AI tools and frameworks
Begins to develop and design architect solutions, considering integrations with other solutions.
Provides relevant knowledge on the development of user documentation of solutions and follows standard processes in user documentation.