Senior Data Engineer
About The Position
We are seeking a Senior Data Engineer to join our Data Engineering organization. This is a hands‑on engineering role responsible for designing, developing, and operating scalable, high‑performance data pipelines and distributed data processing systems that support Visa’s commercial data platforms and products. The role involves working independently on defined components, contributing across the full SDLC, and collaborating closely with product managers, architects, platform teams, operations, and PMO partners. This position supports modern data engineering practices by leveraging AI‑assisted techniques, including Generative AI and agentic workflows, to improve data quality, automation, productivity, and documentation, while adhering to Visa’s security, privacy, and governance standards.
Requirements
- 2 or more years of work experience with a Bachelor’s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)
- 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
- Bachelor’s or Master's degree in computer science, Engineering, or a related technical field
- Typically, 2-5 years of relevant experience in data engineering, software engineering, or distributed systems.
- Experience working in large‑scale data platforms, data processing systems, or commercial/enterprise data domains.
Responsibilities
- Design, build, and optimize large‑scale data pipelines and ETL/ELT workflows for batch and streaming processing
- Develop and maintain distributed data processing solutions using Apache Spark, including performance tuning and optimization
- Implement production‑grade data engineering solutions using Scala and Python (and Java where applicable)
- Write, optimize, and maintain complex SQL queries for data transformation, validation, and analytics
- Work in a UNIX/Linux environment, including scripting and automation for job execution and operational support
- Apply data modeling, schema design, and transformation logic to support analytics and operational use cases
- Ensure data quality, integrity, reliability, and security through automated validations, monitoring, and operational controls
- Translate design artifacts into production‑ready code following Visa engineering standards and secure development practices
- Perform code reviews, unit testing, functional testing, and integration testing
- Contribute to CI/CD pipelines, automation, and release readiness activities
- Leverage Generative AI and AI/ML in data engineering workflows to improve productivity, data quality, anomaly detection, monitoring, and automated validations with human oversight.
- Build and use AI Agents / Agentic AI to automate and orchestrate engineering workflows across validation, testing, CI execution, and operational checks.
- Passionately continuously learn and apply new technologies to improve data engineering solutions and workflows.
- Mentor junior engineers and contribute to continuous improvement of engineering standards, processes, and best practices
- Collaborate with product managers, architects, platform teams, operations, and PMO to manage dependencies and deliver committed outcomes
- Communicate progress, risks, issues, and dependencies clearly and proactively
- Support production releases, monitoring, incident investigation, and root‑cause analysis
- Create and maintain technical documentation, runbooks, and operational procedures
Benefits
- Medical
- Dental
- Vision
- 401(k)
- FSA/HSA
- Life Insurance
- Paid Time Off
- Wellness Program
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
