Senior Staff Data Engineer

Visa•Austin, TX

6h•Hybrid

About The Position

As a Senior Consultant Data Engineer, you will join Visa's Value Added Services – Digital Marketing & Engagement organization. Your role will involve designing, enhancing, and building the Visa data token platform within an agile development environment. You will take on leadership roles in multiple projects, focusing on full-stack development of real-time scoring services, RESTful APIs, and container-based distributed services, ensuring they are highly available, secure, scalable, and resilient. The position also entails spearheading the development of next-generation software, incorporating machine learning and deep learning technologies. The team operates with self-managing Agile principles, emphasizing unit testing, code reviews, and continuous integration for high code quality and rapid deployment to production. This role is crucial for driving innovation to differentiate products and accelerate time-to-market delivery, requiring proficiency in containerization technologies like Docker and Kubernetes, expertise in Java, Spring Boot, React, and both relational and non-relational databases, alongside a strong background in data engineering with Hadoop, Spark, and Scala.

Requirements

8 or more years of relevant work experience with a Bachelor Degree OR at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) OR 2 years of work experience with a PhD
Proficiency in containerization technologies like Docker and Kubernetes
Expertise in Java, Spring Boot, React
Experience with relational and non-relational databases
Strong background in data engineering with experience in Hadoop, Spark, and Scala

Nice To Haves

9 or more years of relevant work experience with a Bachelor Degree OR 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) OR 3 or more years of experience with a PhD
Demonstrated leadership in teams delivering high-quality, large-scale, enterprise-class applications
Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark, Python, and SQL
Deep experience in Java, with experience in REST APIs, container-based technologies, and implementing containerization strategies using Docker and Kubernetes
Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models
Expertise in developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models
Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s)
Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control-M, and maintaining OPS tools
Strong experience with UI technologies, including Redux, React.js, HTML5, CSS4, and jQuery/JavaScript standards
Familiarity with Agile development incorporating TDD, CI/CD, and relational and non-relational databases
Proven track record of building applications adhering to industry best practices for reliability, availability, scalability, and operability
Ability to manage component security analysis and collaborate with security teams
Strong work ethic, focus on immediate goals, and proven experience as a technical leader
Passion for mentoring juniors and helping them reach new heights
Demonstrated proficiency with programming languages, scripting languages, code quality initiatives, and operating systems
Excellent communication and interpersonal skills, and a strong team player

Responsibilities

Represent the team in various technical forums.
Help customers achieve their business goals by understanding their requirements.
Build deep partnerships with product management to ensure that the products deliver real value.
Analyze business requirements and architect highly secure, robust, and scalable solutions.
Drive internal proof of concept initiatives.
Quickly design and implement a prototype of a system or component with a proper architecture, and then lead or hand over to engineering team to implement.
Champion efforts to architect, design and implement various components of our global transaction processing systems.
Follow and create software best practices and processes.
Coach and mentor team members and help them grow professionally.
Create an atmosphere of mutual accountability.
Play key role in meetings and discussions with cross-functional and non-technical teams.