Senior Software Engineer- Product Reliability Engineering

Visa•Austin, TX

2d•Onsite

About The Position

Visa is hiring a Senior Software Engineer for its Product Reliability Engineering (PRE) team. PRE is a software engineering organization focused on infrastructure as code, reliability, and automation for systems supporting Visa’s global payment network. The engineer will build, automate, and evolve platforms and workflows that support real-time transactions at global scale, working across AI, infrastructure, data platforms, and distributed systems. The role includes developing end-to-end automation for deployment pipelines, infrastructure provisioning, platform operations, and release orchestration; building and operating relational database platforms; and creating GenAI-powered tools for deployment, observability, incident response, and developer productivity. The engineer will also build monitoring and telemetry solutions, improve platform reliability and security, troubleshoot production systems, and contribute to highly available infrastructure across cloud-native and hybrid environments. The position involves collaboration with software engineers, product managers, platform teams, and global PRE colleagues. The engineer will participate in design and code reviews, maintain technical documentation and runbooks, take ownership of initiatives from design through operational support, and participate in on-call rotations and incident response. Visa requires at least three days in the office; the specific days will be confirmed by the Hiring Manager. Work hours vary according to departmental needs, and travel is required 5–10% of the time. The position is performed in an office setting and involves sitting and standing at a desk, communicating in person and by telephone, and frequently using standard office equipment such as telephones and computers.

Requirements

Bachelor’s degree with at least 2 years of relevant professional experience, or an advanced degree with at least 2 years of relevant experience, or at least 5 years of relevant work experience.
Strong problem-solving, communication, and collaboration skills, including the ability to work effectively across globally distributed teams.
Ability to translate user and platform requirements into maintainable engineering solutions and clear technical documentation.

Nice To Haves

Hands-on software engineering or automation experience using Python, Java, Go, JavaScript/TypeScript, or a comparable language.
Experience supporting Linux-based systems and troubleshooting distributed applications or infrastructure.
Hands-on experience with logging or search platforms such as Splunk, ClickHouse, OpenSearch, or Elasticsearch.
Hands-on experience with metrics and visualization technologies such as Prometheus, Thanos, Grafana, or Bosun.
Experience developing backend services, APIs, command-line tools, integrations, or operational automation.
Experience with cloud platforms, preferably AWS or GCP, and cloud-native architecture and services.
Experience with containers and orchestration technologies such as Docker, Kubernetes, or equivalent enterprise container platforms.
Experience with infrastructure as code, configuration management, CI/CD pipelines, Git, automated testing, and deployment tooling.
Understanding of telemetry pipelines, log collection and parsing, metrics collection, alerting, dashboards, data retention, access controls, and platform integrations.
Understanding of distributed systems, scalability, high availability, disaster recovery, performance tuning, capacity planning, and reliability engineering.
Experience in production incident troubleshooting, root cause analysis, problem management, and preventive remediation.
Experience with vulnerability remediation, secure configuration, certificate management, patching, upgrades, and software lifecycle management.

Responsibilities

Design, develop, and deploy automation for deployment pipelines, infrastructure provisioning, platform operations, and release orchestration.
Write production-grade Python and, where appropriate, Go or Bash to reduce manual work and operational risk and improve reliability and scalability.
Develop reusable frameworks for release scheduling, validation, rollback, reporting, and configuration management.
Drive automation initiatives that improve engineering efficiency, standardization, and operational excellence.
Design, build, operate, and improve relational database platforms supporting critical payment systems and high-volume transaction processing.
Contribute to platform architecture decisions and engineering enhancements that improve scalability, resiliency, and performance.
Lead database health and lifecycle operations, including upgrades, patching, backup and recovery strategies, and modernization.
Analyze and optimize database performance using index tuning, execution plan analysis, replication monitoring, and capacity management.
Automate database operations, configuration management, and schema deployments using tools such as Ansible, Liquibase, and CI/CD pipelines.
Build monitoring, observability, and reporting solutions to identify reliability risks before they affect production services.
Design and build GenAI-powered tools for deployment orchestration, operational workflows, release governance, and platform management.
Integrate LLM-driven capabilities into observability, incident response, troubleshooting, and developer productivity workflows.
Evaluate and implement AI, automation, and machine learning technologies that improve reliability, efficiency, and engineering velocity.
Contribute to strategies for agentic automation and increasingly autonomous engineering operations.
Build dashboards, alerts, telemetry pipelines, and health indicators using technologies such as Prometheus, Grafana, Splunk, or ELK.
Analyze platform performance, reliability, utilization, and availability data, and implement long-term improvements.
Troubleshoot infrastructure, applications, databases, and platform services; perform root cause analysis and drive durable corrective actions.
Design and implement self-healing, automated remediation, and auto-scaling capabilities.
Design and implement highly available, scalable infrastructure for business-critical global payment systems.
Ensure platforms and services meet security, compliance, governance, and resiliency requirements across cloud-native and hybrid environments.
Drive vulnerability remediation, configuration hardening, patch management, and security automation.
Partner with engineering teams to integrate reliability and security practices into the software development lifecycle.
Collaborate with software engineers, product managers, platform teams, and global PRE peers to design, deliver, and operate engineering solutions.
Participate in architecture reviews, design discussions, code reviews, and technical planning.
Create and maintain technical documentation, runbooks, operational procedures, and engineering standards.
Participate in on-call rotations and incident response, and help drive operational improvements based on production events.
Own initiatives from design through implementation, deployment, and operational support, and seek opportunities to improve systems and processes.