Senior Site Reliability Engineer

NVIDIA • Santa Clara, CA

1d

About The Position

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. NVIDIA is looking for a seasoned SRE to join its complex and fast-paced Infrastructure, Planning and Processes organization where you will be working as a Senior SRE Engineer. The position will be part of a fast-paced crew that develops and maintains sophisticated NVIDIA's internal Jenkins based CI/CD product for GPUs and Tegra systems. The team works with various other business units within NVIDIA Software such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure & systems needs. As an SRE, you’ll also be working in conjunction with various teams such as software engineering to deploy these new products and handle our infrastructure, associated processes and systems. Keen attention to detail, problem-solving abilities, and a solid knowledge base are needed. What you’ll be doing: Manage NVIDIA's on-prem infrastructure. Maintain uptime, reliability and readiness of on-prem engineering cloud spread across multiple data centers. Guard service level agreements (SLAs) for critical engineering services. Implement monitoring, alerting, and incident response procedures to ensure alignment to defined performance targets. Perform root cause analysis and post-mortems of incidents for any threshold breaches. Deploy, configure, and manage applications and services on Kubernetes clusters. Implement logging, monitoring, and alerting solutions (e.g., Prometheus, Grafana, ELK/EFK). Ensure high availability, fault tolerance, and disaster recovery for Kubernetes workloads. Help in capacity planning, optimization and better utilization efforts. Support user reported issues & issues. Monitor alerts and take necessary action. Actively participate in WAR room for critical issues Drive automation of monitoring to gain more insight into applications and system health. Reuse AI techniques to extract useful signals about machines and jobs from the data generated.

Requirements

• Experience of maintaining cloud infrastructure and highly-available production environment.
• Experience handling and maintaining systems installed in on-premises data centers, with strong hands-on proficiency using BMC interfaces (Redfish), KVM, and IPMI tools for hardware provisioning, remote access, and troubleshooting.
• Knowledge and understanding of Openstack architecture and services is a plus.
• Proven background working with databases, including relational databases such as SQL/MySQL, as well as time-series databases like Prometheus, with experience in data querying & performance tuning.
• Solid understanding of networking principles and protocols, including TCP/IP, DNS, DHCP, and VLANs, with the ability to diagnose connectivity issues and support complex, distributed systems.
• Practical experience in working with data analytics and visualization tools such as Kibana, Grafana, Splunk, or similar platforms, applied to analyze logs, metrics, and system behavior for monitoring and troubleshooting purposes.
• Strong demonstrable experience in automation tools like Jenkins and/or Temporal along with configuration tools like Ansible.
• Proficiency with Kubernetes, Docker, and virtualization technologies, with experience deploying, managing, and operating containerized workloads and virtualized infrastructure in production environments.
• Advanced knowledge of standard security methodologies and protocols, including system hardening, access control, vulnerability management, and secure operations across infrastructure and application layers.
• 10+ years of demonstrable experience.
• Bachelor's degree in Computer Science, Information Technology, or related field, or equivalent experience.

Nice To Haves

• Previous experience with SRE teams managing on-prem infrastructure.
• Experience managing NVIDIA hardware like GPUs and Tegras.
• Thrives in a multi-tasking environment with constantly evolving priorities.
• Outstanding interpersonal skills and communication with all levels of management.

Responsibilities

• Manage NVIDIA's on-prem infrastructure.
• Maintain uptime, reliability and readiness of on-prem engineering cloud spread across multiple data centers.
• Guard service level agreements (SLAs) for critical engineering services.
• Implement monitoring, alerting, and incident response procedures to ensure alignment to defined performance targets.
• Perform root cause analysis and post-mortems of incidents for any threshold breaches.
• Deploy, configure, and manage applications and services on Kubernetes clusters.
• Implement logging, monitoring, and alerting solutions (e.g., Prometheus, Grafana, ELK/EFK).
• Ensure high availability, fault tolerance, and disaster recovery for Kubernetes workloads.
• Help in capacity planning, optimization and better utilization efforts.
• Support user reported issues & issues.
• Monitor alerts and take necessary action.
• Actively participate in WAR room for critical issues
• Drive automation of monitoring to gain more insight into applications and system health.
• Reuse AI techniques to extract useful signals about machines and jobs from the data generated.

Benefits

• With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers.
• You will also be eligible for equity and benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level