Principal Site Reliability Engineer - Automotive

Red River • Raleigh, NC

18h

About The Position

Red Hat is seeking a Principal Site Reliability Engineer based in Raleigh with a passion for designing, maintaining and continuously improving highly reliable infrastructure. In this role, you will architect, design and lead the implementation of the Red Hat In-Vehicle OS (RHIVOS) product SRE initiative.You will partner with development, quality engineering, and release engineering colleagues to assess and then uphold the health and well-being of the infrastructure hosting software production services. The ideal candidate will possess deep-dive infrastructure and product reliability knowledge and a proven ability to drive the adoption of their technical vision across engineering teams. What you will do: Architect, design and lead the implementation of the RHIVOS product SRE initiative. Instrument metrics to support Service Level Objectives (SLO), Service Level Indicators (SLI) and Service Level Agreements (SLA) for critical services. Utilize metrics designed and built into the software to analyze system performance and identify performance bottlenecks, underutilized hardware or scale the infrastructure design. Review team contributions to software correcting errors and provide constructive feedback. Lead and participate in incident response and postmortems, help identify steps to minimize Mean Time To Resolution (MTTR). Regularly contribute to internal workshops and training to upskill the team as the product architecture evolves. Configure and maintain software production infrastructure and tooling. Serve as an internal expert on infrastructure and tooling, including software production pipelines, providing guidance to engineering teams and making high-level recommendations to improve efficiency, reliability, and stability. Create/maintain service monitoring, improve automation, uphold security best practices and respond to various service situations for the software production infrastructure. Resolve service incidents by use of existing operating procedures, investigate outage causes and coordinate incident resolution across various service teams Act as a leader and mentor to your less experienced colleagues, bring and drive continuous improvement ideas and help the team to benefit from technology evolution, such as AI tools utilization Collaborate on incident retrospective reviews and corrective items implementation Proactively identify and eliminate toil by automating manual, repetitive, and error-prone processes Coordinate your actions with other Red Hat teams such as IT and Product Security to ensure our infrastructure meets quality expectations Implement monitoring, alerting and escalation plans in the event of an infrastructure outage or performance problem Work with service owners to co-define and implement SLIs and SLOs for the services you’ll support, ensure those are met and execute remediation plans if they are not Helpout/backup RHIVOS Raleigh lab SRE when needed. What you will bring: 8+ years of software reliability engineering experience with deep expertise in Linux systems, infrastructure-as-code, and complex, distributed enterprise environments. Linux administration expertise Advanced experience of Kubernetes/OpenShift administration and application development Advanced experience of automation services like Ansible or Terraform Advanced experience of CI/CD platforms like GItLab CI, Tekton and Pipelines as a code (optionally GitHub Actions etc) Advanced experience and experience with monitoring platforms and technologies Advanced experience and experience of AWS technologies Experience with open source monitoring technologies (Grafana, Prometheus, OpenTelemetry) Excellent written and verbal communication skills in English, as you'll be working in a globally distributed team Proven track record for leading and hands on implementing a program/product wide adoption of a data-driven reliability framework by architecting complex, multi-service SLO/SLI standards and institutionalizing error budget policies that effectively balance rapid feature velocity with global system stability Previous experience with the Site Reliability Engineer (SRE) model and software development using Python or GoLang. Ability to work in the Raleigh office when needed Preferred Qualifications Experience with creation of Standard Operating Procedures Experience or familiarity with large-scale testing frameworks and infrastructure used specifically for OS development and release. Knowledge of functional safety standards and processes in the Automotive industry, such as ISO 26262 or ISO 21434. The salary range for this position is $151,510.00 - $249,950.00. Actual offer will be based on your qualifications. Pay Transparency Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience. About Red Hat Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact. Benefits ● Comprehensive medical, dental, and vision coverage ● Flexible Spending Account - healthcare and dependent care ● Health Savings Account - high deductible medical plan ● Retirement 401(k) with employer match ● Paid time off and holidays ● Paid parental leave plans for all new parents ● Leave benefits including disability, paid family medical leave, and paid military leave ● Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more! Note: These benefits are only applicable to full time, permanent associates at Red Hat located in the United States. Inclusion at Red Hat Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village. Equal Opportunity Policy (EEO) Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law. Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee. Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email [email protected]. General inquiries, such as those regarding the status of a job application, will not receive a reply. We’re the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge. At Red Hat, our commitment to open source extends beyond technology into virtually everything we do. We collaborate and share ideas, create inclusive communities, and welcome diverse perspectives from all Red Hatters, no matter their role. It’s what makes us who we are. Some of the most knowledgeable and passionate people in the technology industry work here. Whether we’re building software, championing our products, or training new associates, we’re collaborating openly to make a difference in the world of open source and beyond.

Requirements

• 8+ years of software reliability engineering experience with deep expertise in Linux systems, infrastructure-as-code, and complex, distributed enterprise environments.
• Linux administration expertise
• Advanced experience of Kubernetes/OpenShift administration and application development
• Advanced experience of automation services like Ansible or Terraform
• Advanced experience of CI/CD platforms like GItLab CI, Tekton and Pipelines as a code (optionally GitHub Actions etc)
• Advanced experience and experience with monitoring platforms and technologies
• Advanced experience and experience of AWS technologies
• Experience with open source monitoring technologies (Grafana, Prometheus, OpenTelemetry)
• Excellent written and verbal communication skills in English, as you'll be working in a globally distributed team
• Proven track record for leading and hands on implementing a program/product wide adoption of a data-driven reliability framework by architecting complex, multi-service SLO/SLI standards and institutionalizing error budget policies that effectively balance rapid feature velocity with global system stability
• Previous experience with the Site Reliability Engineer (SRE) model and software development using Python or GoLang.
• Ability to work in the Raleigh office when needed

Nice To Haves

• Experience with creation of Standard Operating Procedures
• Experience or familiarity with large-scale testing frameworks and infrastructure used specifically for OS development and release.
• Knowledge of functional safety standards and processes in the Automotive industry, such as ISO 26262 or ISO 21434.

Responsibilities

• Architect, design and lead the implementation of the RHIVOS product SRE initiative.
• Instrument metrics to support Service Level Objectives (SLO), Service Level Indicators (SLI) and Service Level Agreements (SLA) for critical services.
• Utilize metrics designed and built into the software to analyze system performance and identify performance bottlenecks, underutilized hardware or scale the infrastructure design.
• Review team contributions to software correcting errors and provide constructive feedback.
• Lead and participate in incident response and postmortems, help identify steps to minimize Mean Time To Resolution (MTTR).
• Regularly contribute to internal workshops and training to upskill the team as the product architecture evolves.
• Configure and maintain software production infrastructure and tooling.
• Serve as an internal expert on infrastructure and tooling, including software production pipelines, providing guidance to engineering teams and making high-level recommendations to improve efficiency, reliability, and stability.
• Create/maintain service monitoring, improve automation, uphold security best practices and respond to various service situations for the software production infrastructure.
• Resolve service incidents by use of existing operating procedures, investigate outage causes and coordinate incident resolution across various service teams
• Act as a leader and mentor to your less experienced colleagues, bring and drive continuous improvement ideas and help the team to benefit from technology evolution, such as AI tools utilization
• Collaborate on incident retrospective reviews and corrective items implementation
• Proactively identify and eliminate toil by automating manual, repetitive, and error-prone processes
• Coordinate your actions with other Red Hat teams such as IT and Product Security to ensure our infrastructure meets quality expectations
• Implement monitoring, alerting and escalation plans in the event of an infrastructure outage or performance problem
• Work with service owners to co-define and implement SLIs and SLOs for the services you’ll support, ensure those are met and execute remediation plans if they are not
• Helpout/backup RHIVOS Raleigh lab SRE when needed.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed