Principal, Site Reliability Engineer
About The Position
The Principal, Site Reliability Engineer leads the design, development, and implementation of reliability programs for complex site environments. This role ensures system performance, scalability, and disaster recovery through advanced monitoring, root cause analysis, and infrastructure automation. The position requires expertise in software architecture, distributed systems, and cloud technologies to optimize operational efficiency and resilience. The Principal Engineer collaborates across teams to drive continuous improvement, establish reliability standards, and support business objectives by delivering robust, scalable, and secure solutions aligned with organizational goals. The CES team delivers exceptional customer service experiences to millions of Walmart customers and agents worldwide. Comprising software engineers, data scientists, and machine learning experts, the team advances GenAI technology within complex enterprise applications. As part of Walmart Global Tech’s Enterprise Business Systems, CES collaborates closely with product, business, and UX teams to drive measurable business outcomes. The team focuses on innovation, reliability, and scalability to support Walmart’s mission of helping customers save money and live better through cutting-edge technology and robust site reliability engineering practices.
Requirements
- Extensive experience in site reliability engineering with strong expertise in system monitoring, root cause analysis, and reliability analysis.
- Proficiency in designing scalable, modular, and extensible software architectures aligned with business and technical requirements.
- In-depth knowledge of disaster recovery planning, execution, and contingency procedures for complex site environments.
- Skilled in cloud computing platforms and containerization technologies such as Docker.
- Ability to lead reliability testing and chaos engineering experiments using open-source tools.
- Strong coding skills in languages like JavaScript and Python, with automation experience in CI/CD pipelines.
- Proven capability to analyze system performance and implement telemetry for continuous improvement.
- Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in site reliability engineering, site and system administration, infrastructure management, or related area.
- OR 7 years’ experience in site reliability engineering, site and system administration, infrastructure management, or related area.
Nice To Haves
- Master's degree in site reliability engineering, site and system administration, infrastructure management, or related area and 3 years’ experience in site reliability engineering, site and system administration, infrastructure management, or related area.
- SRE certification (for example, IBM Cloud Site Reliability Engineer).
- Experience in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.
- Knowledge of accessibility best practices and joining efforts to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
Responsibilities
- Design and develop reliability programs tailored to complex site environments, ensuring alignment with business goals and site safety engineering.
- Lead and facilitate reliability testing and chaos experiments to validate application resiliency and system performance.
- Analyze system architecture and performance to optimize scalability, disaster recovery, and operational efficiency.
- Develop and implement monitoring strategies, establishing metrics and alerts to maintain system availability and reliability.
- Guide root cause analysis efforts to identify and resolve defects, enhancing application stability and preventing incidents.
- Drive infrastructure automation and telemetry integration to support continuous delivery and operational excellence.
- Mentor team members on tools, coding standards, and reliability best practices.
Benefits
- Competitive pay
- Performance-based bonus awards
- Medical coverage
- Vision coverage
- Dental coverage
- 401(k)
- Stock purchase
- Company-paid life insurance
- PTO (including sick leave)
- Parental leave
- Family care leave
- Bereavement leave
- Jury duty leave
- Voting leave
- Short-term disability
- Long-term disability
- Company discounts
- Military Leave Pay
- Adoption expense reimbursement
- Surrogacy expense reimbursement
- Live Better U (Walmart-paid education benefit program for full-time and part-time associates)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
