Software Quality Ops Scenarios Specialist (RelSim)
About The Position
The Software Quality Operations (SWQOps) team is at the heart of ensuring the safety, reliability, and quality of the Waymo Driver. Our mission is to build an adaptable and scalable operation, increasingly powered by AI, to deliver the crucial insights necessary to confidently deploy and grow Waymo's autonomous vehicle service. Waymo is undergoing unprecedented growth, rapidly expanding into new cities (targeting ~20 new cities by EOY 2026) and launching new vehicle platforms. SWQ Ops plays a critical role in this expansion, making it possible to scale safely and efficiently. The Scenario Operations team within SWQ Ops owns the scaled delivery and maintenance of simulation-based directed testing coverage used to evaluate the Safety and performance of the driver as Waymo continues to scale. As a Technical Specialist in Scenario Operations, you are the Subject Matter Expert who bridges the gap between our simulation software capabilities and real-world operational execution.
Requirements
- BS/BA degree or 4 years of relevant work experience in AV Software Quality, Simulation or Technical Operations
- Experience with ML testing and validation methods, including dataset quality assurance, bias detection, edge-case scenario testing, and / or performance evaluation using statistical metrics.
- Ability to quickly master proprietary software tools and a proven track record of root-causing high complexity, technical issues
- A strong understanding of driving rules, behavioral safety, and the nuances of complex traffic environments
Nice To Haves
- Hands-on experience with advanced AV simulation test environments
- Basic experience with SQL for data extraction and basic results analysis
- Experience working with offshore teams / multiple local operations hubs
- Track record of using technical expertise to influence product roadmaps or improve internal customer satisfaction.
Responsibilities
- Partner with Product and Engineering teams on design, test, and deployment of cutting-edge simulation tools. You will ensure these tools effectively combine human-in-the-loop (HITL) precision with AI-driven automation to create scalable test coverage.
- Drive the technical processes for "rapid-response" simulation-based scenario testing. When emergent issues are found in the field, you will apply your deep understanding of the A/V software stack and our tooling to support root-cause evaluation and fix validation.
- Serve as the key link between AI/ML development and operational execution. Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate advanced tools and insights into daily vendor workflows.
- Design and implement robust quality control processes for both human and AI-generated outputs. Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance.
- Act as the Subject Matter Expert (SME) for your specific domain. You will provide technical leadership to cross-functional stakeholders, advising on the feasibility of new testing coverage and driving tool improvements to achieve desired outcomes.
Benefits
- discretionary annual bonus program
- equity incentive plan
- generous Company benefits program
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
