Sr. Software Reliability & Stability Quality Engineer, Siri Speech

Apple

About The Position

At Apple, quality is in everything we do, and as a Siri Software Reliability & Stability Quality Engineer, you will be responsible for automating, running and reporting hundreds of automated tests on automation racks You will work cross-functionally to identify and highlight key issues in a dynamic environment facing exciting new challenges daily for all the Apple product lines that Siri works on! This involves working cross functionally across many teams at Apple and delivering rich Apple Quality - Apple Intelligence features to our customers. You will have excellent communication and interpersonal skills, attention to detail, and a real passion for product usability. This team ensures Reliability and Stability of Siri Software and will play a key role in telling us when we are ready to release the Software to our customers. Quality Engineers in this team test to objective metrics with customer experience in mind and build automated tests for iterative and long-term measurements of quality. You will create and utilize LLM tools to assist in this overall effort. The ideal candidate should be comfortable to execute these tests and also write new automated tests and user-level test automation tools. In this role you will be actively involved in understanding features, identifying testing requirements and creating test plans. You will continuously track software bugs, identify issue trends, escalate bugs to be fixed and verify that they are indeed fixed by running the tests on automation racks. The Siri Speech team is looking for exceptional individuals to extend the core technology that lets Siri understand, learn, and remember. In this role you will: - Bring technical depth to help solve challenging and novel problems and enable quantitative measurements of quality. - Ability to develop automation tools, data corralling tools coming from various automation pipelines, and work cross-functionally to learn & reuse existing tools. - Deliver clear reports to partners and executives as products under test move through each development phase. - Take ownership of issues and drive them to resolution. - Balance priorities between short term results and long term infrastructure improvements. - Continuously improve tests and processes with a drive towards innovation and automation.

Requirements

Minimum 3 years of software quality experience
Strong passion for quality assurance in software, including developing and maintaining automated test libraries and tools
Strong programming and software design skills, preferably in Swift and/or Python
Excellent knowledge of and experience with test methodologies ranging from functional unit tests to non-functional exploratory testing
Experience in building automated UI and non-UI tests for user facing applications or system frameworks
Creative problem solver with a knack for building scalable solutions in a collaborative and cross-functional space
Ability to proactively triage, investigate, and debug difficult technical and UX problems independently as well as collaboratively
Highly organized with strong planning skills to estimate, update, and communicate progress

Nice To Haves

Bachelor's degree or equivalent experience in a related field
Knowledge of the Apple development ecosystem using Xcode, Xcode Cloud, and XCTest or XCUITest preferred
Experience with or knowledge of Machine Learned (ML) systems and associated qualification approaches
Strong interpersonal skills to work well with engineering teams
Excellent problem solving and critical thinking
Ability to work in a fast-paced environment with rapidly changing priorities
Passionate about building extraordinary products and experiences for our users

Responsibilities

Automating, running and reporting hundreds of automated tests on automation racks
Work cross-functionally to identify and highlight key issues in a dynamic environment
Working cross functionally across many teams at Apple and delivering rich Apple Quality - Apple Intelligence features to our customers
Ensuring Reliability and Stability of Siri Software
Testing to objective metrics with customer experience in mind
Building automated tests for iterative and long-term measurements of quality
Creating and utilizing LLM tools
Understanding features, identifying testing requirements and creating test plans
Continuously tracking software bugs, identifying issue trends, escalating bugs to be fixed and verifying that they are indeed fixed by running the tests on automation racks
Bring technical depth to help solve challenging and novel problems and enable quantitative measurements of quality
Develop automation tools, data corralling tools coming from various automation pipelines, and work cross-functionally to learn & reuse existing tools
Deliver clear reports to partners and executives as products under test move through each development phase
Take ownership of issues and drive them to resolution
Balance priorities between short term results and long term infrastructure improvements
Continuously improve tests and processes with a drive towards innovation and automation