We are the Product Systems Quality team, and we are looking for a highly motivated and experienced Algorithm Validation Engineer with a passion for delivering robust, inclusive, and state-of-the-art Computer Vision and Machine Learning algorithms in Apple's next generation of products. You'll enjoy working on a team of quality engineers with diverse backgrounds as we refine the model pipelines that power Apple's trademark simple and elegant user experience. Come be a part of our team and use both creativity and technical expertise to bring experiences to life that our customers love! We are seeking an experienced Machine Learning Validation Engineer to lead the design and implementation of evaluation pipelines for Apple's ML systems. This is a technical leadership role for someone who bridges algorithm research, systems engineering, and customer experience. You'll be solving complex problems at the intersection of model performance, real-world constraints, and user impact. Your work will require close partnership with algorithm development teams to design and execute live test procedures, aggressor searches, user studies, and annotation pipelines to improve and influence algorithm performance and design. You'll use data science techniques to design experiments that expose vulnerabilities in the models and investigate patterns of failure. By focusing on end-to-end system performance, you'll evaluate and represent the true customer experience while using a deep understanding of the various components within the models to test comprehensively and efficiently. You'll also work with hardware and software engineering teams to consider the system design and external factors that influence model performance. You'll be working through every step of the product development cycle and will help make Apple products more reliable, flexible, and easy to use.