Snorkel AI is hiring researchers to support its Open Benchmarks Red Team program. This hands-on research role combines AI evaluation, adversarial testing, practical benchmark repairs, and collaboration with benchmark authors. The role focuses on identifying weaknesses in frontier AI benchmarks, developing and validating fixes, and creating reusable methods to improve benchmark quality across tasks and datasets. The researcher will share findings with benchmark authors, collaborate on repairs, and help ensure improved benchmark versions are adopted. Snorkel AI’s Open Benchmarks Grants program is a $30 million commitment to fund and support researchers and independent builders developing AI evaluations. It supports teams behind Terminal-Bench, OSWorld 2.0, and Senior SWE-bench, as well as a Research Fellows program for PhD students and postdocs. Funded work covers areas such as physical AI, scientific discovery, cybersecurity, safety, and alignment, and includes testing and strengthening benchmarks before and after public release. Snorkel AI describes itself as a frontier AI data lab that develops datasets, benchmarks, evaluations, and custom solutions for real-world AI systems. The company was founded out of the Stanford AI Lab in 2019 and works with AI labs and enterprises. It presents the role as an opportunity to contribute to technical research and engineering while influencing priorities and strategic decisions in a growing company.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed