Snorkel AI is hiring a researcher to support its Open Benchmarks Red Team program, which works to improve the reliability of frontier AI benchmarks. This hands-on research role combines AI evaluation, adversarial testing, benchmark repairs, and collaboration with benchmark authors. The researcher will identify benchmark weaknesses, help develop and validate fixes, and create reusable methods to improve benchmark quality across tasks and datasets. They will share findings with benchmark authors, collaborate on repairs, and support adoption of improved benchmark versions. Snorkel AI’s Open Benchmarks Grants is a $30 million commitment to support researchers and independent builders developing AI evaluations. The program supports work across areas including physical AI, scientific discovery, cybersecurity, safety, and alignment, and helps teams test and strengthen benchmarks before and after public release. The role contributes to technical reports, open-source tools, publications, and new approaches to benchmark evaluation and improvement. Snorkel AI describes an environment where employees can shape priorities, influence strategic decisions, deepen technical expertise, explore leadership opportunities, and develop skills across functions.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed