Research Scientist, Open Benchmarks

Snorkel AI • San Francisco, CA

2d

About The Position

Snorkel AI is seeking a Staff or Senior Research Scientist to collaborate with partners and lead development of frontier benchmarks and datasets. This highly visible, customer-facing role sits at the intersection of research, company strategy, and go-to-market. The scientist will design datasets in light of frontier model performance, work with academic partners, and collaborate with delivery, product, and go-to-market teams to scale work into production. The role also serves as a technical partner to customers and prospects and contributes to outcomes that affect the broader research community.

The position reports directly to the Head of Research. It is suited to someone energized by cross-functional work and interested in how startups operate across research, data operations, and commercial teams.

Requirements

• Strong research background in AI/ML evaluation, NLP, or related fields.
• Track record of rigorous experimental design, especially measuring the impact of training and evaluation data on model behavior.
• Exceptional communication skills, including the ability to present complex technical findings clearly to technical and non-technical audiences.
• Comfort working in a fast-moving, cross-functional environment with ambiguous problem spaces.
• Genuine interest in go-to-market strategy, startup dynamics, and the commercial side of AI data services.

Nice To Haves

• Ph.D. in machine learning, NLP, or a related field; equivalent industry or research lab experience is also considered.

Responsibilities

• Design state-of-the-art datasets for frontier model training and evaluation based on current model performance and academic partnerships.
• Translate benchmark insights into clear narratives about the return on investment of expert-curated data for customer presentations, technical reports, and go-to-market materials.
• Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
• Stay current with frontier LLM evaluation research and bring best practices into Snorkel's workflows.
• Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements.

Benefits

• Opportunities to shape priorities and initiatives and influence strategic decisions.
• Support for career development, including deepening technical expertise, exploring leadership opportunities, and learning new skills across functions.
• An environment designed for growth, learning, and shared success.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed