Research Scientist - Frontier Benchmarks

Snorkel AI•San Francisco, CA
•$200,000 - $375,000

About The Position

Snorkel AI is seeking a Research Scientist to lead the design of next-generation benchmarks and datasets for evaluating frontier models. The role defines measures of performance across challenging tasks, using customer and academic partner input to ground datasets in real-world performance gaps. It involves building benchmarks to measure those gaps and training data to help address them, then partnering with delivery, product, and go-to-market teams to bring the work into production. The role is suited to someone interested in shaping how the field measures progress in frontier AI and working in a fast-moving, cross-functional startup. The position also involves communicating the value of expert-curated data to customers and contributing to research discussions through publications and other external engagement.

Requirements

  • Strong research background in AI/ML evaluation, NLP, or a related field, with a track record of rigorous experimental design, especially measuring the impact of training and evaluation data on model behavior.
  • Exceptional communication skills and ability to present complex technical findings clearly to technical and non-technical audiences.
  • Comfort working in a fast-moving, cross-functional environment with ambiguous problem spaces.
  • Genuine interest in go-to-market strategy, startup dynamics, and the commercial side of AI data services.

Nice To Haves

  • Ph.D. in machine learning, NLP, or a related field; equivalent industry or research lab experience is considered.

Responsibilities

  • Design state-of-the-art datasets for frontier model training and evaluation based on current model performance and academic partnerships.
  • Translate benchmark insights into clear narratives about the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials.
  • Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
  • Stay current with frontier LLM evaluation research and bring best practices into Snorkel's workflows.
  • Represent Snorkel's research through publications, blog posts, conference talks, and customer engagements to advance discussion of data-centric AI.

Benefits

  • Opportunities to shape priorities and initiatives, influence strategic decisions, and impact company success.
  • Support for career development, technical expertise, leadership opportunities, and learning across functions.
  • Reasonable accommodations during the application or interview process, for essential job functions, and to receive other employment benefits and privileges.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service