Data Operations Manager

Anthropic PbcSan Francisco, CA
277d$270,000 - $290,000

About The Position

Anthropic is seeking a Data Operations Manager to join our growing Human Data Operations team. In this role, you'll work across multiple research teams to scope, execute, and manage a portfolio of human data projects that directly contribute to improving our AI models. You'll be responsible for efficiently collecting high-quality human feedback data that helps our researchers build more capable, safer, and more helpful AI systems. As a Data Operations Manager, you'll serve as a key interface between research teams and our human data collection resources, ensuring our projects are executed with speed, quality, and efficiency. At Anthropic, we believe that AI systems should be safe, beneficial, and aligned with human values. As a Human Data Operations Associate, you'll play a critical role in developing the human feedback data that helps shape these systems. If you're passionate about AI safety and excited to contribute to cutting-edge research while solving complex operational challenges, we'd love to hear from you.

Requirements

  • Exceptional project management skills with demonstrated ability to handle multiple complex projects simultaneously
  • Extremely detail-oriented with strong organizational skills with the ability to analyze information line-by-line
  • Excellent written and verbal communication skills, with the ability to translate technical requirements into clear instructions
  • Experience with data collection, labeling, or analysis in technical environments
  • Demonstrate strong problem-solving abilities and can navigate ambiguity effectively
  • Responsive and reliable, with a bias toward action and getting things done
  • Experience with data analysis and can work with tools like SQL, Python, Tableau, spreadsheets, or similar
  • Comfortable working in a fast-paced environment with shifting priorities
  • Care about developing safe, beneficial AI systems

Nice To Haves

  • Experience with human data collection and labeling specific to large language models
  • Knowledge of data collection, annotation, or labeling practices
  • Experience managing vendor relationships or external contractors
  • Experience implementing quality control systems for data collection
  • Background in a research-oriented organization, working with researchers and engineers
  • Experience with prompt engineering or working with large language models

Responsibilities

  • Manage end-to-end human data collection projects across multiple research teams, from scoping and planning to execution and quality control
  • Work closely with researchers to understand their data needs, translate requirements into clear project specifications, and provide regular updates on project progress
  • Write clear labeling instructions, review data, balance quality/diversity/volume requirements, and improve processes for efficiency
  • Manage day-to-day relationships with external vendors and contractors for human data projects, ensuring they deliver high-quality results on time
  • Implement systematic quality controls and verification processes to ensure data usability and trustworthiness
  • Create clear, effective task instructions and training materials for human data workers
  • Identify opportunities to improve efficiency, quality, and cost-effectiveness in our human data collection processes
  • Create project dashboards, data analysis reports, and analyze project metrics to provide insights to researchers and the Human Data Operations team
  • Partner with researchers, engineering teams, and other stakeholders to optimize human data collection processes

Benefits

  • Annual Salary: $270,000 - $290,000 USD
  • Visa sponsorship available
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service