Data Operations Manager - Computer Use & Tool Use

Anthropic • San Francisco, CA

75d • $250,000 - $365,000

About The Position

As Data Operations Manager for Computer Use & Tool Use, you'll build and scale data operations that advance Claude's computer use capabilities and tool use safety. You'll partner with research teams to design and execute data strategies, manage vendor relationships, and own the entire data pipeline from requirements to production. This is a zero-to-one role requiring technical depth to understand what makes high-quality training data for autonomous agents, but your focus will be on strategy and execution rather than hands-on engineering. Think technical founder who evolved from writing code to building the business.

Requirements

• Have 3+ years in technical operations, product management, or entrepreneurial experience building from zero to scale
• Have strong technical foundations - proficiency in Python and understanding of ML workflows, RL environments, and evaluation frameworks
• Have strong communication skills and can effectively engage with both technical and non-technical stakeholders
• Are familiar with how LLMs work and could describe concepts like RLHF, tool use, and agentic workflows
• Understand the unique challenges of evaluating autonomous systems and long-horizon agent behaviors
• Are highly organized and can manage multiple parallel workstreams effectively
• Have a high threshold for navigating ambiguity and can balance strategic priorities with rapid execution
• Thrive in fast-paced research environments with shifting priorities and novel technical challenges
• Are passionate about AI safety and understand the critical importance of high-quality data in building safe, capable agentic systems

Nice To Haves

• Experience at companies training AI models, building AI agents, or creating AI training data, evaluations, or environments
• Knowledge of computer and tool use safety challenges like prompt injection, data exfiltration attempts, or adversarial attacks
• Experience with RLHF, reinforcement learning techniques, or similar human-in-the-loop training methods
• Domain expertise in computer use automation, security, or AI safety evaluation
• Familiarity with model performance monitoring, training observability, or quality assessment systems
• Track record of building and scaling operations teams

Responsibilities

• Develop and execute data strategies for computer use, tool use safety, and agentic AI research
• Partner with research leaders to translate technical requirements into operational frameworks
• Build data collection and evaluation systems for complex scenarios: prompt injection robustness, multi-turn agent conversations, adversarial attacks, autonomous workflows
• Scale the generation of realistic evaluation environments that capture real-world tool use and computer use challenges
• Identify, evaluate, and manage specialized contractors and vendors for technical data collection
• Implement quality control processes to ensure data meets training requirements for both capabilities and safety
• Manage multiple complex projects simultaneously, balancing research velocity with rigorous evaluation standards
• Track metrics and communicate progress to stakeholders

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Publishing Industries
• Education Level: Bachelor's degree