Anthropics Technology Ltd-posted about 1 month ago
$365,000 - $435,000/Yr
Full-time • Mid Level
Hybrid • San Francisco, CA
11-50 employees

Anthropic's Reinforcement Learning environments are the foundation of how Claude learns new capabilities. As we scale to massive training runs consuming trillions of tokens, we need someone to own the operational health and execution of our RL environments data pipeline. You'll be deeply embedded with Research, Infrastructure, and Data Operations teams - not just coordinating across them, but making hands-on technical decisions about data quality, environment configurations, and infrastructure priorities. This role requires both the technical depth to debug yield issues and configure complex ML systems, and the program management skills to coordinate across multiple teams during high-stakes production runs. This is operational technical leadership: you'll spend your time monitoring production environment health, coordinating in-flight changes during active training runs, driving infrastructure migrations, and ensuring our environment development keeps pace with our ambitious model training roadmap.

  • Own capacity planning and execution for major training runs: distribute token allocation targets across environment types, track team fulfillment in real-time, and coordinate production integration
  • Serve as single point of contact for RL environment execution status, consolidating visibility across teams and providing unified reporting on capacity fulfillment and blockers
  • Coordinate in-flight environment changes during active training runs, ensuring source of problem yield are producing at the right pace and quality, making technical decisions about configuration updates, deployment timing, and risk mitigation
  • Drive distributed technical initiatives by working hands-on with engineering teams on implementation and validation
  • Own mid-run and post-run feedback loops: run retrospectives analyzing environment performance data, establish ownership coverage for environment health, and feed insights back into roadmap planning
  • Ensure quality bar and production pace across problem yield sources, working in the weeds on both engineering and science aspects of data generation
  • Align environment teams to specific configurations and coordinate deployment of environment updates across the organization
  • Maintain operational processes for environment health monitoring, issue triage, and team coordination during production runs
  • Partner with Research leads, Infrastructure engineers, and Data Operations to identify blockers, prioritize competing needs, and make technical trade-off decisions
  • Deep technical understanding of ML training pipelines, RLHF systems, and large-scale data infrastructure - not just familiarity, but hands-on experience with production ML systems
  • Experience with RL training data generation, environment development, or ML data operations at scale
  • Nuanced understanding of RL training data characteristics, quality metrics, and how data issues manifest in model training performance
  • Background in ML research or ML engineering before transitioning to technical program management
  • Experience with reinforcement learning, human feedback systems, or AI safety research
  • Understanding of data quality frameworks, testing methodologies, and production validation processes for ML systems
  • Proven ability to make technical decisions about data quality, system configurations, and infrastructure priorities under pressure
  • Track record of operational ownership for production ML systems, including monitoring, incident response, and performance optimization
  • Experience with operational processes for production ML systems, including health monitoring, issue triage, and incident coordination
  • Experience coordinating complex technical initiatives across multiple engineering and research teams
  • Demonstrated ability to debug technical issues, work hands-on with engineers on implementation details, and drive migrations to completion
  • Strong technical judgment to balance research experimentation needs with production stability requirements
  • Ability to build deep contextual understanding of organization-specific systems and make informed decisions with incomplete information
  • Comfort with high-stakes environments where decisions impact millions of dollars in compute spend and model training timelines
  • Excellent stakeholder management and ability to influence senior technical staff through competence and consistent delivery
  • Track record working in fast-moving AI research organizations
  • competitive compensation and benefits
  • optional equity donation matching
  • generous vacation and parental leave
  • flexible working hours
  • a lovely office space in which to collaborate with colleagues
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service