Automation Lead, AI Operations
About The Position
At Fetch, we’re building AI and automation systems that make our work smarter, faster, and more scalable. The AI Operations team ensures our models, automations, and LLM systems perform with quality, reliability, and measurable impact. As an Automation Lead, you’ll own automation and evaluation programs across AI Operations. You’ll translate business and functional goals into scalable systems, define how we measure quality, and ensure automation and evaluation become durable, high-impact capabilities across the organization. This role is ideal for someone who combines deep technical problem-solving with systems-level thinking and strong cross-functional leadership. This is a full-time role that can be held from one of our US offices or remotely in the United States.
Requirements
- 5+ years of experience and the proven ability to lead complex automation or evaluation initiatives across systems or teams
- Experience designing, building, and scaling evaluation frameworks, datasets, and quality systems at scale for LLMs or AI products
- Strong understanding of AI/LLM workflows, automation platforms, and system design
- Experience in influencing cross-functional stakeholders and aligning priorities
- Demonstrated ability to define metrics and drive measurable business impact
Nice To Haves
- Familiarity with data pipelines, APIs, or production systems
- Experience mentoring or leading technical contributors
- Background in AI Operations, applied AI, or process optimization
Responsibilities
- Own programs: Lead complex, high-impact automation and evaluation initiatives across workflows or teams
- Design scalable solutions: Architect end-to-end workflows integrating datasets, evaluations, automations, and HITL processes
- Establish standards: Define best practices for datasets, evaluation methodologies, and quality measurement
- Drive cross-functional alignment: Influence priorities and partner with Engineering, Product, and AI teams to deliver solutions
- Improve systems at scale: Lead redesign of workflows, tooling, and processes to improve performance and durability
- Measure and communicate impact: Define success metrics and communicate performance and recommendations to leadership
- Elevate the team: Raise the bar through your work and actively mentor others by sharing approaches, guiding problem-solving, and enabling the team to build stronger automation and evaluation capabilities
- Drive innovation: Stay current on emerging tools and approaches; pilot and translate them into actionable improvements for the team
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
