Quality Lead, Gen AI

Scale AI • San Francisco, CA

2d • $134,400 - $168,000

About The Position

At Scale, Quality Control ensures that data delivered to leading AI customers is state of the art. The Quality Lead, Gen AI owns quality for high-impact Generative AI programs and leads a large team of quality control specialists measuring and improving quality across programs, including multilingual post-training data and agentic RL environments. The role addresses frontier-level problems involving programs that train widely discussed models.

The lead holds delivery teams accountable across high-impact projects, resolves nuanced quality issues, and drives strategic initiatives that support reliable, scalable operations across the organization. The position includes leading and developing quality specialists, translating unclear customer requirements into measurable data-quality standards, running daily quality operations, analyzing quality trends, and helping determine and build future agentic capabilities for quality control.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Operations, or a related field.
• At least 3 years of experience leading teams or scaling large operational or technical processes.
• Strong analytical and problem-solving skills, particularly in SQL, and attention to detail.
• Experience building systems, processes, and teams across multiple customer segments or product lines.
• Hands-on background in product management, operations management, program management, or top-tier management consulting.
• Proven experience taking initiative in cross-functional technical environments.

Nice To Haves

• Master’s degree in Computer Science, Engineering, Operations, or a related field.
• Experience in AI/ML services, data annotation, or model evaluation.
• Experience in a fast-growing, less-structured startup environment.
• Experience building teams from the ground up.

Responsibilities

• Lead, hire, coach, and calibrate a team of quality specialists.
• Work with delivery teams to interpret and improve customer requirements and translate them into clear, measurable data-quality standards.
• Own daily quality operations, including planning and allocating workforce capacity, producing quality reporting, measuring productivity and efficiency, and driving quality control policies.
• Identify and root-cause quality defect patterns and elevate findings that delivery teams can act on.
• Lead strategic initiatives to enable reliable, scalable operations across the organization.
• Help decide and lead the development of future agentic capabilities to scale and optimize quality operations.

Benefits

• Comprehensive health coverage.
• Dental coverage.
• Vision coverage.
• Retirement benefits.
• Learning and development stipend.
• Generous paid time off.
• May be eligible for a commuter stipend.
• Eligible roles include equity-based compensation, subject to Board of Director approval.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager