Quality Lead, Gen AI

Scale AI • San Francisco, NY

1d

About The Position

At Scale, Quality Control ensures that data delivered to leading AI customers is state of the art. The Quality Lead, Gen AI owns quality decisions for high-impact Generative AI programs and leads a large team of quality control specialists to measure and improve quality across programs, including multilingual post-training data and agentic RL environments. The role addresses frontier-level problems involving programs that train widely discussed models and holds delivery teams accountable for quality on high-impact projects.

The Quality Lead interprets and improves customer requirements with delivery teams, turning them into clear standards and measurable data-quality signals. The role owns daily quality operations, including workforce planning and allocation, quality reporting, productivity and efficiency measurement, and quality control policies. It also identifies, investigates, and escalates quality defect patterns, and leads strategic initiatives to make operations reliable and scalable. The lead will help determine and build future agentic capabilities for quality control.

Scale's eligible-role compensation packages include base salary, equity, and benefits. The listed base salary range for this full-time role in San Francisco, New York, and Seattle is $134,400–$168,000 USD. The range may cover multiple career levels; final compensation depends on work location and factors such as skills, experience, qualifications, interview performance, and relevant education or training. Equity is subject to Board of Director approval, and eligibility is confirmed during hiring. Benefits include comprehensive health, dental, and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. The role may also be eligible for benefits such as a commuter stipend.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Operations, or a related field.
• At least 3 years of experience leading teams or scaling large operational or technical processes.
• Strong analytical and problem-solving skills, particularly in SQL, and attention to detail.
• Experience building systems, processes, and teams across multiple customer segments or product lines.
• Hands-on background in product management, operations management, program management, or top-tier management consulting.
• Proven ability to take initiative in cross-functional technical environments.

Nice To Haves

• Master’s degree in Computer Science, Engineering, Operations, or a related field.
• Experience in AI/ML services, data annotation, or model evaluation.
• Experience in a fast-growing, less-structured startup environment.
• Experience building teams from the ground up.

Responsibilities

• Lead, hire, coach, and calibrate a team of quality specialists.
• Work with delivery teams to interpret and improve customer requirements, then convert them into clear standards and measurable data-quality signals.
• Own daily quality operations, including planning and allocating workforce capacity, producing quality reports, measuring productivity and efficiency, and driving quality control policies.
• Analyze quality trends, identify and root-cause defect patterns, and elevate findings that delivery teams can act on.
• Lead strategic initiatives that enable reliable, scalable quality operations across the organization.
• Help determine and lead the development of future agentic capabilities to scale and optimize quality operations.
• Hold delivery teams accountable for quality across high-impact projects.

Benefits

• Comprehensive health coverage
• Dental coverage
• Vision coverage
• Retirement benefits
• Learning and development stipend
• Generous PTO
• Potential commuter stipend
• Equity-based compensation for eligible roles, subject to Board of Director approval

What This Job Offers

• Job Type: Full-time
• Career Level: Manager