GenAI Center of Excellence Lead
Scale AI
·
Posted:
August 21, 2023
·
Onsite
About the position
As the GenAI Center of Excellence Lead in Dallas, you will be responsible for hiring and scaling up a high-quality, on-site workforce and for designing, overseeing, and running new solutions, tools, and processes to ensure Scale maintains the highest quality standards in our Generative AI offerings. You will oversee the day-to-day operations of our GenAI data labeling system for high-priority pilots, hiring and managing a team of top-tier data labelers. This role offers an exciting opportunity to work with global cross-functional teams and make a significant impact in leading, professionalizing, and growing Scale's GenAI labeler workforce.
Responsibilities
- Hire and build a 50+ contractor workforce of GenAI data quality specialists (labelers) from scratch; coach and develop leaders in the workforce to achieve high-impact outcomes
- Own outcomes in their entirety: from ideation and strategy to in-the-weeds delivery of results
- Lead customer-facing presentations on the capabilities and growth of the Dallas workforce
- Be a relentlessly positive cultural agent to professionalize the labeler workforce
- Regularly conduct regular audits and analytics to identify areas for improvement and ensure adherence to quality standards
- Develop and implement quality assurance policies and procedures to ensure compliance with industry standards
- Design and execute quality control processes to monitor and evaluate product/service quality throughout the organization
- Establish and maintain quality performance metrics and key performance indicators (KPIs) to measure and report on quality levels
- Design new processes and tools and drive their implementation across the organization within the US and globally
- Collaborate with stakeholders to improve processes for new and existing customers
- Use quantitative experimentation to derive result-oriented actions for labeler acquisition, retention, experience, and performance
- Problem-solve some of our most pressing strategic operations challenges
- Partner with product teams to drive step-function changes to scale quality operations
- Build, maintain, and regularly communicate detailed reporting for other leaders across the company who will use your team's data to inform their own operations and strategy
- Work with product operations, customer operations, engineering, and other quality operations teams to execute on delivering SLAs for high-priority pilots
- Be based in the Dallas metropolitan area and are available to come into the office on a hybrid schedule
- Have 7+ years of experience in a general manager, operations, and/or top tier consulting role requiring a blend of analytical, strategic, and cross-functional work
- Have a strong orientation towards outcomes, and a history of being scrappy when it counts – you are excited about building things from scratch and are able to solve difficult problems in high-stakes environments
- Have experience leading teams and managing multiple, complex workstreams
- Have experience planning, organizing, and managing resources to bring about the successful completion of specific project goals and objectives
- Have solid project management abilities, including the ability to prioritize tasks, manage resources, and meet deadlines
- Have a penchant for digging deep into data, thinking from first principles, and iterating quickly to deliver results
- Have an easygoing interpersonal style and ability to work and build relationships with a wide range of people
- Have excellent qualitative and quantitative analytical skills
- Have strong written communication skills
- Have experience with reading and writing SQL (nice to have)
- Have experience growing and owning a 30+ person org (nice to have)
- Have work experience with Product Management, Machine Learning, Deep Learning, Generative AI, Large Language Models, Natural Language Processing (nice to have)
- Have professional certifications in quality management (e.g., Certified Quality Manager, Six Sigma) (nice to have)
Requirements
- 7+ years of experience in a general manager, operations, and/or top tier consulting role requiring a blend of analytical, strategic, and cross-functional work
- Strong orientation towards outcomes and a history of being scrappy when it counts
- Experience leading teams and managing multiple, complex workstreams
- Experience planning, organizing, and managing resources to bring about the successful completion of specific project goals and objectives
- Solid project management abilities, including the ability to prioritize tasks, manage resources, and meet deadlines
- A penchant for digging deep into data, thinking from first principles, and iterating quickly to deliver results
- Easygoing interpersonal style and ability to work and build relationships with a wide range of people
- Excellent qualitative and quantitative analytical skills
- Strong written communication skills
- Experience with reading and writing SQL (nice to have)
- Experience growing and owning a 30+ person org (nice to have)
- Work experience with Product Management, Machine Learning, Deep Learning, Generative AI, Large Language Models, Natural Language Processing (nice to have)
- Professional certifications in quality management (e.g., Certified Quality Manager, Six Sigma) (nice to have)
Benefits
- Base salary range of $122,400-146,880
- Compensation packages including base salary, equity, and benefits
- Stock options awarded upon board of director approval
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous paid time off (PTO)
- Possible additional benefits such as a commuter stipend