Manager of AI Data Operations

CaptionCall by Sorenson • Salt Lake City, UT

9h • Onsite

About The Position

The Manager of AI Data Operations leads the end-to-end lifecycle of data used to train, test, and ship AI models for sign language recognition and generation. This role is critical to ensuring that data assets are clean, accurate, properly labeled, and compliant, bridging the gap between our data collection teams and the raw data sources that power our AI products. This role will be responsible for data pipeline management, annotation quality, and vendor operations while designing scalable workflows that keep pace with the demands of production AI systems. The ideal candidate will thrive in ambiguous, fast-moving environments and is passionate about building the data foundation that makes trustworthy AI possible.

Requirements

• Minimum 4 Year / Bachelors Degree in a related field, or equivalent career experience.
• 4 years of experience in data operations, program management, or AI/ML product roles, with experience in data annotation, labeling, or data pipeline management.
• Hands-on experience with annotation platforms and data pipeline orchestration tools
• Excellent project management skills with the ability to coordinate multiple concurrent workstreams across internal teams and external vendors in ambiguous, fast-paced environments.
• Strong understanding of AI/ML data requirements, including dataset construction, train/test/validation splits, class balancing, and the impact of data quality on model performance.
• Strong analytical and written communication skills, including the ability to translate complex data quality findings into clear executive summaries and actionable recommendations.
• Experience managing distributed or remote annotator teams, with demonstrated ability to maintain quality and throughput across geographically dispersed workforces.
• Collaborative, low-ego working style with the confidence to advocate for data quality investments and the judgment to make trade-off decisions independently.
• Commitment to responsible data practices, including privacy-preserving data handling, bias awareness, and ethical AI data sourcing.
• Proficiency with standard productivity and collaboration tools (Microsoft Office, Confluence, JIRA, or equivalent).
• Ability to query a dataset in SQL, review annotator performance metrics, and present data quality strategy to executive stakeholders.
• Professional attitude, team player, strong interpersonal communication skills, and able to work across research, engineering, and business departments.

Nice To Haves

• Familiarity with data infrastructure and ML tooling environments (e.g., dashboards, model evaluation platforms, cloud data storage, annotation tools) preferred.

Responsibilities

• Own the end-to-end data pipeline including collection, labelling, annotation, and preparation of data for AI model training and evaluation.
• Lead data annotation and labeling operations establishing quality standards, annotation guidelines, and inter-annotator agreement benchmarks to ensure high-fidelity training datasets.
• Design and maintain regular reporting cadences that track progress against data collection, labeling, and annotation targets.
• Serve as the primary operational contact for third-party annotation and collection vendors, managing SLAs, quality reviews, and budget tracking.
• Identify bottlenecks in data processes and implement scalable solutions including automation, tooling improvements, and process redesign to increase throughput and reduce error rates.
• Maintain comprehensive documentation of data schemas, annotation taxonomies, pipeline architecture, and quality benchmarks.
• Partner with AI scientists, Insights Team and Product Managers to translate model data requirements into actionable data collection and labeling work.
• Ensure all data operations comply with applicable privacy regulations, internal data governance policies, and responsible AI standards.
• Responsible for gaining a working understanding of all regulatory and legal requirements related to your role/work product and ensuring that those requirements are met.
• Other duties as assigned.

Benefits

• Paid Vacation Time and Paid Sick Time and Paid Holidays
• 401k 6% match with immediate vesting
• Nationwide Medical Insurance plans and coverage (Medical, Dental/Orthodontia, Vision)
• TeleDoc
• HSA company match
• 3 Medical plan options including a Low Deductible PPO Medical Plan
• Employee Assistance Program
• Engaged Employee Resource Groups
• Outstanding Learning and Career Development Opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Manager