Senior Data Enrichment & Annotation Manager

Candid
6d$145,000 - $170,000Remote

About The Position

Candid is a nonprofit that provides the most comprehensive data and insights about the social sector. We get you the information you need to do good. Candid currently has an opportunity for a Senior Manager, Data Enrichment and Annotation. The Senior Manager of Data Enrichment and Annotation will help drive Candid’s efforts to transform raw data into the structured knowledge that powers our products and supports our users’ decision-making. They will lead the team responsible for organizing complex information about grants and organizations, managing the creation and application of the taxonomies and frameworks that enable Candid to surface meaningful insights. Working at the intersection of domain expertise and technical implementation, they will partner with subject matter experts, product staff, and data science to create knowledge systems that serve both human users and AI applications.

Requirements

  • 7+ years of experience in taxonomy development, data annotation operations, knowledge management, or related fields
  • 3+ years managing teams that perform manual data coding, classification or annotation work
  • Proven experience designing and implementing taxonomies, ontologies, or classification systems used across multiple applications
  • Experience designing annotation guidelines or codebooks that achieve high inter-annotator agreement
  • Demonstrated ability to balance quality with throughput when scaling coding operations
  • Demonstrated ability to translate complex domain knowledge into structured frameworks
  • Experience working cross-functionally with technical teams, product managers, and subject matter experts
  • Excellent communication skills across technical and non-technical audiences
  • Experience with AI/ML applications and their use in classification or coding tasks
  • Familiarity with semantic web technologies, knowledge graphs, or linked data
  • Experience with data annotation and training data generation for machine learning models
  • Willingness to perform other duties and special projects as needed/requested.
  • Sensitivity and respect for racial, gender, sexual orientation, and cultural differences.
  • Champions and represents Candid’s core values: We’re driven, direct, accessible, curious, and inclusive.

Nice To Haves

  • Background in the nonprofit or philanthropic sector a bonus

Responsibilities

  • Lead the team that manually codes grants and organizations using Candid’s taxonomy, the Philanthropy Classification System, with a focus on scaling operations and improving classification accuracy and consistency.
  • Partner with subject matter experts to develop and maintain additional ontologies, taxonomies, and semantic models that enable knowledge representation and reasoning across applications, including AI applications.
  • Design and implement quality control processes and metrics to ensure coding quality and strong inter-rater reliability, including guidance for handling ambiguous edge cases.
  • Monitor and address data quality drift, including maintaining annotator calibration and detecting shifts in labeling standards over time.
  • Collaborate with Candid’s data science team to evaluate AI models (including LLMs) used for autocoding tasks.
  • Coordinate efforts to generate the training data needed to build effective AI/ML solutions.
  • Build strong relationships with key teams across Candid to understand how knowledge engineering can support their needs and advance desired outcomes.

Benefits

  • Health insurance (medical, dental, vision)
  • Retirement contribution with additional option for a match
  • Paid life insurance and AD&D
  • Paid leave time (PTO, compassionate leave, volunteer, holiday, parental)
  • Short-term and long-term disability
  • Pre-tax transit
  • Flexible spending accounts
  • Supplemental insurance
  • Summer hours
  • Public Service Loan Forgiveness (PSLF) program eligible employer.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service