Annotation Manager - Content Platform

Spotify • New York, NY

12h • $82,921 - $118,459 • Hybrid

About The Position

Spotify designs its consumer experience end-to-end, across every screen, platform, and partner integration, aiming to make listening effortless, personal, and joyful for billions of users. This involves transforming complexity into clarity across numerous touchpoints, from mobile apps to smart speakers, TVs, cars, and other integrations. The company focuses on deep insight into human behavior, design, and technology to create intuitive, expressive, and distinctly Spotify experiences. The Content Platform team specifically designs and powers experiences that connect listeners with audio, enabling creators and content distributors to deliver content seamlessly and providing Spotify teams with a rich, reliable catalog. The Annotation Platform Ops team collaborates with Product and Engineering within the Content Platform R&D studio to build high-quality, interconnected datasets. These datasets power machine learning systems across Music, Podcasts, and Audiobooks, combining human expertise with AI to enhance content understanding and experience at scale. The Annotation Manager will facilitate the collection of labeled datasets used by Content Platform teams to train, evaluate, and understand models and systems, working at the intersection of ML and AI-driven development.

Requirements

• You have experience managing annotation projects or data operations in ML/AI environments
• You’re familiar with LLM or AI-driven annotation workflows and human-in-the-loop systems
• You’re comfortable leading multiple projects simultaneously and navigating ambiguity across stakeholders
• You bring a structured, detail-oriented approach to building and improving processes
• You communicate clearly and can align technical and non-technical teams around shared goals
• You collaborate effectively with cross-functional partners in fast-paced environments
• You have a solid understanding of the machine learning lifecycle, from data collection to deployment
• You’re comfortable working with emerging AI tools and agent workflows
• You’re curious about music, podcasts, and audiobooks, and how data can improve those experiences

Nice To Haves

• You have familiarity with music metadata or industry standards

Responsibilities

• Partner with Product and Engineering teams to understand annotation needs, define requirements, and prioritize use cases based on business impact
• Own end-to-end annotation project delivery, including designing workflows and setting up scalable processes
• Translate requirements into clear annotation guidelines, collaborating with content policy experts and updating guidance based on results
• Lead training and onboarding for annotation teams, creating materials and establishing strong feedback loops
• Support project launches, including annotator allocation, data readiness, and task distribution across teams
• Monitor project performance using key metrics, and share insights and results with cross-functional partners
• Collaborate with R&D teams to set up and run LLM-driven and AI-assisted workflows
• Facilitate regular reviews with annotation teams to track progress, forecast workload, and improve performance against KPIs

Benefits

• health insurance
• six month paid parental leave
• 401(k) retirement plan
• monthly meal allowance
• 23 paid days off
• 13 paid flexible holidays

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 1,001-5,000 employees