Annotation Manager - Content Platform

About Us

Spotify is a global leader in audio streaming, dedicated to unlocking human creativity and connecting billions of fans with the audio they love. Our mission is to make listening effortless, personal, and joyful, shaping consumer experiences across all platforms and devices. The Content Platform team ensures creators and distributors can deliver content seamlessly, while providing Spotify with a rich and reliable catalog.

The Role

The Annotation Platform Ops team is at the heart of the Content Platform R&D studio, partnering closely with Product and Engineering. We build high-quality, interconnected datasets that power machine learning systems across Music, Podcasts, and Audiobooks, combining human expertise with AI to enhance content understanding and experience at scale.

We are seeking an Annotation Manager to facilitate the collection of labeled datasets crucial for training, evaluating, and understanding ML models and systems within the Content Platform. This is a unique opportunity to work at the intersection of ML and AI development.

What You'll Do

• Partner with Product and Engineering teams to understand annotation needs, define requirements, and prioritize use cases based on business impact.
• Own end-to-end annotation project delivery, including designing workflows and setting up scalable processes.
• Translate requirements into clear annotation guidelines, collaborating with content policy experts and updating guidance based on results.
• Lead training and onboarding for annotation teams, creating materials and establishing strong feedback loops.
• Support project launches, including annotator allocation, data readiness, and task distribution across teams.
• Monitor project performance using key metrics, and share insights and results with cross-functional partners.
• Collaborate with R&D teams to set up and run LLM-driven and AI-assisted workflows.
• Facilitate regular reviews with annotation teams to track progress, forecast workload, and improve performance against KPIs.

Who You Are

• Experienced in managing annotation projects or data operations within ML/AI environments.
• Familiar with LLM or AI-driven annotation workflows and human-in-the-loop systems.
• Comfortable leading multiple projects simultaneously and navigating ambiguity across stakeholders.
• Possess a structured, detail-oriented approach to building and improving processes.
• Skilled in clear communication to align technical and non-technical teams around shared goals.
• A strong collaborator with cross-functional partners in fast-paced environments.
• Solid understanding of the machine learning lifecycle, from data collection to deployment.
• Comfortable working with emerging AI tools and agent workflows.
• Curious about music, podcasts, and audiobooks, and how data can improve these experiences.
• Familiarity with music metadata or industry standards is a plus.

Where You'll Be

• This role is based in New York.
• We offer flexibility with a hybrid work model, allowing for remote work with some in-person meetings.

Compensation and Benefits

• The United States base salary range for this position is $82,921.00 - $118,459.00, plus equity.
• Benefits include health insurance, six months of paid parental leave, a 401(k) retirement plan, a monthly meal allowance, 23 paid days off, and 13 paid flexible holidays.
• Salary ranges are subject to future modification.

Equal Opportunity Employer

Spotify is committed to creating an inclusive and accessible workplace. We celebrate diversity and encourage individuals from all backgrounds to apply. We are committed to providing reasonable accommodations throughout the recruitment process. Please let us know if you require any accommodations.

About Spotify

Since launching in 2008, Spotify has transformed music listening globally. Our mission is to unlock human creativity by empowering artists and connecting them with billions of fans. Our passion for music and podcasting drives everything we do. Today, we are the world's most popular audio streaming subscription service.