AI Trainer / Audio Data Labeler

Neon

20d • Remote

About The Position

Neon partners with leading AI teams to improve the quality, usefulness, and reliability of audio-based AI systems.
Our projects focus on evaluating and improving transcriptions of audio recordings generated by large language models (LLMs). You will assess model-generated transcriptions across diverse topics and provide high-quality human feedback.

Requirements

• You hold a Bachelor’s degree or equivalent experience
• You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in English
• You have experience using large language models (LLMs) and understand how and why people use them
• You have excellent writing skills and can clearly articulate nuanced feedback
• You have strong attention to detail and consistently notice subtle issues others may overlook
• You are adaptable and comfortable moving across topics, domains, and customer requirements

Nice To Haves

• Prior experience with audio data annotation, RLHF, or other data annotation work
• Experience comparing multiple outputs and making fine-grained qualitative judgments

Responsibilities

• Evaluate LLM-generated transcriptions on their ability to effectively understand conversations from an audio recording.
• Generate high-quality human annotations to correct model-generated transcripts,
• Apply consistent annotations by following clear taxonomies and detailed evaluation guidelines.

What This Job Offers

• Job Type: Part-time