Product Manager (AI Speech)
About The Position
Artificial Analysis is the leading independent AI benchmarking company, supporting labs, engineers, and enterprises in understanding AI capabilities and making critical decisions about their AI strategies. Our benchmarks shape the frontier of AI and are trusted by leading AI labs, major publications, and hundreds of thousands of users. We are a fast-growing team backed by prominent industry leaders. This role is for a Product Manager focused on AI speech technologies, including text-to-speech, speech-to-text, voice cloning, and real-time voice. You will be instrumental in developing and enhancing our speech arenas and leaderboards, contributing to product strategy and execution at the intersection of voice technology and AI. This is a hands-on, technical product role where you will drive day-to-day operations for our speech offering, collaborate closely with engineering and analysis colleagues, and founders. Responsibilities include running experiments, curating datasets and prompts, and benchmarking models for top companies in the field. This role offers a unique opportunity to be at the forefront of AI speech advancements and understand how developers and creators are utilizing these technologies.
Requirements
- Strong analytical and critical thinking skills
- Excitement about AI and eagerness to work at the forefront of technological innovation
- Demonstrated excellence, both academically and professionally
- Real interest in speech AI models
Nice To Haves
- Experience working with speech AI models — especially building products leveraging recent TTS, STT, or voice cloning models
- Experience working in a product role at a voice/audio software company (e.g. ElevenLabs, Descript, Resemble AI) or in a startup environment
- Experience in strategy consulting
- Academic success in a technical degree programme, especially related to AI (e.g. Computer Science, Engineering), or in a related technical field (e.g. Physics, Maths, Linguistics)
- Strong writing skills, especially in relation to explaining technical topics to both technical and non-technical audiences
- Visual communication skills (e.g. making slides, visualizing data)
- A strong perspective on AI scaling laws — and specifically their implications for speech models
- Publication record in AI/ML or speech processing conferences or journals
- Familiarity with modern AI language models (e.g. developing systems leveraging LLMs as a component)
- Experience working in software engineering or data science
- Proficiency in Python and data analysis libraries (e.g. pandas, numpy, matplotlib); experience with AI/ML frameworks (e.g. PyTorch, TensorFlow)
Responsibilities
- Contribute to Speech AI product strategy and help execute the roadmap for our speech evaluation platforms, including text-to-speech, speech-to-text, voice cloning, and emerging capabilities — including working with engineers on our team to develop features and potentially coding features yourself
- Build and maintain comprehensive frameworks, prompt libraries, and evaluation techniques that reflect real-world usage patterns to test the capabilities, strengths, and weaknesses of speech models.
- Ensure that coverage of speech models across Artificial Analysis stays up to date by benchmarking new models and providers — both working with our development team and using our tooling yourself (e.g. running Python scripts)
- Deeply understand how developers and creators are pushing the boundaries with AI speech tools, and translate these insights into evaluation frameworks that help users understand AI capabilities
- Help amplify the impact of our speech benchmarks, collaborating with our team to maximize impact of our content across platforms and audiences
- Work with leading companies to benchmark their speech models, understanding their capabilities and helping shape industry standards for how AI speech capabilities are evaluated
- Embrace an AI-native workflow, using the latest AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking
Benefits
- Competitive compensation including equity
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
