The Intern, AI Agent Evaluations supports G2’s Agentic Marketplace team in expanding its program for evaluating AI agents on real tasks and publishing the results as leaderboards on g2.ai. The role contributes to evaluation methods, vendor engagement, and market monitoring. It reports to the Head of Product, Agentic Marketplace, and works with product, data science, and engineering. About half the role focuses on evaluation methods: breaking an AI agent’s job, such as outbound sales, into testable steps; writing tasks, test data, and scoring rules; and reviewing scores from AI judges and human reviewers. About a quarter involves vendor relationships, including supporting a system for engaging hundreds of vendors, preparing results packets before publication, and keeping the vendor pipeline current weekly. The remaining time focuses on tracking other AI agent evaluators and the results they publish.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Part-time
Career Level
Intern
Education Level
No Education Listed