The AI Evaluation Scientist designs and executes evaluation processes to ensure predictive and generative AI systems are accurate, reliable, safe, and aligned with mission requirements. The role establishes trust in AI solutions and supports continuous improvement across the AI lifecycle. It works closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and support responsible deployment. The position contributes to the growth of Steampunk’s AI & Data Exploitation Practice. It involves evaluating AI systems, documenting findings for technical and non-technical audiences, and supporting evaluation outputs used in compliance, documentation, and risk assessment.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior