Solvd Inc. is seeking a Senior AI Quality & Evaluation Engineer to independently verify retrieval quality and access permissions for AI systems. The role will build and maintain acceptance-gating evaluations, including golden-question suites, negative entitlement tests, freshness and retirement checks, and drift alarms. It is a 50% allocation role across weeks 3–10, drawn from a Quality Engineering or GRC background. The position reports to the POD Lead and works day-to-day with the retrieval engineer. The engineer will automate scheduled and change-triggered evaluation runs, publish scores and regression trends to a quality dashboard, and report test failures with root causes to the appropriate owners. The role also defines QA gates for remediated content and creates an evaluation runbook, while training client stewards and platform owners to operate and interpret the evaluation suite.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed