Turing is seeking experienced, hands-on software engineers to evaluate and improve AI coding models. The role focuses on working with coding agents across real-world repositories and assessing the quality of their work, rather than primarily building production applications. Engineers review generated code and agent behavior, determine whether solutions are technically correct, identify failure modes, and create evaluation signals and feedback to improve model performance. The role also involves developing and refining evaluation rubrics, producing evaluation and preference data, and building and maintaining pipelines and infrastructure for data generation, collection, and evaluation workflows. The engineer will synthesize findings into clear recommendations and collaborate with AI researchers and engineers to turn qualitative judgment into scalable processes. This is an independent contractor engagement expected to last approximately three months. The preferred availability is 40 hours per week, with at least six hours of Pacific Time overlap. The role is open to candidates in North America, LATAM, or India, and the start date is as soon as possible.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Mid Level
Education Level
No Education Listed