We're looking for experienced software engineers to help evaluate and improve next-generation AI systems. In this role, you'll use your software engineering expertise to create challenging, realistic tasks that test how well AI models can solve complex programming problems. You'll design reinforcement learning environments where AI agents interact with real software projects and tools to diagnose and solve engineering challenges. Assignments may include debugging, implementing new features, refactoring existing code, and improving performance. You'll also create reproducible environments, reliable verification systems, and reference solutions that accurately evaluate an AI agent's reasoning, tool usage, and software engineering capabilities. Prior AI or machine learning experience is not required. Strong software engineering expertise is the most important qualification.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Senior
Education Level
No Education Listed