Turing is building LLM evaluation and training datasets based on realistic software engineering problems. This project creates verifiable software engineering tasks from public repository histories using a synthetic approach with human involvement, while expanding coverage across programming languages and difficulty levels. The role is for experienced, tech-lead-level software engineers familiar with high-quality public GitHub repositories. It involves hands-on software engineering, including development environment automation, issue triaging, and evaluation of test coverage and quality. The engineer will assess how LLMs handle real code and bug-fixing scenarios, and may have opportunities to lead junior engineers. This is a fully remote contractor assignment involving a commitment of at least 20 hours per week, with four hours of overlap with Pacific Time.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Senior
Education Level
No Education Listed