Turing is seeking experienced, tech-lead-level software engineers familiar with high-quality public GitHub repositories to contribute to projects that build LLM evaluation and training datasets. The project creates verifiable software engineering tasks from public repository histories using a synthetic approach with human involvement, while expanding coverage across programming languages and difficulty levels. The role involves hands-on software engineering, including development environment automation, issue triage, and evaluation of test coverage and quality. Engineers will work with trending open-source libraries, run and modify real codebases to assess LLM performance in bug-fixing scenarios, and collaborate with researchers to identify challenging repositories and issues. There may also be opportunities to lead junior engineers. This is a fully remote contractor assignment supporting AI research and evaluation. The required commitment is at least 4 hours per day and 20 hours per week, with 4 hours of overlap with PST. Available commitment options are 20, 30, or 40 hours per week. The assignment does not include medical or paid leave.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Senior
Education Level
No Education Listed