We are looking for experienced software engineers at the tech lead level who are familiar with high-quality public GitHub repositories and can contribute to this project. The role involves hands-on software engineering, including development environment automation, issue triaging, and evaluating test coverage and quality. The work focuses on analyzing and triaging GitHub issues across trending open-source libraries; setting up and configuring code repositories, including Dockerization and environment setup; evaluating unit test coverage and quality; and modifying and running codebases locally to assess LLM performance in bug-fixing scenarios. The role also collaborates with researchers to design and identify repositories and issues that are challenging for LLMs. This is a fully remote contractor assignment lasting 2–3 weeks. The commitment is at least 4 hours per day and a minimum of 40 hours per week, with 4 hours of overlap with PST. The posting states that the assignment does not include medical or paid leave.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed