We are looking for experienced software engineers at a tech lead level who are familiar with high-quality public GitHub repositories and can contribute to this project. The role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality. The work includes analyzing and triaging GitHub issues across trending open-source libraries; setting up and configuring code repositories, including Dockerization and environment setup; evaluating unit test coverage and quality; modifying and running codebases locally to assess LLM performance in bug-fixing scenarios; and collaborating with researchers to identify repositories and issues that are challenging for LLMs. This is a fully remote contractor assignment for candidates located in Argentina, Brazil, Chile, Colombia, or Peru. The contract is expected to last 2–3 weeks, with an expected start date next week. The commitment is at least 4 hours per day and a minimum of 40 hours per week, with 4 hours of overlap with PST. Payment is $25 per approved task. The assignment does not include medical or paid leave.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Senior
Education Level
No Education Listed