🌎 AI Trainer (SWE), Remote- Contract

Xperteez Technology • ,

12h • $60 - $120 • Remote

About The Position

This is a fully remote contract role for an AI Trainer (SWE), with a flexible schedule and a time commitment of at least 15 hours per week. The role is intended for candidates who have already completed substantive AI-training work. You will use your software engineering expertise to create challenging technical tasks, evaluate model-generated code, identify failures, and establish objective standards for correct solutions.

Work includes creating realistic software engineering tasks for advanced AI models and developing task instructions, reproducible environments, reference solutions, tests, and evaluation criteria. You will assess model-generated code and technical deliverables for correctness, robustness, and completeness, and identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements; task availability and completion time may vary. The application process includes submitting AI-training experience and public technical evidence, completing an AI interview with technical and integrity checks, and completing a hiring-manager review. Selected candidates complete project onboarding before beginning their first assigned task.

Requirements

• Prior paid experience training, evaluating, benchmarking, or improving AI systems.
• Strong practical proficiency with Python.
• Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
• Strong knowledge of software design, debugging, testing, version control, and dependency management.
• Applicants should provide public evidence of technical skill, such as substantial GitHub or GitLab repositories, meaningful open-source contributions, maintainer or core-contributor responsibilities, programming-competition results, public developer tools or technical projects, or technical publications, benchmarks, or engineering write-ups.

Nice To Haves

• Experience creating AI-training tasks, reference solutions, tests, graders, or benchmark problems.
• Experience reviewing other AI trainers’ technical submissions.
• Codeforces rating of approximately 1900 or higher, or strong results in another programming competition.
• Experience with Linux, Docker, CI/CD, command-line tools, or sandboxed environments.
• Prior experience with long-horizon or agentic coding evaluations.
• Availability to begin immediately.

Responsibilities

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

What This Job Offers

• Education Level: No Education Listed