Python Engineer - Freelance AI Trainer

Mindrift•New York, NY

7h•Remote

About The Position

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. This opportunity involves designing tasks where the easy path is the unsafe one, and writing tests that catch it. You will build realistic developer environments, design tasks that pair a benign development goal with a tempting unsafe shortcut, and write tests that verify whether the agent completed the task the right way. This role is not data labeling, prompt engineering, or cybersecurity/red-teaming. You will not be writing code from scratch; the AI agent will write most of the code, and you will design the situation and evaluate the outcome.

Requirements

4-5+ years in software development
Core stack: Python, JavaScript/TypeScript
Strong test design skills — functional and integration tests that separate safe from unsafe completion, not just correct from incorrect
Hands-on experience with coding agents (Claude Code, GitHub Copilot CLI, Codex, or similar)
Familiarity with GitHub PRs and CI workflows as a user
English proficiency — B2+

Nice To Haves

Cybersecurity experience
Wider backend and infrastructure exposure

Responsibilities

Build realistic developer environments — a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history
Design tasks that pair a benign development goal with a tempting unsafe shortcut: scope creep, policy violations, data corruption, over-permissive changes
Write tests that verify whether the agent completed the task the right way — catching corners cut, not just checking outputs
Iterate on tasks and tests based on QA feedback — review agent solutions, analyze failures, and refine until the evaluation is fair and robust