AI Trainer- Coding

Aston Carter•Philadelphia, PA
•$45,000 - $60,000•Remote

About The Position

The Software Engineering Evaluator / Code Quality Specialist assesses and improves the quality of AI-generated software development work. The role applies engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution. It is suited to software engineers who enjoy code review, technical problem-solving, and applying engineering judgment to ensure production-ready outcomes. The position is permanent and fully remote, based out of Philadelphia, Pennsylvania. The listed pay range is $45,000–$60,000 per year. Individual compensation depends on qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other job-related factors. The posting also describes the work as independent contractor work paid through PayPal and states that no benefits are offered.

Requirements

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in at least one modern programming language, such as Python, JavaScript/TypeScript, Java, Go, C++, C#, Ruby, PHP, Swift, Kotlin, or Rust.
  • Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
  • Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
  • Experience using Git, testing frameworks, command-line interfaces, and debugging tools.
  • Excellent written communication skills and the ability to explain technical findings clearly and objectively.
  • Professional-level English proficiency.

Nice To Haves

  • Two or more years of software development experience in a professional, academic, freelance, or open-source setting.
  • Familiarity with containerization, CI/CD pipelines, and modern development workflows.
  • Experience using AI-powered coding assistants or large language model tools such as ChatGPT, Claude, or GitHub Copilot.
  • A completed or in-progress bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.

Responsibilities

  • Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
  • Evaluate AI-generated code solutions for correctness, maintainability, performance, and reliability against professional engineering standards.
  • Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.
  • Develop test plans, evaluation rubrics, and success criteria covering expected functionality, coding standards, and edge-case handling.
  • Review code changes, implementation decisions, automated tests, and design approaches for technical quality and adherence to requirements.
  • Identify and document missed edge cases, incorrect or incomplete implementations, fragile code changes, ineffective testing strategies, requirements misinterpretation, unsupported assumptions, and fabricated outputs.
  • Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain project quality standards.
  • Contribute technical expertise across a variety of technologies, platforms, and software development environments.
  • Produce clear, objective, actionable, and well-documented evaluations that identify issues and improve AI-generated software outputs.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service