About The Position

This is an independent contractor role for a client, focused on using competitive data science experience to create technical tasks for AI training and evaluation. The role involves designing problems that require analytical reasoning and robust implementation, rather than solutions that only appear plausible. Each task should have a reproducible execution environment, a verified reference solution, and reliable mechanisms for evaluating technical correctness and completeness. The candidate will develop, test, debug, and independently validate complex solutions; assess coding-agent outputs; investigate failures; and refine tasks based on observed performance. The position is global and fully remote, with an approximately 15-hour-per-week commitment and flexible working hours, including the option to work weekends. Compensation is $60–$120 per hour.

Requirements

  • Expert rank or higher on Kaggle or a comparable competitive data science platform.
  • Demonstrated experience participating in competitive data science, machine learning, or applied mathematics challenges.
  • Strong understanding of data science methodologies, machine learning techniques, statistical analysis, and mathematical problem-solving.
  • Ability to explain the reasoning behind selected approaches, algorithms, and implementation decisions.
  • Practical programming proficiency sufficient to independently develop, implement, test, and verify solutions.
  • Experience building reproducible workflows and evaluating technical solutions against defined criteria.
  • Strong analytical thinking, debugging skills, and attention to detail.

Nice To Haves

  • Strong hands-on coding experience, particularly in Python.
  • Proficiency in testing, debugging, and troubleshooting complex implementations.
  • Ability to navigate unfamiliar codebases, understand existing workflows, and implement solutions efficiently.
  • Experience with Python-based data science and machine learning libraries.
  • Familiarity with automated evaluation, benchmarking, and reproducibility practices.
  • Experience working with coding agents or AI-assisted development tools.
  • Experience with one or more relevant competition platforms: Kaggle, DrivenData, Zindi, AIcrowd, Numerai, DataSource.ai, or CodaLab / Codabench.

Responsibilities

  • Build reproducible computational environments, prepare relevant datasets and dependencies, and implement reliable reference solutions.
  • Design challenging data science and machine learning tasks requiring analytical reasoning and practical implementation skills.
  • Develop test cases, evaluation criteria, and verification mechanisms that distinguish correct solutions from incomplete, inaccurate, or flawed approaches.
  • Execute coding agents against assigned tasks, analyze their outputs, investigate failures, and refine tasks based on observed performance.
  • Identify implementation errors, incorrect assumptions, data leakage, methodological weaknesses, and other issues that may affect solution accuracy.
  • Validate solutions through independent testing, computational experiments, and reproducible workflows.
  • Document task requirements, solution methodologies, technical reasoning, and verification procedures clearly.
  • Ensure tasks and reference solutions meet high standards of correctness, reliability, and reproducibility.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service