Data Annotation Specialist, Data Science

Cohere

6d•Remote

About The Position

This role will focus on evaluating data science and coding tasks, requiring you to review and debug code, analyze model trajectories, and assess data visualization script development and logical flow implementation. Your work will contribute to our model development efforts and the logic our models apply when completing task requests. This is a part-time independent contractor position available within Canada. We seek candidates who are able to commit to 16 hours per week minimum at a 40 CAD/hour contract rate. This role is BYOD (Bring Your Own Device - laptop). Remote work within Canada. 12 month contract. Performance incentives included!

Requirements

Exceptional data analysis and visualization skills.
3+ years of relevant industry experience working on real-world data science problems and pipelines.
Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
Prior experience re-writing, proofreading, and delivering feedback on code.

Nice To Haves

Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories is a plus.

Responsibilities

Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
Prompt models to complete complex data science tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.