Data Science Expert

Weekday AI

2d • $120 - $170 • Remote

About The Position

This role is for one of our clients. Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback. This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.

Requirements

• 5+ years of professional experience in Data Science within an industry environment.
• Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
• Deep expertise in: Experimental design and A/B testing, Statistical analysis, SQL and Python, Metric development and performance measurement, Translating analytical findings into business recommendations.
• Excellent written communication skills with the ability to clearly explain technical reasoning.
• Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
• Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.

Nice To Haves

• Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
• Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
• Experience reviewing technical work or mentoring analytical teams is a plus.

Responsibilities

• Design detailed, task-specific evaluation criteria for real-world data science deliverables, including: Data analyses, Predictive and statistical models, Dashboards and visualizations, Experiment results, Executive recommendations and business insights.
• Evaluate AI-generated and human-produced work using objective scoring frameworks.
• Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
• Apply sound analytical judgment to produce reproducible and defensible assessments.
• Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
• Collaborate with cross-functional teams to improve AI training quality and evaluation standards.

Benefits

• Work remotely with flexible scheduling.
• Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.
• We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.
• Weekly payments based on approved work completed.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed