Remote | Advanced STEM Problem Design Consultant — $45–$65/hour

24-Mag•New York, NY

1d•Remote

About The Position

We are sharing a specialised part-time consulting opportunity for advanced STEM and technical professionals experienced in domain-specific problem design, scientific or technical reasoning, research-informed evaluation, structured feedback, and high-quality data development. This role supports current and upcoming remote consulting opportunities focused on AI reasoning evaluation, difficult problem creation, technical response review, and domain-specific assessment across specialised STEM fields. Selected professionals will apply subject matter expertise to create challenging problems, evaluate AI-generated outputs, identify reasoning gaps, and support structured evaluation work involving advanced technical concepts.

Requirements

Advanced expertise in a STEM, technical, scientific, engineering, medical, computational, or quantitative domain
Strong ability to create difficult, domain-relevant problems that require expert-level reasoning
High attention to detail and ability to evaluate technical content with accuracy and nuance
Exceptional written communication skills and ability to explain complex reasoning clearly
Comfort applying structured rubrics, evaluation criteria, and project-specific guidelines consistently
Ability to work independently in a remote, asynchronous, project-based environment
Strong judgment when identifying reasoning gaps, unsupported conclusions, or incomplete technical explanations
PhD, advanced degree, or equivalent industry experience in a relevant STEM or technical field is preferred
Relevant domains may include Medicine or Healthcare, Statistics, Data Science, AI or Machine Learning Research, Computer Science, Game Development, Mechanical Engineering, Aerospace Engineering, or related fields
Academic or professional experience involving research, technical problem solving, scientific analysis, engineering design, data analysis, technical writing, or domain-specific evaluation is highly relevant
Experience with peer-reviewed research, graduate-level teaching, technical assessment, product development, engineering review, or advanced analytical work may be especially valuable

Nice To Haves

Experience designing research problems, technical prompts, exam questions, assessment tasks, or advanced domain-specific exercises
Familiarity with AI evaluation, structured feedback, rubric-based assessment, technical review, or data quality workflows
Experience reviewing scientific, medical, engineering, computational, statistical, or technical written outputs
Comfort identifying methodological issues, reasoning gaps, weak evidence, incorrect assumptions, or unsupported technical conclusions
Strong ability to maintain consistency across detail-oriented technical evaluation tasks

Responsibilities

Create challenging problems and prompts within a specialised STEM or technical domain
Design tasks that test advanced reasoning, conceptual depth, analytical precision, and domain expertise
Develop clear expected answers, solution paths, or evaluation criteria for complex technical problems
Support high-quality data development through accurate, research-informed task design
Review AI-generated technical outputs for accuracy, completeness, reasoning quality, and domain relevance
Evaluate whether responses apply correct concepts, methods, terminology, and problem-solving logic
Identify unsupported claims, incomplete explanations, weak reasoning, calculation errors, or missing technical nuance
Assess written outputs against structured rubrics and project-specific evaluation criteria
Provide clear, precise, and well-supported written feedback on technical reasoning outputs
Explain evaluation decisions with consistency, attention to detail, and subject matter judgment
Follow detailed task instructions and apply domain-specific review criteria accurately
Participate in screening, onboarding, calibration, or domain alignment activities when required