Remote | Legal AI Reasoning Evaluation Consultant — $80–$120/hour

24-Mag•New York, NY

1d•Remote

About The Position

We are sharing a specialised part-time consulting opportunity for legal professionals experienced in legal research, legal writing, case analysis, employment law, labor law, workplace investigations, and structured legal reasoning evaluation. This role supports current and upcoming remote consulting opportunities focused on AI legal reasoning evaluation, workplace scenario review, legal response assessment, case-based analysis, written rationale review, and high-quality project execution. Selected professionals will evaluate AI-generated legal responses, assess accuracy and reasoning quality, identify gaps or unsupported conclusions, and provide structured written feedback based on detailed evaluation criteria.

Requirements

2+ years of professional experience in employment law, labor law, workplace investigations, or related legal practice areas
Experience gained through a law firm, in-house legal department, government agency, labor organization, or comparable legal environment
Strong legal research and legal writing experience, including case law analysis and legal memorandum drafting
Familiarity with the U.S. legal system and employment or labor-related legal reasoning
Excellent written communication skills with strong attention to detail
Ability to evaluate legal written outputs with accuracy, nuance, and structured professional judgment
Comfort applying detailed rubrics, legal review criteria, and evaluation guidelines consistently
Ability to work independently in a remote, project-based environment
J.D. from a U.S. law school or LL.B./LL.M. from an accredited law school is preferred
U.S. law license is preferred and may be active or inactive depending on project requirements
Academic or professional experience involving legal research, legal writing, case analysis, employment law, labor law, workplace investigations, or legal policy review is highly relevant
Backgrounds involving litigation, advisory work, compliance, investigations, legal drafting, legal education, or structured legal assessment may be especially valuable

Nice To Haves

Experience evaluating legal memoranda, workplace investigation summaries, employment disputes, or labor-related written materials
Familiarity with issue spotting, legal reasoning assessment, case law interpretation, and structured legal analysis
Experience providing written feedback, quality review, editing, legal training, or rubric-based evaluation
Comfort comparing multiple written responses and identifying stronger legal reasoning, clearer explanations, or more complete analysis
Strong ability to maintain consistency across repetitive, detail-oriented review tasks

Responsibilities

Evaluate AI-generated legal responses for accuracy, correctness, clarity, completeness, and practical usefulness
Compare multiple responses to the same legal prompt and assess relative quality, reasoning strength, and professional readiness
Review responses involving employment disputes, workplace investigations, labor matters, and related legal scenarios
Identify weak analysis, unsupported conclusions, missing legal nuance, unclear reasoning, or incomplete issue spotting
Apply strong legal research and legal writing judgment to workplace and employment-related scenarios
Assess whether written responses reflect sound legal reasoning, relevant issue analysis, and appropriate use of legal principles
Evaluate case law analysis, legal memoranda-style reasoning, and structured legal explanations
Support review work involving U.S. legal system concepts, employment law frameworks, and labor-related analysis
Provide clear, precise, and well-supported written feedback on AI-generated legal outputs
Explain evaluation decisions with consistency, professional judgment, and attention to legal reasoning standards
Follow detailed task instructions and apply structured rubrics accurately
Participate in onboarding, calibration, or specialty alignment activities when required