Remote | Member of Technical Staff, Legal Research — $400,000–$800,000/year
About The Position
24-MAG LLC is offering a full-time, fully remote opportunity for experienced legal researchers and legal professionals to contribute to advanced AI research and evaluation initiatives. The role focuses on designing rigorous evaluation frameworks for legal AI systems, conducting applied research on legal reasoning and interpretation, developing realistic benchmark environments, and collaborating with researchers and engineers to assess and improve AI performance across sophisticated legal tasks. The work includes legal research, AI evaluation, benchmark development, methodology design, and failure analysis. Assignments may cover corporate law, contracts, litigation, regulatory compliance, intellectual property, employment law, and public policy. Strong legal-research methodology and structured analytical judgment are central to the role. Collaboration will involve researchers, engineers, legal professionals, and other multidisciplinary contributors. Compensation is listed as $400,000–$800,000 per year, but the posting notes a substantial compensation inconsistency and says final terms should be confirmed during hiring. Equity compensation and performance-based incentives may be available, depending on applicable employment terms and policies. Benefits may include health-insurance support, paid time off, retirement-plan contributions, and other employment benefits. Work must be completed without using confidential, privileged, proprietary, or otherwise restricted information belonging to any employer, client, law firm, institution, or other third party. The opportunity is available through 24-MAG LLC, which connects experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
Requirements
- Advanced degree in Law, such as a JD, LLM, SJD, PhD in Law, or equivalent.
- Deep expertise in one or more substantive legal domains.
- Demonstrated experience conducting legal research, legal analysis, or policy work.
- Strong understanding of legal reasoning and research methodology.
- Experience developing structured approaches for assessing legal arguments or outcomes.
- Strong analytical reasoning and written communication skills.
- Ability to translate legal expertise into rigorous evaluation criteria.
- Ability to work with interdisciplinary research, technology, or legal-operations teams.
- Work must not use confidential, privileged, proprietary, or otherwise restricted third-party information.
Nice To Haves
- Familiarity with legal technology or AI-enabled legal workflows.
- Background in legal benchmarking or legal knowledge management.
- Published legal scholarship or policy research.
- Contributions to legal standards, frameworks, or research methodologies.
Responsibilities
- Design and own evaluation frameworks for AI systems operating in legal domains.
- Develop benchmark suites, scoring methodologies, and legal-quality rubrics.
- Establish research-grade protocols for evaluating complex legal tasks and consistent standards for assessing legal reasoning and analytical quality.
- Evolve evaluation methodologies as legal AI capabilities advance.
- Conduct applied research on legal reasoning and statutory interpretation.
- Analyze legal arguments, authorities, and structured decision-making processes.
- Research complex questions across relevant areas of law.
- Develop methodologies for assessing legal outcomes and research quality.
- Translate sophisticated legal concepts into structured evaluation criteria.
- Develop and curate datasets reflecting realistic legal challenges.
- Create case studies and benchmark environments for legal AI evaluation.
- Design tasks involving legal research, analysis, and workflow execution.
- Support evaluation of agentic legal workflows and automation.
- Maintain benchmark quality, consistency, and practical relevance.
- Evaluate legal-focused AI models and agentic systems.
- Analyze reasoning quality, output reliability, and recurring failure modes.
- Identify weak interpretations, unsupported conclusions, and methodological errors.
- Assess AI performance across different legal use cases and provide structured findings to support model and evaluation improvements.
- Collaborate with legal researchers, engineers, and interdisciplinary teams.
- Produce research findings, evaluation methodologies, and best-practice guidance.
- Monitor developments in legal technology, jurisprudence, regulation, and AI research.
- Contribute to legal benchmarking and knowledge-management standards.
- Help establish rigorous practices for evaluating AI-supported legal workflows.
Benefits
- Equity compensation and performance-based incentives may be available depending on applicable employment terms and policies.
- Benefits may include health-insurance support, paid time off, retirement-plan contributions, and other employment benefits.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
Ph.D. or professional degree
