Remote | Member of Technical Staff, Legal Research — $400,000–$800,000/year
24-Mag•New York, NY
•Remote
About The Position
We are sharing a full-time opportunity for experienced legal researchers and legal professionals with deep expertise in legal analysis, research methodology, benchmarking, and complex legal workflows to contribute to advanced AI research and evaluation initiatives. Selected professionals will design rigorous evaluation frameworks for legal AI systems, conduct applied research on legal reasoning and interpretation, develop realistic benchmark environments, and collaborate with researchers and engineers to assess and improve AI performance across sophisticated legal tasks.
Requirements
- Advanced degree in Law, such as JD, LLM, SJD, PhD in Law, or equivalent
- Deep expertise in one or more substantive legal domains
- Demonstrated experience conducting legal research, legal analysis, or policy work
- Strong understanding of legal reasoning and research methodology
- Experience developing structured approaches for assessing legal arguments or outcomes
- Strong analytical reasoning and written communication skills
- Ability to translate legal expertise into rigorous evaluation criteria
- Experience working with interdisciplinary research, technology, or legal-operations teams
Nice To Haves
- Relevant areas may include corporate law, contracts, litigation, regulatory compliance, intellectual property, employment law, or public policy
- Familiarity with legal technology or AI-enabled legal workflows is advantageous
- Background in legal benchmarking or legal knowledge management is beneficial
- Published legal scholarship or policy research is valuable
- Contributions to legal standards, frameworks, or research methodologies are advantageous
Responsibilities
- Design and own evaluation frameworks for AI systems operating in legal domains
- Develop benchmark suites, scoring methodologies, and legal-quality rubrics
- Establish research-grade protocols for evaluating complex legal tasks
- Define consistent standards for assessing legal reasoning and analytical quality
- Evolve evaluation methodologies as legal AI capabilities advance
- Conduct applied research on legal reasoning and statutory interpretation
- Analyse legal arguments, authorities, and structured decision-making processes
- Research complex questions across relevant areas of law
- Develop methodologies for assessing legal outcomes and research quality
- Translate sophisticated legal concepts into structured evaluation criteria
- Develop and curate datasets reflecting realistic legal challenges
- Create case studies and benchmark environments for legal AI evaluation
- Design tasks involving legal research, analysis, and workflow execution
- Support evaluation of agentic legal workflows and automation
- Maintain benchmark quality, consistency, and practical relevance
- Evaluate legal-focused AI models and agentic systems
- Analyse reasoning quality, output reliability, and recurring failure modes
- Identify weak interpretations, unsupported conclusions, and methodological errors
- Assess AI performance across different legal use cases
- Provide structured findings to support model and evaluation improvements
- Collaborate with legal researchers, engineers, and interdisciplinary teams
- Produce research findings, evaluation methodologies, and best-practice guidance
- Monitor developments in legal technology, jurisprudence, regulation, and AI research
- Contribute to legal benchmarking and knowledge-management standards
- Help establish rigorous practices for evaluating AI-supported legal workflows
Benefits
- health-insurance support
- paid time off
- retirement-plan contributions
- Equity compensation and performance-based incentives may be available
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
