Remote | Member of Technical Staff, Medical Research — $400,000–$800,000/year
24-Mag•New York, NY
•Remote
About The Position
We are sharing a full-time opportunity for experienced medical and healthcare researchers with deep expertise in clinical reasoning, evidence synthesis, healthcare research, benchmarking, and AI evaluation to contribute to advanced research on trustworthy healthcare-focused AI systems. Selected professionals will design rigorous evaluation frameworks, develop benchmark datasets and validation environments, analyse medical reasoning and failure patterns, and collaborate with clinicians, researchers, and engineers to improve AI systems supporting healthcare, biomedical, and clinical workflows.
Requirements
- Advanced degree in Medicine, Public Health, Nursing, Pharmacy, Biomedical Sciences, Epidemiology, Health Economics, or a related healthcare field
- Relevant credentials may include MD, DO, PhD, MPH, PharmD, or equivalent advanced qualifications
- Deep expertise in clinical practice, healthcare operations, biomedical research, public health, healthcare analytics, or evidence-based medicine
- Demonstrated experience conducting medical, clinical, biomedical, or healthcare research
- Strong understanding of research design and evidence evaluation
- Strong knowledge of healthcare decision-making processes
- Excellent analytical reasoning and scientific communication skills
- Experience working across multidisciplinary research, healthcare, technology, or policy environments
Nice To Haves
- Familiarity with digital health or clinical decision-support systems is advantageous
- Experience with healthcare analytics or health technology assessment is beneficial
- Knowledge of healthcare quality measurement, clinical guidelines, evidence synthesis, or benchmarking is valuable
- Published medical, clinical, healthcare, or biomedical research is advantageous
- Experience with clinical studies, systematic reviews, or healthcare evaluation initiatives is beneficial
- Experience with AI evaluation or benchmarking is useful but not required
Responsibilities
- Design evaluation frameworks for AI systems operating in medical and healthcare domains
- Develop benchmark structures, scoring methodologies, and clinical quality rubrics
- Define validation protocols for healthcare-oriented AI systems
- Establish consistent standards for measuring medical reasoning and decision-support quality
- Refine evaluation criteria as model capabilities and healthcare use cases evolve
- Conduct applied research on medical reasoning and evidence-based decision-making
- Analyse clinical workflows and healthcare information-synthesis processes
- Evaluate the quality and relevance of medical and biomedical evidence
- Apply research-design principles to healthcare-focused AI evaluation
- Translate complex medical findings into structured research conclusions
- Develop benchmark datasets based on realistic healthcare and biomedical scenarios
- Create evaluation environments reflecting practical clinical and research workflows
- Design tasks that test reasoning, evidence integration, and healthcare decision support
- Support development of agentic medical and healthcare evaluation workflows
- Ensure benchmark design reflects meaningful real-world healthcare challenges
- Analyse model performance across medical and healthcare use cases
- Identify reasoning weaknesses, failure patterns, and safety considerations
- Evaluate reliability across clinical, biomedical, and healthcare decision-support scenarios
- Investigate where AI-generated outputs diverge from professional standards
- Produce structured recommendations for improving model quality and trustworthiness
- Collaborate with clinicians, researchers, engineers, and multidisciplinary stakeholders
- Produce research reports, evaluation methodologies, and best-practice guidelines
- Contribute to healthcare AI benchmarking and reliability standards
- Monitor developments in medicine, healthcare delivery, biomedical research, and AI
- Help shape rigorous industry practices for evaluating healthcare-focused AI systems
Benefits
- health-insurance support
- paid time off
- retirement-plan contributions
- other employment benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
Ph.D. or professional degree
