Postdoctoral Research Associate, AI Biosecurity Evaluation and Study Design

UVA Health • Charlottesville, VA

8d • $60,000 - $75,000 • Onsite

About The Position

This position leads the design, execution, and analysis of a large paired human-subjects study that links AI biosecurity benchmark scores to performance on realistic biological protocol-design and troubleshooting tasks. The researcher reports to Associate Professor Stephen D. Turner and coordinates closely with co-investigators Tom Hartvigsen and Chirag Agarwal, and a laboratory partner. The role draws on study design, psychometric and statistical analysis, and management of participant data collection. The researcher will also contribute to a parallel machine unlearning effort, supporting measurement of how capability-mitigation methods affect both benchmark scores and real-world task performance.

Requirements

• Doctoral degree (PhD or equivalent) in data science, statistics, biostatistics, psychometrics, quantitative psychology, a biological or biomedical science, or a related field, completed at the time of hire
• Experience designing and analyzing human subjects studies, including power analysis and study design
• Strong statistical programming in R or Python, including mixed-effects or hierarchical modeling
• Working knowledge of molecular biology or microbiology sufficient to evaluate biological protocols and collaborate with laboratory scientists

Nice To Haves

• Research experience in biosecurity, biodefense, or dual-use risk assessment
• Familiarity with AI or large language model evaluation, benchmarking, or psychometric validation of model capabilities
• Experience with machine learning tooling such as PyTorch or Hugging Face Transformers, and with model finetuning workflows
• Prior work under IRB oversight and with controlled or sensitive data
• Record of open-source software or reproducible-research practices
• Experience coordinating academic-industry or multi-site research collaborations

Responsibilities

• Lead day-to-day execution of the paired evaluation study, including benchmark administration, participant recruitment and scheduling, and coordination with the laboratory partner on protocol intake and outcome reporting
• Develop scoring rubrics and instruments for protocol-design, feasibility, and troubleshooting tasks
• Build and run mixed-effects and item-level analyses that estimate how benchmark scores predict real-world task performance, with quantified uncertainty
• Produce the benchmark validity report and the benchmark-to-task crosswalk and calibration framework
• Contribute to the machine unlearning and model editing components through safety-utility analyses, including within-subject comparisons of model variants on shared task batteries
• Prepare manuscripts, preprints, and documentation for open release, and support IRB compliance and data quality

Benefits

• UVA Health Plan: the choice between 3 different health plans
• Vision Coverage
• Dental Plan
• Benefit Savings Plans
• Life Insurance
• Disability Benefits
• Paid Time Off: starting with 22 days of time off per year
• 12 or more holidays
• 8 weeks parental leave
• Use of up to $5250 per calendar year towards a for-credit degree program or for-credit certificate program
• Use of up to $2000 of the total $5250 noted above per calendar year for professional development including job-related training, conferences, and initial certificate exams.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Education Level: Ph.D. or professional degree