Applied AI Health Scientist (ARPA-H)
About The Position
As a Applied AI Health Scientist supporting our client, you will play a pivotal role in shaping our success. This is a Science and Engineering and Technical Advisor (SETA) role in the Proactive Health Mission Office at the Advanced Research Projects Agency for Health (ARPA-H) responsible for providing expertise in artificial intelligence and machine learning to support a program advancing AI diagnostics for rare diseases. Successful candidates have the ability to critically assess technical approaches, advise program leadership, and ensure that funded performers and partners are meeting the highest standards of rigor, reproducibility, and real-world applicability. You will contribute expertise across the full lifecycle of AI system development: data aggregation and curation, model training and benchmarking, and deployment/validation in real-world clinical settings.
Requirements
- Master's degree in Computer Science, Machine Learning, Data Science, or related field.
- 10+ years of relevant professional experience.
- Experience applying advanced ML methods (LLMs, deep learning, etc) to complex health datasets.
- Familiarity with clinical and biomedical data types, including EHR, genomic, and imaging data.
- Demonstrated ability to review, critique, and guide AI/ML technical work at a high level.
- Strong understanding of evaluation methods for AI/ML, including robustness, fairness, interpretability, and reproducibility.
- Strong written and visual communication skills, with ability to produce high-quality reports and presentations.
- Intermediate experience with Microsoft Office productivity software and collaboration tools such as Microsoft Teams and SharePoint.
Nice To Haves
- Experience in healthcare AI or biomedical applications.
- Familiarity with the rare disease field
- Prior involvement in technical advisory, evaluation, or SETA-style roles.
- Experience working with interdisciplinary teams including clinicians and patient stakeholders.
- Experience working in an early-stage, fast-paced, startup environment
Responsibilities
- Review and evaluate AI/ML technical proposals and deliverables from external teams.
- Provide guidance on model development, training methods, and validation strategies.
- Advise on integration of multimodal health data (EHR, imaging, genomic, and patient-reported).
- Assess alignment of model architectures and approaches with program goals and clinical use cases.
- Evaluate benchmarking results and provide feedback on methodological soundness.
- Advise on deployment considerations, including interpretability, reliability, and safety in real-world settings.
- Collaborate with clinical SMEs to ensure AI outputs align with clinician expectations and workflows.
- Identify risks, gaps, or weaknesses in technical approaches and recommend corrective actions.
- Support program leadership with technical assessments, reports, and recommendations.
- Produce high-quality written reports and presentations that synthesize complex technical findings for diverse audiences.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
101-250 employees
