RN Clinical Data Annotation Specialist
Hippocratic AI
•Remote
About The Position
We are seeking Registered Nurses with at least 5 years of clinical experience — bedside nursing, case management, clinical nurse educators, or clinical quality — to join our internal data annotation team evaluating AI-driven clinical agents. You will review agent conversations spanning primary care, chronic disease management, care management, medication adherence, and scheduling, labeling and annotating for clinical accuracy, safety, and guideline adherence. This is a remote, contract position (1099). We are open to individuals available for 20 to 40 hours/week with flexible scheduling.
Requirements
- Active, unrestricted RN license in the United States. Compact license preferred.
- Minimum 5 years of hands-on clinical experience (bedside nursing, case management, clinical quality/utilization review, clinical nurse educators, or equivalent).
- Strong clinical judgment and working knowledge of evidence-based protocols and clinical practice guidelines.
- Comfortable reviewing written transcripts and applying structured rubrics with a high level of attention to detail.
- Strong written communication skills for documenting feedback and corrections clearly.
- Able to work independently and meet turnaround expectations.
Nice To Haves
- Prior experience in clinical quality assurance, utilization review, or case review.
- Experience with chart audits or clinical documentation review.
- Familiarity with AI-assisted clinical tools or digital health platforms.
Responsibilities
- Review recorded and simulated AI agent interactions across a variety of clinical use cases, applying sound clinical judgment to assess the accuracy, safety, and appropriateness of agent responses.
- Score and annotate agent performance using structured evaluation rubrics, aligning with evidence-based protocols and clinical practice guidelines.
- Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.
- Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.
- Participate in periodic calibration sessions with other clinical reviewers to ensure consistent annotation standards.
Benefits
- Hourly compensation, commensurate with experience.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Career Level
Mid Level
