Review and evaluate AI-driven clinical conversations focused on acute symptom triage, diabetes and insulin titration, and pre-travel health guidance. This part-time contract role is remote and centered on clinical accuracy, guideline adherence, escalation decisions, and patient safety. Clinicians also help refine test scenarios and provide structured feedback to support ongoing agent development and quality assurance.
Key Responsibilities
- Review recorded and simulated AI interactions for acute symptom triage and assess escalation and de-escalation decisions.
- Evaluate diabetes and insulin titration conversations for clinical accuracy and guideline adherence.
- Assess travel health guidance, including pre-travel counseling, vaccination recommendations, and destination-specific risk factors.
- Identify safety concerns, edge cases, and gaps in triage logic or clinical reasoning.
- Score and annotate agent performance using structured evaluation rubrics.
- Provide written feedback to clinical and product teams to support agent refinement.
- Participate in calibration sessions with other clinical subject matter experts.
- Help develop and refine test scenarios for ongoing quality assurance.
Required
- Active, unrestricted RN license or active, unrestricted U.S. Nurse Practitioner license.
- Current board certification for Nurse Practitioners (ANCC or AANP).
- At least 5 years of direct clinical experience in primary care, urgent care, telephone/virtual triage, or a comparable acute-care setting.
- Clinical experience managing patients with diabetes, including insulin titration.
- Current working knowledge of triage protocols and clinical practice guidelines.
- Ability to work independently in a remote, asynchronous contract role.
Preferred
- Experience in telephone triage or nurse advice line settings.
- Experience in travel medicine, occupational health, or pre-travel consultation.
- Familiarity with CDC and other travel medicine guidelines.
- Prior experience in clinical quality assurance, utilization review, or case review.
- Familiarity with AI-assisted clinical tools or digital health platforms.
Benefits & Perks
- Remote, fully flexible scheduling.
- Up to 10 hours per week.
- Hourly compensation commensurate with experience.
- Contract (1099) engagement.
- Opportunity to support ongoing AI agent development and FDA evaluation milestones.