This role involves creating specialty-specific clinical scenarios, writing reference-quality answers, and evaluating AI-generated medical responses against evidence-based standards. Physicians review diagnostic reasoning, treatment planning, risk stratification, and guideline-based decision-making to help improve healthcare-focused AI models. The work is fully remote and asynchronous, with collaboration alongside clinical and research teams during onboarding and calibration.
Key Responsibilities
- Develop realistic clinical cases and prompts that reflect day-to-day medical practice.
- Produce high-quality, attending physician-level reference responses aligned with current evidence and clinical guidelines.
- Evaluate AI-generated answers for strengths, omissions, reasoning errors, and overall clinical accuracy.
- Provide detailed written feedback using structured scoring rubrics and evaluation frameworks.
- Collaborate with multidisciplinary research teams to support consistency and quality across evaluations.
- Participate in onboarding sessions and specialty calibration meetings.
Required
- Attending physician with a current, active, and unrestricted medical license.
- Resident physician in the final year of an accredited residency program, or a recent graduate who is board-eligible.
- Fellow who is board-certified or board-eligible in the primary specialty.
- Physicians from a range of medical and surgical specialties are eligible to apply.
Preferred
- Strong understanding of evidence-based medicine and clinical practice guidelines.
- Excellent written communication skills.
- Experience with medical education, clinical research, peer review, or healthcare quality initiatives.
- Interest in artificial intelligence and healthcare innovation.
Benefits & Perks
- Fully remote, asynchronous work completed on your own schedule.
- Flexible schedule with a typical commitment of approximately 20 hours per week.
- Weekly payments.
- Opportunity for additional hours based on project needs.
- Rolling onboarding with ongoing project opportunities.
- Independent contractor engagement.