Experienced physicians contribute to AI research by creating realistic clinical scenarios, writing reference answers, and evaluating AI-generated medical responses for reasoning, safety, and guideline adherence. The work is broad across non-specialty-specific medical fields and may include family medicine, pediatrics, anesthesiology, surgery, ENT, PM&R, pain medicine, occupational medicine, and other specialties. This is a fully remote, independent contractor role with specialty calibration and written feedback focused on improving the quality and accuracy of clinical AI outputs.
Key Responsibilities
- Design clinically realistic prompts and patient scenarios based on medical specialty expertise.
- Develop reference responses that demonstrate attending-level clinical reasoning.
- Evaluate AI-generated medical responses using structured criteria.
- Assess diagnostic reasoning, treatment planning, risk stratification, and guideline adherence.
- Provide detailed written feedback to improve the safety and accuracy of outputs.
- Participate in onboarding and specialty calibration sessions.
Required
- Board-certified attending physician with a current, active, unrestricted medical license.
- Final-year resident or recent graduate who is board-eligible, or fellow who is board-certified or board-eligible in the primary specialty.
- Strong clinical reasoning and evidence-based medical decision-making skills.
- Excellent written communication skills and close attention to detail.
- Ability to work independently in a fully remote environment.
Preferred
- Family Medicine, Pediatrics, Anesthesiology, General Surgery, ENT, PM&R, Pain Medicine, or Occupational Medicine background.
- Experience in a specialty not covered by dedicated specialty-specific AI evaluation roles.
- Prior work evaluating clinical content, medical decision support, or AI-generated outputs.
Benefits & Perks
- Fully remote work from the United States or Canada.
- Hourly contract engagement.
- Competitive compensation based on specialty and experience.
- Weekly payments.
- 20+ hours per week commitment.