Physicians in this role use clinical expertise to create realistic patient scenarios, write reference responses, and evaluate AI-generated medical answers for reasoning, accuracy, and safety. The work is fully remote and centers on structured review of diagnostic reasoning, treatment planning, risk assessment, and guideline adherence. It is a contract, hourly engagement for clinicians who can work independently and provide detailed written feedback.
Key Responsibilities
- Design clinically realistic prompts and patient scenarios based on medical specialty.
- Develop reference responses that demonstrate attending-level clinical reasoning.
- Evaluate AI-generated medical responses using structured evaluation criteria.
- Assess diagnostic reasoning, treatment planning, risk stratification, and guideline adherence.
- Provide detailed written feedback to improve the safety and accuracy of AI outputs.
- Participate in onboarding and specialty calibration sessions to support evaluation consistency.
Required
- Board-certified attending physician with a current, active, unrestricted medical license.
- Final-year resident physician or recent graduate who is board-eligible, if applying as a resident.
- Fellow who is board-certified or board-eligible in the primary specialty with a current, active, unrestricted medical license.
- Strong clinical reasoning and evidence-based medical decision-making skills.
- Excellent written communication skills and close attention to detail.
- Ability to work independently in a fully remote environment.
Preferred
- Experience in Family Medicine, Pediatrics, Anesthesiology, General Surgery, ENT (Otolaryngology), PM&R, Pain Medicine, Occupational Medicine, or another specialty not covered by dedicated specialty-specific roles.
Benefits & Perks
- Fully remote work within the United States or Canada.
- Hourly contract engagement.
- Weekly payments.
- Competitive compensation based on specialty and experience.
- Opportunity to contribute to advanced AI research and evaluation projects.