Physician Reviewer (MD/DO) - Medical AI Evaluation

Job description

The role involves reviewing written clinical cases and assessing the quality of diagnostic and treatment reasoning. Evaluate EHR vignettes paired with a question, proposed answer, and distractor. Score vignette accuracy, completeness, answer correctness, and trap quality. Verify that reasoning chains reach the answer from vignette facts and write brief rationales. Work within three independent blind reads followed by physician adjudication. Flexible participation from anywhere without patient contact.

Requirements

• Medical degree (MD or DO)
• active unrestricted US medical license
• board certification or completed residency with recent direct patient care (attending level preferred)
• broad multi‑system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• strong clinical reasoning including differential diagnosis and next‑step management
• strong written English (C1+)
• knowledge or experience in medical AI evaluation, clinical content review, exam question review, or medical annotation/QA (a plus)

Skills