This study compared the analytic scores on an essay test of clinical judgment generated by nonphysician readers with those of physician readers. Generalizability theory was applied to determine the number of essays and scorers required to reach specified levels of reproducibility. Results suggested that with training nonphysicians could…

This study analyzed the relationship between selecting critical errors (choices that would be dangerous to patients) and conventional test scores on a medical school certifying examination that included three item formats: regular and weighted multiple-choice questions and patient management problems. Data from a Clinical Certifying Examination…

Medical students (N=284) from four Northeastern medical schools interacted with standardized patients, then were given a free-response form (blank form for writing diagnostic impressions) and then they completed a cued-response form, which listed a series of diagnoses generated by the case author. The patients also completed a checklist. (MLW)

The presence and extent of overlap between checklist and written scores using data for over 400 medical students in 6 classes on an examination including clinical encounter stations with standardized patients were studied. Eighty-three cases used both measures. Written scores provide information in addition to that of the checklists. (SLD)