This study retrospectively applies aggregate scoring to the cardiology questions from a recertifying examination in general internal medicine. Three groups of experts were identified among the examinees and the remainder of the examinees were the participants (N=1887) of the study. Generalizability theory is applied to these data. (MLW)

This study compared the analytic scores on an essay test of clinical judgment generated by nonphysician readers with those of physician readers. Generalizability theory was applied to determine the number of essays and scorers required to reach specified levels of reproducibility. Results suggested that with training nonphysicians could…

A study assessed the effectiveness of medical resident training programs during 1983-88 by evaluating students' certification scores and comparing them to the program's evaluation of students' clinical competence. Results are reported and analyzed for top-rated, university-affiliated, and non-university-affiliated programs, focusing on trends over…

This study examined whether two variations on the typical Angoff group standard-setting process would produce sufficiently consistent results to recommend their use. The results imply that judgments gathered after an initial traditional group-process session can provide an efficient alternative mechanism for setting cutting scores using the Angoff…

A study investigated the relationship of internal medicine fellowship program characteristics (n=140 programs) to their students' characteristics and performance on a cardiovascular disease licensing examination. Results show indicators such as fellow-to-faculty ratio, training length, and fellowship performance correlate with student knowledge…