Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving…

Introduction: Board certification has evolved from a "point-in-time" event to a process of periodic learning and reevaluation of medical competence through maintenance of certification (MOC). To better understand MOC participation, the transtheoretical model (TTM) was used to describe physicians' perceptions of MOC as a sequence of…

Changes in certification requirements and examinee characteristics are likely to influence the validity of the evidence associated with interpretations made based on test data. We examined whether changes in Educational Commission for Foreign Medical Graduates (ECFMG) certification requirements over time were associated with changes in internal…

Effective clinical faculty are essential for disseminating substance abuse screening, brief intervention, and referral to treatment (SBIRT). The authors developed an 8-hour SBIRT training for internal medicine faculty preceptors. Trainers conducted SBIRT lectures and small-group communication practice sessions. The authors assessed participants'…

The authors sought to evaluate the feasibility and acceptability of initiating a Screening, Brief Intervention, and Referral to Treatment (SBIRT) for alcohol and other drug use curriculum across multiple residency programs. SBIRT project faculty in the internal medicine (traditional, primary care internal medicine, medicine/pediatrics),…

The mini-CEX is widely used to rate directly observed resident-patient encounters. Although several studies have explored the reliability of mini-CEX scores, the dimensionality of mini-CEX scores is incompletely understood. Objective: Explore the dimensionality of mini-CEX scores through factor analysis and generalizability analysis. Design:…

Context specificity, or the variation in a participant's performance from one case, or situation, to the next, is a recognized problem in medical education. However, studies have not explored the potential reasons for context specificity in experts using the lens of situated cognition and cognitive load theories (CLT). Using these theories, we…

Learning theories, which suggest that experienced faculty use collaborative teaching styles, are reflected in qualitative studies of learners in hospital settings. However, little research has used resident focus groups to explore characteristics of successful teachers in outpatient clinics. Therefore, focus group discussions with first through…

Background: Adaptation to learning styles has been proposed to enhance learning. Objective: We hypothesized that learners with sensing learning style would perform better using a problem-first instructional method while intuitive learners would do better using an information-first method. Design: Randomized, controlled, crossover trial. Setting:…

Utilization of objective structured clinical examinations (OSCEs) for final assessment of medical students in Internal Medicine requires a representative sample of OSCE stations. The reliability and generalizability of OSCE scores provides validity evidence for OSCE scores and supports its contribution to the final clinical grade of medical…

A study compared the 1984-88 test performances of United States osteopathic medical school graduates and Canadian medical school graduates with those of U.S. and foreign medical school graduates during the same period. Findings, limitations, and implications for recruitment and training of internal medicine specialists are discussed. (Author/MSE)

Performance on patient management problems and multiple-choice questions was analyzed for candidates for American Board of Internal Medicine certification whose residencies had been problem-oriented, for candidates whose residencies had been classified as nonproblem-oriented, and for the national pool of U.S. medical graduates. (Author/MLW)

This study compared the analytic scores on an essay test of clinical judgment generated by nonphysician readers with those of physician readers. Generalizability theory was applied to determine the number of essays and scorers required to reach specified levels of reproducibility. Results suggested that with training nonphysicians could…

A study assessed the effectiveness of medical resident training programs during 1983-88 by evaluating students' certification scores and comparing them to the program's evaluation of students' clinical competence. Results are reported and analyzed for top-rated, university-affiliated, and non-university-affiliated programs, focusing on trends over…