Undergraduate medical education aims to train the students to develop the required clinical skills and preparation for the residency. The validity of the assessment on clinical competence is primarily ignored or uncompleted, especially in the clinical clerkship. The current study was multifaceted and accomplished multiple evaluation and research goals. This research was nested within a broader evaluation study, which focused on one element of the U.T. medical education-Internal Medicine (I.M.) clerkship effectiveness. Within the context of this self-assessment and continuous improvement, the overarching research goal was to conduct a psychometric study of the Objective Structured Clinical Examinations (OSCEs) in the I.M. clerkship, which was both methodological and evaluative. This study began with applying Rasch Model (R.M.) to conduct a psychometric examination of the OSCEs (OSCE-B and OSCE-L), followed by statistical methods establishing the degree to which OSCE performances predicted success on USMLE Step 2 C.S. Accomplishing the research goal informed summative and formative evaluation decisions of the clerkship effectiveness and areas for improvement. The methodology, which integrated measurement, statistical, assessment, and program evaluation theory and methods is the first of its kind in medical education. Therefore, this study also provides a road map to guide other medical education and professional programs through a self-assessment process that supports accreditation and continuous improvement requirements. Additional implications and recommendations for future studies were also discussed. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml.]