In this study, we assessed a highly structured, yearlong, case-based course designed for undergraduate pre-health students. We incorporated both content learning assessments and developed a novel method called Multiple Mini Exams for assessing course impact on the development of skills that professional schools often seek in pre-health students, focusing on students' abilities to collaborate with others, display bedside manners, synthesize patient case details, appropriately use scientific and medical language, and effectively attain patients' medical histories. This novel method utilized a rubric based on desired medical student skills to score videotaped behaviors and interactions of students role playing as doctors in a hypothetical patient case study scenario. Overall, our findings demonstrate that a highly structured course, incorporating weekly student performance and presentation of patient cases encompassing history taking, diagnosis, and treatment, can result in content learning, as well as improve desired skills specific for success in medical fields.