ERIC Number: EJ1409491
Record Type: Journal
Publication Date: 2023
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1755-1382
Available Date: N/A
Reliability and Validity of Methods to Assess Undergraduate Healthcare Student Performance in Pharmacology: Comparison of Open Book versus Time-Limited Closed Book Examinations
David Bell; Vikki O'Neill; Vivienne Crawford
Practitioner Research in Higher Education, v15 n1 p14-23 2023
We compared the influence of open-book extended duration versus closed book time-limited format on reliability and validity of written assessments of pharmacology learning outcomes within our medical and dental courses. Our dental cohort undertake a mid-year test (30xfree-response short answer to a question, SAQ) and end-of-year paper (4xSAQ, 1xessay, 1xcase) in pharmacology. For our first year medical cohort, pharmacology is integrated within a larger course, contributing 20xclinical vignette questions (to select the single best answer (SBA) to each question from a choice of 5 plausible answers) to a mid-year test and 3-5xSAQ to an end-of-year paper. Our experience indicates that SAQ are as reliable as SBA for closed-book time-limited assessments; reliability correlates with number of questions employed. We have found good correlation between mid-year and end-of-year performance (predictive validity), between questions (factorial validity) and between pharmacology and other subjects within the assessment (concurrent validity). Adoption of open-book extended duration assessments resulted in only modest reduction in reliability and validity.
Descriptors: Undergraduate Students, Pharmacology, Pharmaceutical Education, Test Format, Timed Tests, Comparative Analysis, Test Reliability, Correlation, Test Items, Predictive Validity, Test Validity, Vignettes, Item Analysis, Pathology, Dental Schools, Dentistry, Foreign Countries
University of Cumbria. LED Research Centre, Fusehill Street, Carlisle, Cumbria, England CA1 2HH. Tel: +44-1228-616338; Web site: https://ojs.cumbria.ac.uk/index.php/prhe
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (Belfast)
Grant or Contract Numbers: N/A
Author Affiliations: N/A