ERIC Number: EJ1209871
Record Type: Journal
Publication Date: 2019
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0260-2938
EISSN: N/A
Comparison of Standardized Assessment Methods: Logistics, Costs, Incentives and Use of Data
Simper, Natalie; Frank, Brian; Kaupp, Jake; Mulligan, Nerissa; Scott, Jill
Assessment & Evaluation in Higher Education, v44 n6 p821-834 2019
Critical thinking, problem solving and communication are fundamental elements of undergraduate education, but methods for assessing these skills across an institution are susceptible to logistical, motivational and financial issues. Queen's University conducted two research studies investigating the use of standardised tests to assess cognitive skill development across the institution. Synthesis of results from implementing the Collegiate Learning Assessment (CLA+), the Critical Thinking Assessment Test (CAT), and the HEIghten[superscript TM] test found that student test effort was a significant factor, and effort level correlated with performance at r = 0.33. Test incentives were also a significant factor; effort levels for the $25 financial incentive group were one standard deviation higher than effort for the in-class test group. A dedicated computer lab was the preferred option for computer-based testing. A paper-based test was found to be much simpler to administer, but test results were not available for a long time, therefore limiting the usefulness of data. The true cost of tests was greater than the price of the instrument; recruitment, training, proctoring and marking costs need to be included in the calculation. Generally speaking, alignment of test objectives with student or course objectives, and timeliness of data, were key for participation and motivation.
Descriptors: Foreign Countries, Student Evaluation, Standardized Tests, Undergraduate Students, Critical Thinking, Cognitive Tests, Thinking Skills, Incentives, Computer Assisted Testing, Preferences, Test Results, Costs, Alignment (Education), Comparative Analysis, Usability, Computer Centers
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada
Grant or Contract Numbers: N/A