ERIC Number: EJ1405974
Record Type: Journal
Publication Date: 2023
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0895-7347
EISSN: EISSN-1532-4818
Change in Engagement during Test Events: An Argument for Weighted Scoring?
Steven L. Wise; G. Gage Kingsbury; Meredith L. Langi
Applied Measurement in Education, v36 n4 p340-354 2023
Recent research has provided evidence that performance change during a student's test event can indicate the presence of test-taking disengagement. Meaningful performance change implies that some portions of the test event reflect assumed maximum performance better than others and, because disengagement tends to diminish performance, lower-performing portions are less likely to reflect maximum performance than higher-performing portions. This empirical study explored the use of differential weighting of item responses during scoring, with weighting schemes representing either declining or increasing performance. Results indicated that weighted scoring could substantially decrease the score distortion due to disengagement factors and thereby improve test score validity. The study findings support the use of scoring procedures that manage disengagement by adapting to student test-taking behavior.
Descriptors: Tests, Weighted Scores, Test Wiseness, Scoring, Maximum Likelihood Statistics, Student Evaluation, Performance Factors
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A