ERIC Number: EJ1454277
Record Type: Journal
Publication Date: 2024
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0895-7347
EISSN: EISSN-1532-4818
Identifying Careless Responses in Computer-Adaptive Affective Surveys Using Person Fit Analysis
Stefanie A. Wind; Beyza Aksu-Dunya
Applied Measurement in Education, v37 n4 p391-411 2024
Careless responding is a pervasive concern in research using affective surveys. Although researchers have considered various methods for identifying careless responses, studies are limited that consider the utility of these methods in the context of computer adaptive testing (CAT) for affective scales. Using a simulation study informed by recent research, we explored the impact of careless response patterns on three types of response quality indicators: model-based person fit statistics, CAT-specific statistical process control indicators, and standalone indices of carelessness. We focused on over-consistency and random responding as forms of carelessness. All three types of indicators were sensitive to carelessness, with some differences related to CAT termination rules and item bank size. Our findings suggest that person fit analysis techniques may also be useful in affective CAT contexts to evaluating response quality from a measurement model perspective, including identifying carelessness. We discuss the implications of our work for research and practice.
Descriptors: Response Style (Tests), Computer Assisted Testing, Adaptive Testing, Affective Measures, Surveys, Responses, Test Items, Item Banks, Goodness of Fit, Item Response Theory
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A