NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1329129
Record Type: Journal
Publication Date: 2021
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2148-7456
EISSN: N/A
The Continuity of Students' Disengaged Responding in Low-Stakes Assessments: Evidence from Response Times
Bulut, Hatice Cigdem
International Journal of Assessment Tools in Education, v8 n3 p527-541 2021
Several studies have been published on disengaged test respondents, and others have analyzed disengaged survey respondents separately. For many large-scale assessments, students answer questionnaire and test items in succession. This study examines the percentage of students who continuously engage in disengaged responding behaviors across sections in a low-stakes assessment. The effects on calculated scores of filtering students, based on their responding behaviors, are also analyzed. Data of this study came from the 2015 administration of PISA. For data analysis, frequencies and percentages of engaged students in the sessions were initially calculated using students' response times. To investigate the impact of filtering disengaged respondents on parameter estimation, three groups were created, namely engaged in both measures, engaged only in the test, and engaged only in the questionnaire. Next, several validity checks were performed on each group to verify the accuracy of the classifications and the impact of filtering student groups based on their responding behavior. The results indicate that students who are disengaged in tests tend to continue this behavior when responding to the questionnaire items in PISA. Moreover, the rate of continuity of disengaged responding is non-negligible as can be seen from the effect sizes. On the other hand, removing disengaged students in both measures led to higher or nearly the same performance ratings compared to the other groups. Researchers analyzing the dataset including achievement tests and survey items are recommended to review disengaged responses and filter out students who are continuously showing disengaged responding before performing further statistical analysis.
International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Arab Emirates; Australia; Austria; Belgium; Bulgaria; Brazil; Canada; Switzerland; Chile; Colombia; Czech Republic; Germany; Lithuania; Luxembourg; Latvia; Macau; Mexico; Montenegro; Malaysia; Netherlands; Norway; New Zealand; Peru; Poland; Portugal; Denmark; Dominican Republic; Spain; Estonia; Finland; France; United Kingdom; Greece; Hong Kong; Croatia; Hungary; Ireland; Iceland; Israel; Italy; Japan; South Korea; Qatar; China; United States; Russia; Singapore; Slovakia; Slovenia; Sweden; Taiwan; Thailand; Tunisia; Turkey; Uruguay
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A