ERIC Number: EJ1422970
Record Type: Journal
Publication Date: 2024
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: EISSN-1543-4311
A Three-Step DIF Analysis of a Reading Comprehension Test across Regional Dialects to Improve Test Score Validity
Language Assessment Quarterly, v21 n2 p141-158 2024
In sociolinguistic contexts where standardized languages coexist with regional dialects, the study of differential item functioning is a valuable tool for examining certain linguistic uses or varieties as threats to score validity. From an ecological perspective, this paper describes three stages in the study of differential item functioning (DIF): detection, comprehension and evaluation of its consequences. The research focuses on a reading comprehension test in Basque with 1,943 respondents representing two regional dialects. After assessing the dimensionality of the data fitting unidimensional and bifactor models, we start with a multi-method approach (Item Response Theory, Mantel-Haenszel, Standardization) to detect DIF. In a second step, we study the causes of DIF based on a qualitative methodology approach built on the focus group technique. Finally, the impact of DIF on the test level is evaluated through indicators of differential test functioning (DTF) derived from the IRT, and comparisons between situations that consider the presence/absence of DIF. The paper stresses the importance of the comprehensive study of DIF in language accreditation tests as a tool for improving score validity.
Descriptors: Reading Tests, Reading Comprehension, Scores, Test Validity, Dialects, Sociolinguistics, Test Items, Languages, Language Tests, Test Bias, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Spain
Grant or Contract Numbers: N/A