ERIC Number: EJ1298316
Record Type: Journal
Publication Date: 2021
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2229-0443
EISSN: N/A
Assessing the Validity of an IAU General English Achievement Test through Hybridizing Differential Item Functioning and Differential Distractor Functioning
Jamalzadeh, Mehri; Lotfi, Ahmad Reza; Rostami, Masoud
Language Testing in Asia, v11 Article 8 2021
The current study sought to examine the validity of a General English Achievement Test (GEAT), administered to university students in the fall semester of 2018-2019 academic year, by hybridizing differential information (DIF) and differential distractor function (DDF) analytical models. Using a purposive sampling method, from the target population of undergraduate students studying in different disciplines at Islamic Azad University (IAU), (Isfahan branch), a sample of 835 students taking GEAT were selected. The 60-item multiple-choice test comprised four sub-sections; namely, vocabulary, grammar, cloze test, and reading comprehension. The students' test scores served as the targeted data and the validity of the test was examined through the application of Cochran-Mantel-Haenszel (CMH) and multinomial log-linear regression models for detecting DIF and DDF, respectively. To account for the assumption of uni-dimensionality, the test sub-sections were analyzed independently. Furthermore, the assumption of local independence was checked based on correlational analysis and no extreme values were observed. The results of the study identified five moderate-level DIF items and one DDF item signaling an adverse effect on test fairness due to the existing biased items. Notably, these findings may have important implications for both language policymakers and test developers.
Descriptors: Language Tests, Achievement Tests, Undergraduate Students, Islam, Scores, Foreign Countries, Test Validity, Multiple Choice Tests, Test Items, Vocabulary Skills, Grammar, Cloze Procedure, Reading Comprehension, Correlation, Item Analysis, English (Second Language), Second Language Learning, Religious Colleges
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Iran
Grant or Contract Numbers: N/A