ERIC Number: EJ1385344
Record Type: Journal
Publication Date: 2023-Mar
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2476-5880
A Cognitive Diagnostic Assessment Study of the Reading Comprehension Section of the Preliminary English Test (PET)
Mohammed, Aisha; Dawood, Abdul Kareem Shareef; Alghazali, Tawfeeq; Kadhim, Qasim Khlaif; Sabti, Ahmed Abdulateef; Sabit, Shaker Holh
International Journal of Language Testing, v13 spec iss p1-20 Mar 2023
Cognitive diagnostic models (CDMs) have received much interest within the field of language testing over the last decade due to their great potential to provide diagnostic feedback to all stakeholders and ultimately improve language teaching and learning. A large number of studies have demonstrated the application of CDMs on advanced large-scale English proficiency exams, such as IELTS, TOEFL, MELAB, and ECPE. However, too little attention has been paid to the utility of CDMs on elementary and intermediate high-stakes English exams. The current study aims to diagnose the reading ability of test takers in the B1 Preliminary test, previously known as the Preliminary English Test (PET), using the generalized deterministic input, noisy, "and" gate (G-DINA; de la Torre, 2011) model. The G-DINA is a general and saturated model which allows attributes to combine in both compensatory and non-compensatory relationships and each item to select the best model. To achieve the purpose of the study, an initial Q-matrix based on the theory of reading comprehension and the consensus of content experts was constructed and validated. Item responses of 435 test takers to the reading comprehension section of the PET were analyzed using the "G-DINA" package in R. The results of attribute profiles suggested that lexico-grammatical knowledge is the most difficult attribute, and making an inference is the easiest one.
Descriptors: Reading Comprehension, Reading Tests, Language Tests, English (Second Language), Second Language Learning, Language Proficiency, Diagnostic Tests, Feedback (Response), Second Language Instruction, Linguistic Input, High Stakes Tests, Test Validity, Test Items, Test Content, Evaluation Methods, Computer Software, Inferences, Item Analysis, Test Construction
Tabaran Institute of Higher Education. Shariati 60, Shariati Blvd, Ghasem Abad, Mashhad, Khorasan Razavi, Iran. Tel: +98 (51) 35227215; e-mail: ijlt@tabaran.ac.ir; Web site: http://www.ijlt.ir/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language; International English Language Testing System
Grant or Contract Numbers: N/A