ERIC Number: EJ1265426
Record Type: Journal
Publication Date: 2020-Aug
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0734-2829
EISSN: N/A
Exploring the Impact of Q-Matrix Specifications through a DINA Model in a Large-Scale Mathematics Assessment
Wu, Haiyan; Liang, Xinya; Yürekli, Hülya; Becker, Betsy Jane; Paek, Insu; Binici, Salih
Journal of Psychoeducational Assessment, v38 n5 p581-598 Aug 2020
The demand for diagnostic feedback has triggered extensive research on cognitive diagnostic models (CDMs), such as the deterministic input, noisy output "and" gate (DINA) model. This study explored two Q-matrix specifications with the DINA model in a statewide large-scale mathematics assessment. The first Q-matrix was developed based on five predefined content reporting categories, and the second was based on the post hoc coding of 15 attributes by test-development experts. Total raw scores correlated strongly with the number of skills mastered, using both Q-matrices. Correlations between the DINA-model item statistics and those from the item response theory analyses were moderate to strong, but were always lower for the 15-skill model. Results highlighted the trade-off between finer-grained modeling and less precise model estimation.
Descriptors: Mathematics Tests, Cognitive Measurement, Models, Test Items, Raw Scores, Item Response Theory, Test Content, Skills, Correlation
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A