ERIC Number: EJ866999
Record Type: Journal
Publication Date: 2009
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Application of Three Cognitive Diagnosis Models to ESL Reading and Listening Assessments
Lee, Yong-Won; Sawaki, Yasuyo
Language Assessment Quarterly, v6 n3 p239-263 2009
The present study investigated the functioning of three psychometric models for cognitive diagnosis--the general diagnostic model, the fusion model, and latent class analysis--when applied to large-scale English as a second language listening and reading comprehension assessments. Data used in this study were scored item responses and incidence matrices, or Q-matrices (Tatsuoka, 1983, 1990), for the Listening and Reading sections of two field test forms of the TOEFL[R] iBT (Test of English as a Foreign Language[TM]). Results of empirical data analyses based on the three cognitive diagnosis models above revealed that (a) all three models adequately separated examinees into two mastery levels on most of the reading and listening skills, (b) a moderate level of across-form consistency of examinee skill mastery classification was achieved for most of the reading and listening skills as defined in this study, but (c) a large proportion of examinees were classified into "flat" profiles (i.e., "nonmasters of all skills" and "masters of all skills"). Overall, the three models produced similar results in terms of examinee classification, but some subtle differences across them were identified as well. (Contains 5 footnotes, 3 tables, and 6 figures.)
Descriptors: Reading Comprehension, Field Tests, Identification, Classification, Psychometrics, Listening Skills, Item Response Theory, Language Tests, Models, English (Second Language), Second Language Learning, Test Items, Cognitive Ability
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A