ERIC Number: EJ913917
Record Type: Journal
Publication Date: 2011-Jan
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
The Deceptive Mean: Conceptual Scoring of Cloze Entries Differentially Advantages More Able Readers
O'Toole, J. M.; King, R. A. R.
Language Testing, v28 n1 p127-144 Jan 2011
The "cloze" test is one possible investigative instrument for predicting text comprehensibility. Conceptual coding of student replacement of deleted words has been considered to be more valid than exact coding, partly because conceptual coding seemed fairer to poorer readers. This paper reports a quantitative study of 447 Australian secondary school student responses to three differing cloze tests covering identical content. The study sought to better understand the impact of cloze coding decisions on estimation of text difficulty and/or reader competence. Findings reveal the following: (a) conceptual coding increases reader cloze score differentially; (b) the increase in score from conceptual coding is greater for more able readers; (c) conceptual coding differentially advantages more able readers of less difficult text. This study is significant because instructors, researchers and developers often make decisions based on interpretation of mean scores from grouped cloze test results and such summaries of result distributions can obscure differential advantages such as those made clearer by this study. Estimates of text comprehensibility based on mean scores of conceptually coded cloze tests may overestimate group competence and underestimate text difficulty for some groups of readers. This contradicts an apparent consensus in the literature dealing with deletion-based tests. (Contains 5 tables and 2 figures.)
Descriptors: Cloze Procedure, Test Results, Language Tests, Reading Comprehension, Coding, Statistical Analysis, Foreign Countries, Secondary School Students, Difficulty Level, Scores, Test Reliability
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Australia
Grant or Contract Numbers: N/A