Cognitive diagnostic models (CDMs) have great promise for providing diagnostic information to aid learning and instruction, and a large number of CDMs have been proposed. However, the assumptions and performances of different CDMs and their applications in regard to reading comprehension tests are not fully understood. In the present study, we…

For those tests solely composed of testlets, local item independency assumption tends to be violated. This study, by using empirical data from a large-scale state assessment program, was interested in investigates the effects of using different models on equating results under the non-equivalent group anchor-test (NEAT) design. Specifically, the…

This study builds upon previous work aimed at developing a student model of reading comprehension ability within the intelligent tutoring system, iSTART. Currently, the system evaluates students' self-explanation performance using a local, sentence-level algorithm and does not adapt content based on reading ability. The current study leverages…

Content balancing is one of the most important components in the computerized adaptive testing (CAT) especially in the K to 12 large scale tests that complex constraint structure is required to cover a broad spectrum of content. The purpose of this study is to compare the weighted penalty model (WPM) and the weighted deviation method (WDM) under…

The purpose of this study was to investigate the use of English language proficiency and academic reading assessment scores to predict the future academic success of English learner (EL) students. Data from two cohorts of middle-school ELs were used to evaluate three prediction models. One cohort of students was used to develop the prediction…

The purpose of this study was to investigate the relative appropriateness of several procedures for estimating reliability and standard errors of measurement of complex reading comprehension tests. Seven generalizability theory models were conceptualized by incorporating one or several factors of items, passages, themes, contents, and types of…

After reviewing the information that teachers and other decision makers need to have about student achievement and some recent advances in the theory and practice of reading assessment, the author makes a number of recommendations for improving assessment programs. These include: do less massive, broad-band testing, but improve the reliability and…

An investigation was undertaken of the intercorrelations among residuals obtained by applying regression techniques under two conditions: (1) mean sixth-grade Metropolitan Achievement Test reading scores predicted by mean second-grade Stanford Achievement Test reading scores, and (2) mean sixth-grade reading scores predicted by mean second-grade…

Four papers on reading in a second language are reviewed and discussed. They include a study of assessment and the difficulties inherent in the measurement of a construct as complex as reading comprehension. The other three deal with variables facilitating comprehension in reading. One supports an interactive model of reading rather than a…

The strengths of item-response theory (IRT) are used to examine the degree of information individual test items provide, as well as to investigate how the individual item types contribute to the overall measurement accuracy of the Illinois Goal Assessment Program (IGAP) reading test. Using the graded-response model of Samejima (1969), the amount…

The need for improved measures is particularly acute in reading because, in spite of the magnitude of time and effort which continues to be invested in reading, there is no insurance that the outcome is indeed proportionate to the effort involved. How much of the educational system's performance relative to its own goals is measured by a…

In this article some results are presented relating to the dimensionality of instruments containing polytomously scored as well as dichotomously scored items, concentrating on the 1992 National Assessment of Educational Progress' (NAEP) mathematics and reading assessment data and several simulated datasets. The maximum likelihood factor analytic…

In the Dutch national examinations, reading comprehension tests are used for all languages. For the native language, reading comprehension is tested with reading passages and related questions to which the test-taker provides his own response, not choosing from a group of alternatives. One problem encountered in testing with these items is…

Traditionally, studies of beginning reading have focused either on between-subjects' differences or on changes in reading performance characteristics induced by specific training procedures. A third approach to reading is a within-subjects' comparison of individual performance characteristics at varying difficulty levels. The present study…

The American College Testing Program is developing a new program, Work Keys, a system to develop and assess employability skills. It consists of four components: (1) a systematic process for profiling job skill requirements; (2) assessments that measure learners' job skill levels; (3) procedures and formats for conveying assessment results so they…