Item stem formats can alter the cognitive complexity as well as the type of abilities required for solving mathematics items. Consequently, it is possible that item stem formats can affect the dimensional structure of mathematics assessments. This empirical study investigated the relationship between item stem format and the dimensionality of…

Solving test items might require abilities in test-takers other than the construct the test was designed to assess. Item and student characteristics such as item format or reading comprehension can impact the test result. This experiment is based on cognitive theories of text and picture comprehension. It examines whether integration aids, which…

Existing reading comprehension assessments have been criticized by researchers, educators, and policy makers, especially regarding their coverage, utility, and authenticity. The purpose of the current study was to evaluate a new assessment of reading comprehension that was designed to broaden the construct of reading. In light of these issues, we…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics summative assessments in grades 3 through 8 and high school. The ELA/L assessments focus on reading and comprehending a range of sufficiently complex texts independently and…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics assessments in grades 3 through 8 and high school. New Meridian, in coordination with multiple states and vendors, developed an alternate form of the summative assessment to…

This technical report describes the development of progress monitoring measures in the area of Reading Comprehension. Measures were developed for grades 6 through 8. Twenty alternate forms of each measure were created. Passages were written by graduate students and reviewed by the lead author, as well as teachers and panels of graduate students.…

In this study, we describe the development of rapid reading measures, sentences presented to students in a nearly subliminal manner, with a literal comprehension question asked following their removal. After administering alternate forms of these measures to students, we present the results from three statistical analyses to ascertain their…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

The development and use of item shells in the construction of a series of standardized tests of reading comprehension at the elementary school level are described. An item shell is an item that is devoid of specific content, but contains key words and a distinctive syntactic structure. The specific content of the item shell varies depending on the…

An assessment analysis was performed to determine whether sets of items designed to measure three different subskills of reading comprehension of the Iowa Tests of Basic Skills (ITBSs) did, in fact, distinguish among these subskills. The three major skills objectives were: (1) facts; (2) generalizations; and (3) inferences. Data from…

The present study examined whether specific item characteristics, such as mode of acquisition (MoA) of word meanings, make reading comprehension tests particularly difficult for deaf children. Reading comprehension data on nearly 13,000 hearing 7-to-12-year-olds and 253 deaf 7-to-20-year-olds were analyzed, divided across test levels from second…

The passage dependence of an item refers to the degree to which it is necessary to read the associated passage in order to be able to answer that item correctly. This paper studies the value of obtaining data about passage dependence in the construction of reading comprehension achievement tests. Passage dependence indices were examined in several…

The possibility that certain features of items on a reading comprehension test may lead to biased estimates of the reading achievement of particular subgroups of students was investigated. Item response data on the reading comprehension section of a frequently used achievement test were obtained from the Anchor Test Study data files. Eight…

The usefulness of latent class modeling in addressing several measurement issues is demonstrated via a study of 74 good and 74 poor readers in grades 5 and 6. Procedures were particularly useful for assessing the hierarchical relation among skills and for exploring issues related to item domains. (SLD)

The design and development of a test of inference ability in reading comprehension for grades 6, 7, and 8 (the Phillips-Patterson Test of Inference Ability in Reading Comprehension) are described. After development of a contemporary theoretical framework for the test of inference ability in reading comprehension, the design, item development, and…