Many initiatives have emphasized the importance of challenging students in text using readability formulas. Almost all formulas employ mean word frequency yet long-standing issues abound. Researchers question using a singular mean with a skewed variable like frequency. They also question the degree to which frequency pinpoints complex words,…

The purpose of this longitudinal study was to critically evaluate the updated Turkish reading curricula to determine whether they enable teachers to design instructional sequences that are highly cognitively demanding. This study was designed as a qualitative inquiry using document analysis to estimate the pedagogically oriented intellectual…

Four-parameter models have received increasing psychometric attention in recent years, as a reduced upper asymptote for item characteristic curves can be appealing for measurement applications such as adaptive testing and person-fit assessment. However, applications can be challenging due to the large number of parameters in the model. In this…

The aim of this study is to better understand the notion of early algebraic thinking by describing differences in grade 4-7 students' thinking about basic algebraic concepts. To achieve this goal, one test that involved generalized arithmetic, functional thinking, and modeling tasks, was administered to 684 students from these grades. Quantitative…

This study presents estimates of Black-White, Hispanic-White, and income achievement gaps using data from two different types of reading and mathematics assessments: constructed-response assessments that were likely more cognitively demanding and state achievement tests that were likely less cognitively demanding (i.e., composed solely or largely…

What does "rigor," a word that frequently pops up in conversations about education, really mean? More specifically, what does it mean for "literacy" instruction, and how does it relate to challenging standards-based assessments? In this informative and practical guide, literacy expert Nancy Boyles uses the framework from Webb's…

The authors explored the effects of drifting common items on vertical scaling within the higher order framework of item parameter drift (IPD). The results showed that if IPD occurred between a pair of test levels, the scaling performance started to deviate from the ideal state, as indicated by bias of scaling. When there were two items drifting…

The present study was conducted first to identify which school subjects were most liked, most important, and most difficult, as well as least liked, least important and easiest as perceived by elementary school students and second to explore the reasons why students most/least liked, considered as most/least important, and considered as most…

This study examined the validity of test accommodation in third-eighth graders using differential item functioning (DIF) and mixture IRT models. Two data sets were used for these analyses. With the first data set (N = 51,591) we examined whether item type (i.e., story, explanation, straightforward) or item features were associated with item…

The purpose of the present study is to examine the language characteristics of a few states' large-scale assessments of mathematics and science and investigate whether the language demands of the items are associated with the degree of differential item functioning (DIF) for English language learner (ELL) students. A total of 542 items from 11…

In this study, we describe the development of rapid reading measures, sentences presented to students in a nearly subliminal manner, with a literal comprehension question asked following their removal. After administering alternate forms of these measures to students, we present the results from three statistical analyses to ascertain their…

The purpose of this study was to develop and gather validity evidence for silent reading fluency passages. A number of passages were written following a traditional story grammar structure (character, setting, events) and placed on a computer for students to read silently. We describe in detail, the manner in which content-related evidence was…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

The impact of language characteristics in mathematics test items on student performance was evaluated for students with disabilities (SWD) and English language learners (ELL) as well as a large general student sample. Relationships were examined for test items and students at 4th, 7th, and 10th grades. The individual test item was the unit of…

Fourth, seventh, and ninth grade students in Elementary Secondary Education Act (ESEA) Title I programs were tested with the reading comprehension subtests of the Comprehensive Tests of Basic Skills, at each of two levels: on-level for each respective grade, and an easier out-of-level form. Approximately half of these students were found to be…