Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

The goal of this study was to gather comprehensive evidence about the alignment of the Smarter Balanced summative assessments to the Common Core State Standards (CCSS). Alignment of the Smarter Balanced summative assessments to the CCSS is a critical piece of evidence regarding the validity of inferences students, teachers and policy makers can…

ACT reporting categories and ACT Readiness Ranges are new features added to the ACT score reports starting in fall 2016. For each reporting category, the number correct score, the maximum points possible, the percent correct, and the ACT Readiness Range, along with an indicator of whether the reporting category score falls within the Readiness…

Background: In 2011 the Progress in International Reading Literacy Study (PIRLS) and the Trends in International Mathematics and Science Study (TIMSS) were conducted at fourth grade in a number of participating countries with a shared representative sample. In this article we investigate whether there are multidimensional proficiency patterns…

Content balancing is one of the most important components in the computerized adaptive testing (CAT) especially in the K to 12 large scale tests that complex constraint structure is required to cover a broad spectrum of content. The purpose of this study is to compare the weighted penalty model (WPM) and the weighted deviation method (WDM) under…

Linguistic complexity of test items is one test format element that has been studied in the context of struggling readers and their participation in paper-and-pencil tests. The present article presents findings from an exploratory study on the potential relationship between linguistic complexity and test performance for deaf readers. A total of 64…

In operational testing programs using item response theory (IRT), item parameter invariance is threatened when an item appears in a different location on the live test than it did when it was field tested. This study utilizes data from a large state's assessments to model change in Rasch item difficulty (RID) as a function of item position change,…

For several decades, the Iowa Tests of Basic Skills (ITBS) held the preeminent role in measuring student and school performance in the Chicago Public Schools (CPS), Illinois. In the context of the No Child Left Behind act and new calls for accountability, the CPS has decided to include results from the Illinois Standard Achievement Test (ISAT) in…

At the heart of the No Child Left Behind Act (NCLB) is the call for all students to be "proficient" in reading and mathematics by 2014. Yet the law expects each state to define proficiency as it sees fit and design its own tests. This study investigated three research questions related to this policy: (1) How consistent are various…

The Massachusetts Educational Assessment Program (MEAP) is designed to improve curriculum and instruction in the public schools. The MEAP tests all students in grades 4, 8, and 12 in major curriculum areas biennially. The test is not designed to yield scores for individual students. This document describes the content of the assessment instruments…

The results of this study conclude that there is a multidimensional basis for test score inferences on the mathematics and critical reading sections of the SAT. Results from the exploratory analyses indicate that the data are multidimensional, as mathematics displayed two dimensions and critical reading displayed three dimensions. The correlations…

Changes to the Scholastic Aptitude Test (SAT) that will be introduced in the 1993-94 academic year are reviewed, with attention to edumetric factors such as relationship of curriculum and instructional practice to test design and the impact of the changes. The new SAT will put increased emphasis on critical reading skills to reflect developments…

This handbook contains information for high school educators--teachers, curriculum coordinators, counselors, and principals--as they prepare students to take the Prairie State Achievement Examination (PSAE). The first section explains the purpose of the PSAE, gives timelines and test-day schedules, and shows how the PSAE is constructed. The rest…