Test-based educational accountability systems have considerable appeal to politicians, policymakers, and the general public. Such systems have been widely used by states for more than a decade and with the enactment of the No Child Left Behind Act of 2001 all states must now implement an accountability system that uses results from assessments in…

Given multiple independent measures of an underlying true factor and information on group membership, it is possible to compute a set of observed group means for each measure. Given at least three tests, these sets of means may be used to compute the reliability of the means for each test. The procedure for estimating true scores from the…

The validity of interpretations of National Assessment of Educational Progress (NAEP) achievement levels is evaluated by focusing on evidence regarding three types of discrepancies: (1) between standards; (2) among descriptions of achievement levels; and (3) between assessments and content standards. All of these discrepancies raise serious…

Current discussions of the effects of test administration conditions (i.e., testing stakes) and the motivational levels associated with them on achievement test performance are reviewed. Results of a nonexperimental study suggest that, in contrast to a moderate-stakes testing environment, the National Assessment of Educational Progress does not…

The following ways of linking results from distinct assessments to use them for multiple purposes are reviewed: (1) equating; (2) calibration; (3) statistical moderation; (4) prediction; and (5) social moderation. The characteristics of these methods, their requirements, and the comparative inferences they support are described. (SLD)

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

The purpose of this investigation was to examine the interaction of item content and group membership on achievement test items. Estimates of the parameters of the three parameter logistic model were obtained on the 46 item math test for the sample of eighth grade students (N = 2055) participating in the Illinois Inventory of Educational Progress,…

Several issues related to the design and reporting of results from the National Assessment of Educational Progress (NAEP) are discussed in the context of current expectations for the NAEP and its origins. These issues include: (1) content coverage and format; (2) estimation procedures; and (3) reporting problems. (SLD)

The adequacy of linking statewide standardized test results to the National Assessment of Educational Progress by using equipercentile equating procedures was investigated using statewide mathematics data from four states. Results suggest that the linkings are not sufficiently trustworthy to make comparisons based on the tails of the distribution.…

Recently, several states have expressed interest in linking their statewide assessments to the National Assessment of Educational Progress (NAEP) in the hope that, through equating, they can be compared to national results. This study considers the degree to which existing statewide assessments may be linked to NAEP, without violating the basic…

Currently in the United States there is considerable interest in developing a system of examinations that is substantially different from the large-scale testing programs presently in use in this country. These new exams would involve a different form of assessment than current tests and would also enable greater local control over the…

Although the use of test results to demonstrate educational shortcomings is important, tests and assessments are also expected to be an instrument of reform. In fact, they are often expected to provide the primary means of creating educational reform. The minimum competency testing movement and the expansion of the use of test results for…

Results of a 1987 report--indicating that elementary students of all 50 states were above the national average--were assessed via 2 national mail and telephone surveys. Although results of data for 35 states support the general findings of the 1987 report, it appears that more specific results are less sensational. (TJH)

The New Standards Project is a joint effort of the Learning Research and Development Center (LRDC) at the University of Pittsburgh (Pennsylvania) and the National Center on Education and the Economy toward creation of a national examination system based on performance assessments. This study explored the feasibility of comparing performance on…