We address two persistent challenges in large-scale assessments of the Next Generation Science Standards: (a) the validity of score interpretations that target the standards broadly and (b) how to structure claims for assessments of this complex domain. The NGSS pose a particular challenge for specifying claims about students that evidence from…

As researchers at a testing organization concerned with the appropriate uses and validity evidence for our assessments, we provide an applied perspective related to the issues raised in the focus article. Newton's proposal for elaborating the consensus definition of validity is offered with the intention to reduce the risks of inadequate…

The U.S. Department of Education released regulations governing the development of alternate assessments for students with persistent learning problems who are eligible for Modified Academic Achievement Standards (MAAS) in 2007. To date, state regular assessments or alternate assessments based on Alternate Academic Achievement Standards have not…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

This paper reports the results of a survey conducted in the spring of l981 that was designed to collect and summarize guidelines on appropriate test use from the various organizations, agencies, and associations involved in standardized educational testing. The primary objective of the study was to learn how these various groups define the issues…

The Des Moines (Iowa) Public Schools continually evaluate the process of teaching for learning in order to provide quality programming for its diverse student body. Different methods of student outcome assessment are used to identify areas for study and analysis. This report provides information about the achievement of district students on: (1)…

Many states have implemented high-stakes testing since the enactment of the No Child Left Behind Act of 2001. Yet the question remains whether high-stakes tests effectively measure student proficiency. This report describes a study that compared results on high-stakes tests with results on other standardized tests not used for accountability…

Considerable evidence suggests that policy-makers, educators, the media, and the public do not understand national and state test results. The problems appear to be two-fold: the scales on which scores are reported seem confusing, and the report forms themselves are often too complex for the intended audiences. This paper addresses two topics. The…

This annual report combines the November, January, April, June, and August provincial results in diploma examination courses in the Alberta (Canada) schools. The graphs, tables, and text describe student performance for the entire school year. The report is designed to assist school personnel in identifying patterns of students' achievement in the…

The purpose of this paper is (1) to discuss a set of standards that can be used to evaluate potential assessment instruments; and (2) to use these standards to evaluate the American College Testing Program's College Outcomes Measures Program (ACT-COMP) and the Educational Testing Service (ETS) Academic Profile. Using the work of S. Messick (1975,…

The development of national minimum educational standards for the Federated States of Micronesia (FSM) began in 1988 with the deliberations of a national task force that created performance expectations in a number of subjects. In 1988 the development of nationally standardized tests reflecting these standards began. This document presents the…

The program design and psychometric characteristics of the Maryland School Performance Assessment Program (MSPAP) are described, focusing on scaling, equating, standard setting, score accuracy, and validity. The MSPAP is an innovative performance-based testing program administered annually to students in grades three, five, and eight. (SLD)

The College-Level Academic Skills Test (CLAST) is an examination of achievement in communication skills and mathematics that is mandated by state law for college students in community colleges and state universities in Florida as a requirement for an Associate's degree or for entry into upper-level courses. Higher CLAST standards went into effect…

The College-Level Academic Skills Test (CLAST) is a mandated examination of the achievement of college students in communications skills and mathematics that must be passed by students in Florida public institutions of higher education to receive an Associate's degree or entrance into upper-level courses. This report gives test results on the…