Testing programs are often classified as high or low stakes to indicate how stringently they need to be evaluated. However, in practice, this classification falls short. A high-stakes label is taken to imply that all indicators of measurement quality must meet high standards; whereas a low-stakes label is taken to imply the opposite. This approach…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

Over the past few decades, those who take tests in the United States have exhibited increasing diversity with respect to native language. Standard psychometric procedures for ensuring item and test fairness that have existed for some time were developed when test-taking groups were predominantly native English speakers. A better understanding of…

In this study, differential item functioning (DIF) methods utilizing 14 different matching variables were applied to assess DIF in the constructed-response (CR) items from 6 forms of 3 mixed-format tests. Results suggested that the methods might produce distinct patterns of DIF results for different tests and testing programs, in that the DIF…

As an alternative to adaptation, tests may also be developed simultaneously in multiple languages. Although the items on such tests could vary substantially, scores from these tests may be used to make the same types of decisions about different groups of examinees. The ability to make such decisions is contingent upon setting performance…

The purpose of this study was to determine how elementary school administrators in a large U.S. state perceived the overall effects of testing on education in general and, more specifically, on their instructional leadership responsibilities. We surveyed 325 Florida principals and assistant principals, many of whom viewed the testing program…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This article discusses the positive and negative consequences of large-scale testing on five key stakeholders of testing results: students, teachers, administrators, policymakers and parents. The factors that affect the nature of testing consequences are also discussed and means that may provide remedies for associated pitfalls are proposed.

How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

Linking scores from the National Assessment of Educational Progress (NAEP) to statewide test results was studied. Results based on an equipercentile procedure suggest that such a link does not provide precise information. Information from a linking study should be limited to rough estimates of students in each NAEP achievement level. (SLD)

Studied 18 states with high-stakes testing to see if their programs were affecting student learning, analyzing results from additional tests covering some of the same domain as each state's own test. Findings suggest that in all but one case, student learning is indeterminate, remains at the same level, or actually decreases with the…

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

Describes New Jersey's coordinated, statewide higher education effort involving mandatory testing, remediation, and evaluation. Reviews the program's history; the role of the New Jersey Basic Skills Council (NJBSC); the Basic Skills Placement Test, which focuses on reading comprehension, sentence sense, math computation, and elementary algebra;…

Inquiry and lecture/lab methods of instruction yield different results in conceptual and problem-solving tests, while no difference exists in factual tests. The author recommends that the inquiry method of teaching be refined so that it can become a practical classroom instructional strategy. (CT)