Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Mandated testing is not working as advertised. Too much classroom time and energy is being spent on tests that do little to measure or instill in our students the skills and knowledge needed for their later life. Corruption and political manipulation of the testing process and test results further add to questions about the use of such testing.…

This paper discusses whether music educators should push for national testing of music students. The National Assessment of Educational Progress (NAEP) did test music students in 1997. Even though the results of that test did not indicate students were very accomplished, there was a general feeling that at least NAEP and the nation recognized…

Most states do not offer reciprocity for other state assessment tests. That practice has an adverse effect on school-aged, dependent children of military service members. President Clinton's 1997 solution was a national standardized assessment test for public school students. Critics stated it would cost $96,000,000 to deliver the test. Florida…

This paper discusses approaches to raising student test scores. At present, 49 of 50 states mandate tests for students in selected grades, and each school district is under pressure to have students score at a higher level than they did before. Teaching students to do better on tests is a frequent approach. It has some advantages, but also has the…

In situations where there are enormous pressures to produce "good" test results, standardized testing can be a very painful experience, but there are ways of using test data to help in the educational process. California assessment data are disseminated widely to school districts in meaningful diagnostic displays. (Author/CM)

It has been proposed that the National Assessment of Educational Progress (NAEP) increase its efforts to gather and analyze data on student background, teachers, households, and schools. Adoption of this proposal would result in the inclusion in NAEP of additional background variables and subpopulations, to be defined by states. NAEP specification…

This paper makes the case that the high-stakes testing and accountability program currently in place in Massachusetts misuses scores from the Massachusetts Comprehensive Assessment System (MCAS) to select particular schools as exemplary. School awards and recognition programs in Massachusetts imply that score gains are equivalent to school…

This document consists of 14 articles which appeared in the electronic news bulletin, "EducationNews.org," and which were part of a series on "Test Bashing," a discussion of the use of standardized tests that focuses on controversies surrounding the Texas Assessment of Academic Skills and test score improvements in Texas. The…

The potential use of criterion referenced tests (CRT) and norm referenced tests (NRT) in the same testing program is discussed. The advantages and disadvantages of each are listed, and the best solution, a merging, is proposed. To merge CRTs and NRTs into an overall testing program, meaningful and useful to all levels, consideration must be given…

Four topics related to mathematics testing for the National Assessment of Educational Progress (NAEP) are discussed: (1) mathematics achievement; (2) past NAEP approaches; (3) needed changes; and (4) a new conceptual basis for profiling mathematical performance, including recommendations for strengthening current practice. The basic strategy for…

Five years of state test results for Pennsylvania are examined, focusing on differences among elementary schools in which a majority of students do not master basic learning skills. Data are provided for 1,505 elementary schools in about 500 districts. The largest learning problems occur in about 10% of the schools; these schools have been…

This paper contends that, apparently, the patterns of above-norm performance that J. Cannell (1987) reported exist, although the extremity of his "Lake Wobegon" effect is perhaps overstated. The use of outdated test norms and other practices has been identified as a partial explanation for the reporting of "above-average"…