Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Three studies evaluating the validity of the descriptors and exemplars of the National Assessment of Educational Progress (NAEP) as characterizations of the actual mathematics performance of students at achievement levels are reported. Serious inconsistencies were found between actual performance and descriptors and exemplars. Recommendations for…

Reports on an ongoing evaluation of the Vermont portfolio assessment program. Indicates that the positive news about the instructional effects of the assessment program are in contrast with the empirical findings about the quality of the data the program has yielded. (SLD)

This paper discusses one of the arguments that has been advanced against the use of standardized college admissions tests: the notion that their use leads admissions officers to reject non-Asian minority students on the basis of small and insignificant differences in scores. In the aggregate, the disadvantage minority students face as a result of…

The use of achievement levels and anchor points in press reports of the 1990 National Assessment of Educational Progress mathematics assessment was studied. In a review of 41 articles, widespread oversimplification and frequent misinterpretations were found, sometimes stemming from standards-based reporting. Implications for future standards-based…

This paper investigates the adequacy of the National Assessment of Educational Progress (NAEP) for taking into account dissimilarities in students' family, school, and community contexts when reporting test score differences among population groups (i.e., racial and ethnic minorities). This question was addressed by comparing the NAEP to other…

Student test scores are increasingly used to judge the competence of the educational enterprise. Exaggeration of scores is the result of directing attention away from the individual student achievement to the average scores of schools, districts, and states. Implications and recommendations are discussed. (BJV)

The 1992-93 school year was the second year of the implementation of the Vermont assessment program. Evaluation of the 1991-92 year yielded mixed results, with some evidence that the assessment program was having a strong impact on instruction, but other indications that the reliability of the portfolio scoring in both writing and mathematics was…

This report reviews the accuracy and reasonableness of statements in the print media about student proficiency on the 1990 National Assessment of Educational Progress (NAEP) in mathematics. It explores the apparent effects of two reporting approaches, the anchor-point method used by the Educational Testing Service and the National Center for…

Studies of the mathematics assessments of the National Assessment of Educational Progress (NAEP) are summarized. One study found that omit rates for NAEP test items were higher for African Americans and Hispanics than for whites. The other found that descriptions and examples for the 1992 mathematics achievement levels were misleading. (SLD)

Since 1988 the Vermont Department of Education has been developing an innovative statewide performance assessment program. In 1990, the RAND Corporation began evaluating the Vermont assessment program, focusing specifically on the portfolio component of its assessment system. This report presents results from the evaluation in the 1992-93 school…