This report evaluates the degree to which the achievement level descriptions adopted by the National Assessment Governing Board (NAGB) for the 1992 National Assessment of Educational Progress (NAEP) assessment in mathematics accurately represent what students at a given achievement level can do. Three different analytical approaches were used in…

The possibilities and problems in the use of within-group slopes of outcomes on inputs as indicators of substantive educational group effects are considered. Slopes are proposed as outcome measures which may reflect within-group processes in between-group analyses of multilevel data. Research on aptitude x treatment interactions, contextual…

Three studies evaluating the validity of the descriptors and exemplars of the National Assessment of Educational Progress (NAEP) as characterizations of the actual mathematics performance of students at achievement levels are reported. Serious inconsistencies were found between actual performance and descriptors and exemplars. Recommendations for…

Means of interpreting norm-referenced tests to lead to more accurate reporting results are discussed, with particular emphasis on state-level and district-level data. Suggestions fall into the categories of documentation, frequency norming, and multiple form use. (TJH)

This is one of a series of reports based on an ongoing reality test of systemic evaluation for instructional decision making. This feasibility study is being carried out by the Center for the Study of Evaluation with the Laboratory in School and Community Relations at a suburban Los Angeles high school (called Site A). Viewing a school as a…

A conceptual synthesis is presented of the ways in which multilevel methods of data collection, analysis, interpretation and reporting can be used in instructional improvement activities in local school districts. This discussion of multilevel methods in school settings focuses on the "what" of information needs and usage. Principles and…

This paper contends that, apparently, the patterns of above-norm performance that J. Cannell (1987) reported exist, although the extremity of his "Lake Wobegon" effect is perhaps overstated. The use of outdated test norms and other practices has been identified as a partial explanation for the reporting of "above-average"…

The purpose of this article is to comment on practice in the use of existing data bases in program evaluation and school improvement and to explore directions for increased and improved use. (BW)

This is one of a series of reports based on an ongoing reality test of systemic evaluation for instructional decision making. This feasibility study is being carried out by the Center for the Study of Evaluation with the Laboratory in School and Community Relations at a suburban Los Angeles high school (called Site A). Viewing a school as a…