This report provides an overview of what was known about alternative assessment at the time that the article was written in 1991. Topics include beliefs about assessment reform, overview of alternative assessment including research knowledge, evidence of assessment impact, and critical features of alternative assessment. The author notes that in…

We conducted generalizability studies to examine the extent to which ratings of language arts performance assignments, administered in a large, diverse, urban district to students in second through ninth grades, result in reliable and precise estimates of true student performance. The results highlight three important points when considering the…

The intent of formative evaluation is to improve programs as well as to justify their continuation. It is critical to separate clearly those functions of the evaluation which are political from those which may lead the way to instructional improvement. Data for formative evaluation should be gathered in an interpretable way at the level at which…

Discusses some of the challenges of technology-based training and education, the role of quality verification and evaluation, and strategies to integrate evaluation into the everyday design of technology-based systems for education and training. (SLD)

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

This paper examines multiple measures of performance in school accountability systems from two perspectives: laterally (different indicators of different domains) and vertically (indicators that are at different levels of depth of the same domain). From these perspectives, organizational responsibility and instructional sensitivity are examined.…

This report summarizes the work conducted for the Artificial Intelligence Measurement System (AIMS) Project which was undertaken as an exploration of methodology to consider how the effects of artificial intelligence systems could be compared to human performance. The research covered four areas of inquiry: (1) natural language processing and…

This chapter discusses current methods of formative evaluation and suggests that these methods themselves need to be subjected to more critical research and evaluation in order to provide them with a more scientific base. Topics addressed include problems and methods associated with data gathering, evaluation designs, number of subjects available,…

This article investigated the design of appropriate measures to assess the outcomes of schooling. (Author/RK)

Attempts to understand educational quality have created an ever-increasing set of measures and approaches. Issues regarding assessment of student learning, teacher effectiveness, and school effectiveness are discussed. (MT)

This chapter addresses the problems encountered in the formative evaluation of instructional development projects and the instructional development process. Three types of formative evaluation--component, convergent, and contextual--are distinguished, and the consequences of using the wrong type of evaluation in a particular situation or project…

The progress of students and schools in California is examined by reviewing the state's recent test history and the state's progress in creating a sound, standards-based assessment system. The story about California is mixed. Overall performance on the Stanford Achievement Test, ninth edition (SAT-9) shows that the state average, overall grades…

This focus of this newsletter asserts that if one accepts that accountability systems are intended to serve both symbolic and technical functions, one can ask how well they are operating symbolically to motivate action and how well they are doing in providing adequate technical information to support intended inferences. In this column, it is…

Following up on an earlier issue of "The Curriculum Journal" (Vol. 16, No. 1), this article focuses on learning outcomes in the context of video games. Learning outcomes are viewed from two theoretical frameworks: Kirkpatrick's levels of evaluation and the CRESST model of learning. These are used to analyse the outcomes claimed in journal articles…