This chapter addresses the problems encountered in the formative evaluation of instructional development projects and the instructional development process. Three types of formative evaluation--component, convergent, and contextual--are distinguished, and the consequences of using the wrong type of evaluation in a particular situation or project…

The goal of technology assessment is to provide a larger view of the utility and potential impact of a class of technology for a set of potential uses. In this paper, the concentration is on technology for training. Some examples are given of technology assessments conducted on behalf of the public by national agencies. This view of technology…

In the early 1970s educational evaluation's fusion of respect for rationality, power to implement rational procedure, and an altruistic objective (improved instruction) appealed to educational researchers. Dealing essentially with closed systems, it measured program success by student performance on measurement instruments. Critics exclaimed that…

It is difficult to base evaluations on concepts irrelevant to state policy making. Evaluation of a multiproject program requires both time and differentiation of method. Data from the California Early Childhood Program illustrate process variables for program component analysis, and research questions for intraprogram comparison. (CP)

This document presents standards for educational accountability systems that represent models of practice derived from three perspectives: research knowledge, practical experience, and ethical considerations. These standards should be conceived of as targets for state and local systems and as criteria to judge proposed models of accountability…

Some special problems associated with evaluating intelligent computer-assisted instruction (ICAI) programs are addressed. This paper intends to describe alternative approaches to the assessment and improvement of such applications and to provide examples of efforts undertaken and shortfalls. Issues discussed stem chiefly from the technical demands…

Does educational technology work? Does its application in classrooms help children learn? Can teachers improve their own understanding and practice through technology? The answer is yes; however in a period of widespread concern about educational quality, teachers, parents, policymakers, and taxpayers deserve answers that go beyond fervent beliefs…

The Apple Classroom of Tomorrow (ACOT) program was designed to study what happens when "tomorrow's" educational resources, such as individual computer support, are available in the classroom. Student achievement and attitudes were evaluated at five elementary school and secondary school sites located in four states and encompassing…

A plan for evaluating the Apple Classroom of Tomorrow (ACOT) is presented, which implements the model for Sensible Technology Assessment/Research (STAR). STAR involves interactive participation in the evaluation study by ACOT participants, collateral university researchers, and University of California (Los Angeles) staff to develop a credible,…