Over the past quarter-century, evaluation researchers have recognized the importance of documenting implementation practices of programs as they are transferred from controlled to real-world settings. As programs become widely disseminated in the general population, there is a tendency for practitioners to alter programs in a manner more conducive…

Evaluation of state advanced technology programs has begun in response to budget reviews. Issues include: (1) political and institutional contexts of evaluation; (2) technical issues concerning outcome specifications, use of process indicators, and dependence on self-reported assessments; and (3) use of evaluation in policy making. (TJH)

The Administrative Decision-Making Skills Project, undertaken for the New Zealand State Services Commission, is described. A philosophical model of decision making and the associated teaching/learning package for government officers is evaluated. The project, including instruments, methodology, and major findings, is evaluated. (Author/LMO)

An overview of the function of observation systems within the context of program evaluation is illustrated by summarizing observation systems used in evaluations of primary education, compensatory education, and Follow Through programs. (Author/CM)

Four steps to curriculum innovation are outlined: (1) identifying descriptive dimensions; (2) specifying practices implied by the innovation; (3) describing actual practices; and (4) comparing actual with intended practices across the critical dimensions of beliefs, objectives, instructional materials, and teaching strategies. (Author/CP)

Dilemmas inherent in the attempt to measure and evaluate informal supports available to individuals in need of social care are illustrated through a study of 400 elderly persons in Jerusalem. Practical guidelines for evaluation are presented. (SLD)

An ex ante benefit-cost analysis was conducted of applied tree improvement programs in the North Central Region from 1986 through the year 2030. Results for 24 tree species indicate that ex ante evaluation of the programs is difficult, but the intuition of professionals has built-in efficiency considerations. (TJH)

The problem associated with evaluating an econometric model using values outside those used in the model estimation is illustrated in the evaluations of a residential load management program during each of two successive years. Analysis reveals that attention must be paid to this problem. (Author/TJH)

Describes a program evaluation system in which the review of programs' definitions of success serve as indicators of stated goals and changes in programs. Review of definitions of success of eight programs suggests information that programs want to use in making decisions across the Philadelphia, Pennsylvania, delinquency prevention services. (SLD)

Program staff participated in evaluating two school improvement programs of Research for Better Schools, Inc. They used evaluation information primarily to identify technical assistance needs and to modify the program. Increased use has resulted from improved communication, staff perceptions of evaluation relevance and credibility, and staff…

Results of evaluation research studies, even those that are meticulously designed and carefully executed, often are not implemented. This article examines some of the critical factors that mediate between the carrying out of evaluation research and the utilization of findings. To illustrate these factors, two case studies are analyzed. (Author/EGS)

Utilizing social judgment theory, a method for eliciting opinions about the relative importance of multiple objectives, a model was developed to evaluate the performance of public agencies and programs. The model was then applied to the problem of establishing relative weights for six performance dimensions for a public agency. (Author/EGS)

Two evaluation studies using qualitative methods are described to illustrate the appropriateness of such methods for certain research questions. Ways to enhance reliability and validity are also discussed in the descriptions of the evaluations of 16 emergency medical services and 13 local health departments. (SLD)

Two studies were conducted to determine the stability of self-assessment of evaluation performance and use by 276 evaluators of community mental health centers over a 6-week period. The test-retest reliability of two instruments developed to assess internal evaluation was examined. The value of these instruments is discussed. (SLD)

A sample of 459 American Evaluation Association members was surveyed about ethical challenges they encountered in evaluation work. Respondents report a wide variety of ethical conflicts, with evaluators frequently pressured to compromise their roles as scientists and the evaluation product. A framework is proposed for interpreting these findings.…