Productive dialogue is informed best by multiple and diverse voices. Five seasoned evaluators, representing a range of evaluation perspectives, offer their views in two- to three-page discussant contributions. These individuals were asked to reflect and comment on the previous chapters in the spirit of critical review as a key source of evidence…

2011 is the 25th anniversary of the American Evaluation Association. Such occasions are often recognized both by looking back to assess and celebrate accomplishments of the past and by looking ahead to anticipate the problems and potential of the future. In the past 25 years, the profession of evaluation has experienced rapid, ubiquitous growth,…

Evaluation as a discipline requires knowledge based on: empirical evidence; public verification; and usefulness in various settings and contexts. Activities which aid in accumulating this knowledge include: compliance with federal requirements; critiques and secondary data analyses; impact and use studies; comparative field studies; and…

An evaluation design is seen to ensure the presence of certain qualities in an evaluation; values and valued qualities permeate the evaluation design. Mechanisms for evaluations (in-process reviews, follow-up studies, etc.) are dealt with and familiarity with financial, managerial, and ethical procedures are stressed in the evaluation design. (CE)

New perspectives on evaluation methodology have been drawn from other disciplines such as law, casework and journalism. Empirical and conceptual tests to assess the practical utility of alternative perspectives of the evaluation process, and criteria for judging their adequacy are addressed. (Author/AEF)

Weiss' and Patton's competing views concerning the influence of program evaluation on decision-making are critiqued. Patton's approach provides an essential mechanism for achieving desired ends, once they are determined. Weiss' approach supplements that contribution by including not only expert development of means, but also expert selection of…

Rutman's view of evaluability assessment is reviewed, evaluation planning activities are illustrated via flow diagram for a large educational evaluation designed to increase citizen participation in local school activities, and some of the limitations of Rutman's evaluability procedures are outlined. (RL)

Literature on the generalizability of program effects focuses on the a priori development of evaluation designs which enable certain generalizations to be made. Secondary analysis procedures which can be employed using existing evaluation data to estimate a program's generalizability when follow-up field studies are not feasible are suggested.…

Written in response to George Fairweather's position concerning the use of experimental studies in evaluation, this paper highlights considerations in deciding when experimental procedures are feasible. The current debate on the use of experimental methods in evaluation is reviewed. (Author/GK)

The extent to which the Joint Committee "Standards" for evaluation might be used to develop culturally relevant standards for use in other countries and how they might be modified for use in cross-cultural settings were explored using Malta and India as examples. Substantial modifications are probably necessary. (SLD)

The basic functions and procedures of management consulting are contrasted with formal program evaluation. A case example illustrates the differing approaches used in programmatic problem solving. The similarities and differences between these specializations are highlighted to understand their unique but complementary contributions to the…

Political groups, social movements, and organizational influences are sources of values which influence an evaluation study. Value positions can help define and delineate an evaluation problem but, if the values influencing the results are not explicit, the evaluative research may be viewed as something other than it actually is. (BW)

This synthesis of six commissioned papers on state education agency evaluation practices describes the sources of influence or factors affecting the context of their evaluation practices. Evaluation is viewed as testing, management, and policy formation conducted within a highly complex social setting. (PN)