Two case studies are presented to compare and contrast the challenges encountered when attempting to conduct participatory evaluations (P-Es) with tribal programs that represented two extremes of collaboration between the programs and evaluators. In one case, the P-E was successful because the principals were invested in the program, whereas in…

This article concerns recommendations made in a report to Congress and the Department of Education on evaluation of federally supported education programs. The work covers local, state, and federal efforts to address questions about why and how well evaluations are done, and about how results are used. The recommendations are directed toward…

Recommendations are made to Congress and the Department of Education on evaluation of federally supported education programs. The work covers local, state, and federal efforts to address questions about evaluation procedures and practices, and the use of evaluation results. The recommendations are directed toward improving the quality and…

This article focuses on the management of federally funded evaluation research by (1) discussing aspects of building an in-house evaluation team; (2) defining possible contractor/client relationships, and (3) considering contractor/practitioner team rapport. (Author/GK)

Results of evaluation research studies, even those that are meticulously designed and carefully executed, often are not implemented. This article examines some of the critical factors that mediate between the carrying out of evaluation research and the utilization of findings. To illustrate these factors, two case studies are analyzed. (Author/EGS)

This article considers the advantages and disadvantages of having evaluation users increase the specificity of evaluation requirements through a review of legislative requirements behind several congressionally mandated national-level evaluations, and an in-depth examination of one congressionally mandated evaluation in which very specific design…

Estimates are presented for net earnings impact of the Comprehensive Employment and Training Act programs. Net impact was linked to the human capital model and estimated for numerous subgroups. The matching procedure and the use of quasiexperimental versus experimental design are also discussed. (Author/GDC)

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

Two studies used experimental data to evaluate nonexperimental methods of program evaluation for employment and training programs. Results of both studies indicated that the nonexperimental methods might not accurately replicate the experimental estimates. Also, new methods for constructing comparison groups yielded little improvement over…

An evaluation system was designed which directly addresses federal legislation for accountability in vocational education programs. Six criteria were included; three focus on interim evidence of project success, and three address final evidence of project effectiveness. (Author/GK)

The collaborative effort between university researchers and a CETA sponsor aimed at "knowledge development" in employment and training services for disadvantaged out-of-school youth is described. Discussion is included concerning the feasibility of experimental evaluation for youth employment programs in a local setting. (Author/GK)

The problem of measuring impacts of employment and training programs when workers not receiving services are affected by the program is explored, using a reemployment bonus program as an example. The conventional measures of bonus impacts may significantly overestimate the net impact of the bonus offer. (SLD)

The use of peer review for federal research impact evaluation is described. Advanced review processes can improve the efficiency of a review, but the most important factors in a quality review are leader motivation and the competence and independence of review team members. No single method provides complete impact evaluation. (SLD)

In 1980, five federal special education longitudinal qualitative impact evaluations were all prematurely terminated. What happened, why it happened, and what salvage decisions were made are examined in this article. The impact of these decisions on the design of RFPs and future evaluation plans are also discussed. (Author/EGS)

Net impact estimates of Comprehensive Employment and Training Act (CETA) programs vary widely and can be explained by the different evaluation methodologies used. Estimates are sensitive to the inclusion of recently unemployed persons in the comparison sample and assumptions about the time of decision to enroll in CETA. (GDC)