Reviews previous work in training observers for collecting observational counseling data. Outlines a nine-step Systematic Rater Training Model, which includes overview and contract, concept presentation, stimulation, modeling, passive discrimination, active discrimination, production, transfer of training to performance, and ongoing evaluation.…

Discusses components of a consumer feedback system and methods for the systematic collection of information. The system used by the "Teaching-Family Model" approach to residential treatment illustrates the successful implementation of feedback. (Author)

Provides a model for incorporating counseling evaluation concerns such as data on the counselor's instructional behaviors, client adherence to the counseling intervention and client change. Points out that much of the research on counselor effectiveness focuses on counselor characteristics rather than building the case that counseling services are…

Evaluators often utilize analysis of covariance (ANCOVA) techniques to compensate statistically for the lack of experimental control when assessing the effects of innovative programs implemented in naturalistic settings. In this paper design, analysis, and reporting considerations important to the application of ANCOVA-type techniques in…

The Judicial Evaluation Method (JEM) is useful for aiding decision-making bodies to formulate policies. Broad public participation in complex issues is provided by JEM. (The conceptualization, policy formulation stages, and participant roles are identified; and the model is applied in two case studies). (MH)

Relevant conceptual frameworks must guide data collection and analysis if data are to be useful to service program planners and administrators. Such frameworks are increasingly important in the systematic assessment of the total array of services in a planning region. This paper describes a two-dimensional classification matrix developed in…

The cross-levels hypothesis is presented as an explanation for program evaluation failures. It states that the usefulness of evaluation data as feedback for decision making varies inversely with the number of organizational levels between the action the data describe, and the decisions they are intended to influence. To be useful for decision…

Procedures are described to conduct summative evaluations of Talents Unlimited programs. It is assumed that school counselors, administrators, or personnel minimally trained in measurement and statistics are capable of conducting the evaluation, except for doing the statistical analysis. The procedures are composed of: establishing measurable…

The New Hampshire Vocational Program Evaluation System (VPES) is designed to: (1) provide program improvement information; (2) provide information on local program effectiveness to aid in designing improvements; and (3) aid in complying with 1976 federal vocational education legislation. The evaluation system is divided into two components:…

This report reviews 5 years of work involving the Parent Empowerment Project (PEP) and also examines the results of a study that was undertaken to plot the changes in school performance of at-risk children and youth that have occurred since their parents became involved with PEP. It includes: (1) a summary of the demographics and characteristics…

This report discusses results of a survey that examined the experiences of 3,212 ERASMUS (European Community Action Scheme for the Mobility of University Students) grant students studying in other Economic Community countries. The study's purpose was to obtain feedback for universities and their departments participating in activities to support…

A case study approach was used to evaluate the statewide reading improvement project in Louisiana called Special Plan Upgrading Reading (SPUR). SPUR emphasized a change agent approach by providing Technical Assistants and small stipends (approximately $5,000) to participating school districts. During the first two years of the evaluation,…

For the past 20-30 years, both Indonesia and Australia have placed considerable emphasis on reforming their systems of technical and vocational education and training (TVET). Indonesia has focused on expanding secondary-level TVET, whereas Australia has emphasized provision of postsecondary-level vocational education and training (VET). Two…