Three approaches to validating competencies of vocational education programs in technical and professional schools are examined. Competencies are defined as behavior-oriented and relatively simple, observable behaviors which can be identified and measured by the frequency of occurrence. The three models, which have elements in common, are expert…

After surveying the nationwide trend toward reduction and re-evaluation of counselors, this report traces the development of a guidance program accountability evaluation process. The history, a basic definition and rationale of the program, and its goals are described. Various assessment tools, data evaluation and the resulting suggestions and…

The identification, validation, dissemination (IVD) process represents a quality control effort whose ultimate purpose is to validate and disseminate projects of proven educational quality and significance. The IVD and the Joint Dissemination Review Panel (JDRP) processes are complementary, although their procedures and criteria are distinct. JDRP…

Possible reasons for conducting evaluations of college and university courses are outlined, and the evaluation system developed at the Australian National University is described. Sources of information for teachers to use in making course improvements are suggested. (MSE)

This paper examines whether the peer-review process of the North Central Association (NCA) is reliable and valid. Reliance on peer judgments has been a part of NCA accreditation, but confidence in the use of peer decisions to certify a school's readiness to implement the improvement plan--Outcomes Accreditation (OA)--was weak. The study focused on…

The Developing Models for Special Education project utilized a novel evaluation design to produce data for national validation. The results of the evaluation are presented, and the problems and benefits associated with both the theoretical model and the further use of this design are discussed. (Author/GDC)

This paper discusses the practice of social validity assessment in applied behavior analysis, proposes elements that should be included in state-of-the art assessment procedures, offers a taxonomy of consumers to guide the construction and circulation of assessments, and suggests strategies to improve social validity assessment. (JDD)

Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix…

Although there are many reasons to evaluate training and development (T & D) programs, it is often time-consuming and expensive to do so. However, evaluations can be conducted by an auditing approach. The auditing approach to evaluating T & D offers three advantages. Auditing is quicker and less expensive than traditional methods, and it uses a…

The second of two related pamphlets, this guide describes how to design an outcome study and outlines procedures for collecting outcome data. After an introduction that delineates the purpose of the two-part series, the pamphlet is divided into four major sections. The first section explains how to select a cost-outcome analysis. The next three…

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

There is plentiful discussion about the importance of accountability, but much needs to be done to translate it into a manageable and credible system of ongoing feedback. In this book, evaluative inquiry is used in a way that balances attention between the investigation process and its purpose. The book is divided into three parts. Following an…

Due to the high stakes that my be attached to placement decisions, it is imperative that the placement process be as solid and defensible as possible. An integral part of the placement process is the identification and use of cut scores, the point(s) on the score scale that classify students into adjacent categories for placement decisions. This…

This paper argues that many social validity processes in applied behavior analysis are actually measuring consumer satisfaction and not the habilitative validity of goals, procedures, or outcomes. The term "habilitative validation" is proposed to replace social validity, and use of more objective assessment methods is encouraged.…

Three studies identifying the characteristics of program submittals approved by the Joint Dissemintion Review Panel were examined. Between 1978-1985, 358 demonstration programs were submitted. For each of these years, between 51 percent and 83 percent of the submittals were approved. In this study, the submittals were reviewed on the basis of the…