Because human beings are different and are necessarily subjective, and because evaluation always involves the human factor, many problems arise. The problems may be compounded in third world settings because they have been studied less, and are less understood, and because evaluators are often from outside the setting and therefore bring…

The most important distinction between evaluation (in the psychometric tradition), ethnography, and auditing is that they are guided by three distinctively separate principles. The underlying principle guiding evaluation is assessment. Ethnography is guided by description. Auditing uses description and assessment to establish an opinion on…

Argues that moral issues must be a central concern in the practice of evaluation rather than methodological issues and instrumental conceptions of knowledge. Criticizes the consequences of current liberal democratic beliefs on thinking about evaluation. (FMW)

This paper addresses the issues of molar versus molecular assessment of integration of people with disabilities, definitions of integration, and assessment in measuring integration. Measures for four integration components are presented: (1) physical integration, (2) social integration, (3) relationships, and (4) social networks. (Author/DB)

This paper reviews what has been learned about evaluation ultilization during the past 20 years. Evaluation utilization is discussed in terms of what is used, who uses evaluation, when evaluation is used, how evaluation is used, where evaluation is used, and why evaluation is used. It is suggested that the personal factor - the interests and…

This paper considers the measurement of person-centered planning with developmentally disabled individuals. It reports on the development of three instruments to assess person-centered planning and both a process and an outcome index. Psychometric evaluation indicated test-retest reliability and measures of internal consistency were adequate.…

The impact of various definitions of the term "policy" on the nature and outcomes of policy analysis is illustrated by noting a variety of definitions which are implied in the literature. These definitions are applied to exemplar policy arenas to note their differential effect. The policy arenas discussed include the community…

Procedures are proposed for increasing the accuracy of generalization assessment in applied behavior analysis with behavior problem populations by accounting for the degree of natural covariation between treated and untreated behaviors. (Author/DB)

The paper maintains that impact evaluation studies of programs serving handicapped infants and preschoolers should be restricted to scientifically defendable investigations. Specific types of impact studies and an evaluation process are suggested. It is suggested that program leaders should focus evaluation activities on the status of project…

The derivation of a general retrieval effectiveness measure is investigated. Inconsistencies in the definition of relative importance are resolved, and it is shown that the influence of the assigned weight on the effectiveness measure can produce counterintuitive results. An alternative effectiveness measure provided by the Marczewski-Steinhaus…

Discussion of speech sampling in the assessment of children with phonological disorders focuses on the use of nonlinear phonological analysis, a method whereby multiple aspects or levels of a child's phonological system are examined. Principles and suggestions offer general guidance for adequate sample elicitation. (Contains references.)…

This article briefly reviews the central ideas associated with the notion of systemic reform and indicates how these ideas are manifested in the draft of the National Science Education Standards. The draft is critiqued and what the critique suggests about the viability and utility of the notion of systemic reform is considered. The discussion…

The materials in this paper were drawn from an action caucus called to seek common criteria for the presentation and judging of oral interpretation and forensic tournaments. The first section of the paper consists of presentations made by participants. Topics covered in these presentations are (1) consistency in judging, (2) the role of oral…

Describes the Children's Television Workshop (CTW) production model, a general process model utilized in the production of "Sesame Street" and all other CTW productions. The model's assumptions are explicated and its effectiveness is assessed using Scriven's logic of evaluation. (MBR)

This paper reacts to testimony on early childhood special education research before the President's Commission on Excellence in Special Education (EC 632 080). It notes the real technical and practical difficulties of developing valid assessments and research on the effectiveness of interventions. It urges greater attention to identifying…