Many inquiries regarding the causal effects of policies or programs are based on research designs where the treatment assignment process is unknown, and thus valid inferences depend on tenuous assumptions about the assignment mechanism. This article draws attention to the importance of understanding the assignment mechanism in policy and program…

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had…

A methodology for developing clinical/research assessment tools, training interviewers, and continuously assessing interrater reliability is discussed. Data from a multisite national evaluation of long-term health care programs (i.e., the Social/Health Maintenance Organization (HMO) for elderly clients) are used. Focus is on providing research…

Not all data for a program evaluation may be equally valuable, and costs of collection may vary when using several methods to obtain data from several sources. An approach to maximize information yield for a fixed, limited budget using a mathematical technique known as linear programming is described and generalized. (Author/CM)

The linked judgments approach is offered as a potential solution to problems of statistical conclusion validity when judges' ratings are employed in pretest-posttest designs. (Author/GK)

Using data from the evaluation of the Fast Track intervention, this article illustrates three methods for handling attrition. Multiple imputation and ignorable maximum likelihood estimation produce estimates that are similar to those based on listwise-deleted data. A panel selection model that allows for selective dropout reveals that highly…

Challenges of collecting and using photographic evidence and photo-interviewing to evaluate technology infusion programs in higher education are discussed. A five-phase study for using photo-interviewing is presented, using evaluation of a hypermedia workshop attended by 1 instructor, 1 graduate assistant, 26 graduate students, and 1 art…

A methodology is presented for collection of cost data in evaluation of community-level health interventions that coincides with the intervention implementation. The seven discrete steps of the analysis are described, and the Minimal Contact Education for Cholesterol Change study is used as an example of how the strategy is used. (SLD)

This article presents a discussion of field utilization of staff development activities in the context of three separate training programs. Specifically, classroom implementation of knowledge and skills gained by participants in their training sessions was assessed via the Levels of Use (LoU) interview system. (Author/LMO)

Meta-analysis of Title I program evaluations shows the norm-referenced model overestimates positive effectiveness; while the regression-discontinuity design underestimates it. Potential biases include residual regression artifacts, attrition and time-of-testing problems in the norm-referenced design, and assignment, measurement, and data…

Trends in European practice that relate to qualitative assessment in the evaluation of the impact of research and innovation are discussed and analyzed. To date, European evaluations have been mainly concerned with quality and direct impact with few assessments of medium- or long-term impact. (SLD)

Over the past quarter-century, evaluation researchers have recognized the importance of documenting implementation practices of programs as they are transferred from controlled to real-world settings. As programs become widely disseminated in the general population, there is a tendency for practitioners to alter programs in a manner more conducive…