Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

Communities That Care (CTC) is a prevention system designed to reduce adolescent substance use and delinquency through the selection of effective preventive interventions tailored to a community's specific profile of risk and protection. A community-randomized trial of CTC, the Community Youth Development Study, is currently being conducted in 24…

Studied the analytic problems associated with a design in which one identifiable group is allocated to each treatment condition and members of these groups are measured to assess the intervention. Results from a simulation study underscore the analytic problems associated with these quasi-experimental or group-randomized designs. (SLD)

A problem for program evaluators involves a search for ways to maximize internal validity and inferential power of research designs while being able to assess long-term effects of social programs. A multimethodological research strategy combining a delayed control group true experiment with a multiple time series and switching replications design…

The authors demonstrate how exponential smoothing can play a role in the identification of the intervention component of an interrupted time-series design model that is analogous to the role that the sample autocorrelation and partial autocorrelation functions serve in the identification of the noise portion of such a model. (Author/BW)

Evaluation research on vocational counseling in substance dependency treatment should distinguish between the effects of counselors and counseling methods on clients' employment outcomes. Three experimental designs permit investigation of possible confounds between these types of effects: (a) nested designs (each counselor delivers one counseling…

Describes the conceptual design, research framework, evaluation components, and analytic strategies that are guiding the evaluation of a demonstration-research effort, the American Stop Smoking Intervention Study (ASSIST). The ASSIST evaluation is a unique analysis of the relationships among social context, public-health activity, tobacco use, and…

This article reviews factorial surveys and highlights their utility in designing intervention programs. It then describes two instances in which factorial surveys were used to develop HIV/AIDS-related interventions. It is concluded that factorial surveys have great potential for designing intervention programs. (SLD)

This article presents a synopsis of each of seven presentations given at a conference on design and analysis in community trial studies. Papers identify problems with community trials and discuss strengths and weaknesses associated with design and analysis strategies. Areas of consensus are summarized. (SLD)

Recommendations for feasible and rigorous evaluation design formulated by a 1991 conference on the evaluation of comprehensive community interventions are summarized and illustrated through the example of a program for drug risk reduction. Implications of a multisite design with matched pairs randomized into intervention and comparison conditions…

High intercommunity variation in adolescent smoking precluded detection of effects of mass media campaigns on initiation of cigarette smoking in a study with a final sample of 1,637 adolescent subjects. Implications for studies using the individual as unit of analysis and the community as unit of randomization are discussed. (SLD)