Complex survey data are collected by means other than simple random samples. This creates two analytical issues: nonindependence and unequal selection probability. Failing to address these issues results in underestimated standard errors and biased parameter estimates. Using data from the nationally representative Head Start Family and Child…

The study dealt with a research environment in which the treatment effect is heterogeneous, and in which individuals use their assessments of the treatment effect to decide whether or not to enroll in an intervention program. In this article, a new methodology is proposed for examining the validity of the specified research environment in a given…

National Heritage Areas (NHAs) are an alternative and increasingly popular form of protected area management in the United States. NHAs seek to integrate environmental objectives with community and economic objectives at regional or landscape scales. NHA designations have increased rapidly in the last 20 years, generating a substantial need for…

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had…

Growing interest in the institutionalization of evaluation in the public administration raises the question as to which institutional arrangement offers optimal conditions for the utilization of evaluations. "Institutional arrangement" denotes the formal organization of processes and competencies, together with procedural rules, that are…

Background: Injury is the leading cause of death for persons aged 1-44 years in the United States. Injuries have a substantial economic cost. For that reason, regional systems of trauma care in which the more acutely injured patients are transported to Level-I (L-I) trauma centers (TCs) has been widely advocated. However, the cost of TC care is…

Although experiments are viewed as the gold standard for evaluation, some of their benefits may be lost when, as is common, outcomes are not defined for some sample members. In evaluations of marriage interventions, for example, a key outcome--relationship quality--is undefined when a couple splits up. This article shows how treatment-control…

Sustained mass media campaigns have been recommended to stem the tobacco epidemic in the United States. Propensity score matching (PSM) was used to estimate the effect of awareness of a national smoking cessation media campaign (EX[R]) on quit attempts and cessation-related cognition. Participants were 4,067 smokers and recent quitters aged 18-49…

Recent meta-analyses of drug-court studies recognized the poor methodological quality of the evaluations, with only a few being randomized. This article critiques the design of the randomized studies from a statistical perspective. Learning points are identified for future drug-court studies and are applicable to evaluations both of other…

The determinants of sentencing are of much interest in criminal justice and legal research. Understanding the determinants of sentencing decisions is important for ensuring transparent, consistent, and justifiable sentencing practice that adheres to the goals of sentencing, such as the punishment, rehabilitation, deterrence, and incapacitation of…

Background: Surveys of community-based programs are difficult to conduct when there is virtually no information about the number or locations of the programs of interest. This article describes the methodology used by the Helping Young Smokers Quit (HYSQ) initiative to identify and profile community-based youth smoking cessation programs in the…

Two case studies are presented to compare and contrast the challenges encountered when attempting to conduct participatory evaluations (P-Es) with tribal programs that represented two extremes of collaboration between the programs and evaluators. In one case, the P-E was successful because the principals were invested in the program, whereas in…

The authors examined whether paper-and-pencil and Web surveys administered in the school setting yield equivalent risk behavior prevalence estimates. Data were from a methods study conducted by the Centers for Disease Control and Prevention (CDC) in spring 2008. Intact classes of 9th- or 10th-grade students were assigned randomly to complete a…

In social policy evaluations, the multiple testing problem occurs due to the many hypothesis tests that are typically conducted across multiple outcomes and subgroups, which can lead to spurious impact findings. This article discusses a framework for addressing this problem that balances Types I and II errors. The framework involves specifying…

Evaluations that combine social science and law have tremendous potential to illuminate the effects of governmental policies and yield insights into how effectively policy makers' efforts achieve their aims. This potential is infrequently achieved, however, because such interdisciplinary research contains often overlooked substantive and…