Traditional pre-test (TpT)/post-test (PT) and retrospective pre-test (RpT)/post-test (PT) designs are used to collect data on self-reported measures to assess the magnitude of change that occurs from interventions. If measurement invariance does not exist across the measurement occasions within these research designs, it is inappropriate to…

"FRIENDS for Life" is a cognitive behavioural therapy (CBT) programme which aims to reduce anxiety and promote resilience among children. This study evaluated the "FRIENDS for Life" (FRIENDS) programme used as an intervention for seven children between the ages of 10 and 11 presenting with high functioning autism spectrum…

Background: Since 1984, Students Taking a Right Stand (STARS) Nashville has implemented Student Assistance Programs (SAPs) in the middle Tennessee area, to include 14 counties and 16 school districts. STARS Nashville serves K-12 with a focus in middle and high schools. Methods: The current study reviewed studies that utilized quasi-experimental…

The regression discontinuity design (RDD) has the potential to yield findings with causal validity approaching that of the randomized controlled trial (RCT). However, Schochet (2008a) estimated that, on average, an RDD study of an education intervention would need to include three to four times as many schools or students as an RCT to produce…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

A simulation study was conducted in an attempt to examine how evaluators modify their evaluation design in response to differing stakeholder groups. In this study, evaluators were provided with a fictitious description of a school-based program. They were then asked to design an evaluation of the program. After the evaluation design decisions were…

Syntheses of research on educational programs have taken on increasing policy importance. Procedures for performing such syntheses must therefore produce reliable, unbiased, and meaningful information on the strength of evidence behind each program. Because evaluations of any given program are few in number, syntheses of program evaluations must…

D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

Although the need for evaluation of training programs administered in organizations is recognized and widely discussed, program evaluation is not easy, and there exists a gap between discussion and practice. Cohen notes an absence of research efforts demonstrating the application of evaluation methods, particularly within control groups. This…

This applied dissertation described the evaluation of a program designed to provide students with the necessary academic and social skills needed to matriculate and graduate from the university. The problem was that there was no evidence of a formalized program evaluation to determine if the Academic Empowerment Center (AEC) was effective in…

Objective: This study evaluated the Association of Community Organizations for Reform Now's (ACORN) efforts to increase the uptake of families claiming the earned income tax credit through door-to-door canvassing and managing free tax preparation clinics in three pilot cities. Method: The mixed-method program evaluation included administrative…

A research design is described for the situation in which a program, particularly a compensatory education program funded by Chapter 1 of the Hawkins Stafford Act of 1988, can be evaluated when there is no available comparison group and no pretest data. The design requires content specialists to identify which objectives on the posttest were…

The one group posttest only evaluation model has been identified as a relatively inexpensive and useful model that can identify program components that are not being successful. The use of the model is discussed and illustrated through a hypothetical evaluation of a compensatory (Chapter 1) program. The one group posttest only evaluation model…

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…