Designing and interpreting controlled experiments are important inquiry skills addressed in many current science curricula. The relevant skills associated with the design and interpretation of controlled experiments are summarised under the term control-of-variables strategy (CVS). Research on elementary school students' CVS skills shows that they…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

The purpose of this study was to illustrate the use of the randomization test for single-case research designs (SCR; Kratochwill & Levin, 2010). To demonstrate the application of this approach, a systematic replication of Grünke, Wilbert, and Calder Stegemann (2013) was conducted to evaluate the effects of a story map to improve the reading…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

This article reviews several decades of the author's meta-analytic and experimental research on the conditions under which nonrandomized experiments can approximate the results from randomized experiments (REs). Several studies make clear that we can expect accurate effect estimates from the regression discontinuity design, though its statistical…

This study uses within-study comparisons to assess the relative importance of covariate choice, unreliability in the measurement of these covariates, and whether regression or various forms of propensity score analysis are used to analyze the outcome data. Two of the within-study comparisons are of the four-arm type, and many more are of the…

Structure and content of teacher education depend on a deeper rationale, which is a result of cultural boundaries. At the same time teaching is a cultural practice that differs across countries. Like the water in the fish's tank, such cultural givens are too often invisible as we debate research designs. In this article, we focus in particular on…

This article examines the nature and influence of peer group perceptions on pupils' attitudes to learning German and French. It begins with an overview of key findings from the literature, before reviewing selected results from a large PhD attitudinal survey using a multi-stage qualitative research design. The article focuses on the perceptions of…