The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

This paper reports an innovative, hybrid teaching model for a junior level lab course. This model leverages in-person lab operation by adding a student-led online learning mode. Both course outcomes and student outcomes were evaluated. Student feedback was collected, and its analysis showed both positive and negative impacts in this hybrid model.…

In science in general and in the context of single-case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been…

Recently, statisticians have begun developing methods to improve the generalizability of results from large-scale experiments in education. This work has included the development of methods for improved site selection when random sampling is infeasible, including the use of stratification and targeted recruitment strategies. This article provides…

Three experiments investigated the learning of simple associations in a color-word contingency task. Participants responded manually to the print colors of 3 words, with each word associated strongly to 1 of the 3 colors and weakly to the other 2 colors. Despite the words being irrelevant, response times to high-contingency stimuli and to…

Descriptive assessments involve recording naturally occurring instances of behavior and corresponding antecedent and consequent events. Authors have argued for the use of two forms of descriptive assessment, structured and narrative Antecedent-Behavior-Consequence recording, because these methods may require little training. However, the extent to…

Recently, the testing effect has received a great deal of attention from researchers and educators who are intrigued by its potential to enhance student learning in the classroom. However, effective incorporation of testing (as a learning tool) merits a close examination of the conditions under which testing can enhance student learning in an…

Massive Open Online Courses (MOOCs) are becoming an increasingly popular choice for education but, to reach their full extent, they require the resolution of new issues like assessing students at scale. A feasible approach to tackle this problem is peer assessment, in which students also play the role of assessor for assignments submitted by…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

In this article, the authors talk about variation and how variation between measurements may be reduced if sampling is not random. They also talk about replication and its variants. A replicate is a repeated measurement from the same experimental unit. An experimental unit is the smallest part of an experiment or a study that can be subject to a…

In this article, the authors consider the possibility that groups could be different, because of the different conditions of a factor. This is as far as the analysis can extend: the consideration is restricted to groups characterized by the different category of the factor being considered. In many biological experiments, the factor considered may…

As implementation of multi-tiered systems of support becomes common practice across the nation, practitioners continue to need strategies for intensifying interventions and supports for the subset of students who fail to make adequate progress despite strong programs at Tiers 1 and 2. Experts recommend making several changes to the structure and…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…