Background: Power analyses for a cluster-randomized trial (CRT) require estimates of additional design parameters beyond those needed for an individually randomized trial. In a 2-level CRT, there are two sample sizes, the number of clusters and the number of individuals per cluster. The intraclass correlation (ICC), or the proportion of variance…

Background: The generalizability of a study's results continues to be at the forefront of concerns in evaluation research in education (Tipton & Olsen, 2018). Over the past decade, statisticians have developed methods, mainly based on propensity scores, to improve generalizations in the absence of random sampling (Stuart et al., 2011; Tipton,…

Random encouragement designs evaluate treatments that aim to increase participation in a program or activity. These randomized controlled trials (RCTs) can also assess the mediated effects of participation itself on longer term outcomes using a complier average causal effect (CACE) estimation framework. This article considers power analysis…

Outdoor programs have shown holistic health benefits for participants, with recent evidence indicating that these benefits can extend long after the conclusion of the program. The methods employed in retrospective studies exploring these outcomes are diverse, leading to many different approaches. Furthermore, only a few studies reference a…

We conducted a scoping review on the consecutive controlled case series (CCCS) methodology (Hagopian, 2020). The CCCS is an approach to studying functional relations across a series of consecutive cases that share common features. We identified and reviewed 76 studies that used CCCS methodology. Most of these (a) were retrospective CCCS studies…

Debates continue about the positioning of design within research-driven universities. While the idea of autonomy has had a strong appeal, it is the bridging across established academic cultures that has proved especially effective for legitimizing design research and research education. Revisiting a conception of design as a 'Third Space' and…

The quality of a research study application sends a distinct signal to the institutional review board (IRB) about the skills, capacities, preparation, communication, experience, and resources of its authors. However, efforts to research and define IRB application quality have been insufficient. Inattention to the quality of an IRB application is…

Theory-focused joint displays represent an innovative approach to data and results integration with potential to build understanding of complex constructs, including factors that influence change over time. However, the extant literature offers few examples for doing so, particularly in convergent research designs. Therefore, the purpose of this…

The field of education relies heavily on instructional coaches to build teacher capacity in the implementation of evidence-based practices (EBPs). Although observation tools are commonly used to measure the fidelity of implementation by teachers, fewer tools are available to identify specific coaching behaviors used during in situ coaching…

A recent issue of the Australian Journal of Language and Literacy included an article reporting on a systematic narrative review of the research literature that indicated that there was insufficient evidence to conclude whether genre theory and systemic functional linguistics either 'worked' or 'did not work'. The criteria used to evaluate these…

Collecting data for an individual participant data meta-analysis (IPDMA) project can be time consuming and resource intensive and could still have insufficient power to answer the question of interest. Therefore, researchers should consider the power of their planned IPDMA before collecting IPD. Here we propose a method to estimate the power of a…

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically…

Students' emotions have been increasingly examined in feedback research. Socioculturally positioned research has particularly noted that emotions do not exist in a vacuum but are contextually situated, which also holds true for feedback encounters. In this scoping review, we provide a synthesis of earlier studies on emotions in feedback in higher…

Fetters et al.'s (2013) mixed methods integration framework uses construction metaphors: building, connecting, merging, and embedding. In a similar vein, this article uses an architectural metaphor and introduces design patterns as building blocks for mixed methods research design. A design pattern embeds one specific design decision into its…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…