Background: The generalizability of a study's results continues to be at the forefront of concerns in evaluation research in education (Tipton & Olsen, 2018). Over the past decade, statisticians have developed methods, mainly based on propensity scores, to improve generalizations in the absence of random sampling (Stuart et al., 2011; Tipton,…

Random encouragement designs evaluate treatments that aim to increase participation in a program or activity. These randomized controlled trials (RCTs) can also assess the mediated effects of participation itself on longer term outcomes using a complier average causal effect (CACE) estimation framework. This article considers power analysis…

Debates continue about the positioning of design within research-driven universities. While the idea of autonomy has had a strong appeal, it is the bridging across established academic cultures that has proved especially effective for legitimizing design research and research education. Revisiting a conception of design as a 'Third Space' and…

The quality of a research study application sends a distinct signal to the institutional review board (IRB) about the skills, capacities, preparation, communication, experience, and resources of its authors. However, efforts to research and define IRB application quality have been insufficient. Inattention to the quality of an IRB application is…

Theory-focused joint displays represent an innovative approach to data and results integration with potential to build understanding of complex constructs, including factors that influence change over time. However, the extant literature offers few examples for doing so, particularly in convergent research designs. Therefore, the purpose of this…

The field of education relies heavily on instructional coaches to build teacher capacity in the implementation of evidence-based practices (EBPs). Although observation tools are commonly used to measure the fidelity of implementation by teachers, fewer tools are available to identify specific coaching behaviors used during in situ coaching…

A recent issue of the Australian Journal of Language and Literacy included an article reporting on a systematic narrative review of the research literature that indicated that there was insufficient evidence to conclude whether genre theory and systemic functional linguistics either 'worked' or 'did not work'. The criteria used to evaluate these…

Collecting data for an individual participant data meta-analysis (IPDMA) project can be time consuming and resource intensive and could still have insufficient power to answer the question of interest. Therefore, researchers should consider the power of their planned IPDMA before collecting IPD. Here we propose a method to estimate the power of a…

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically…

Students' emotions have been increasingly examined in feedback research. Socioculturally positioned research has particularly noted that emotions do not exist in a vacuum but are contextually situated, which also holds true for feedback encounters. In this scoping review, we provide a synthesis of earlier studies on emotions in feedback in higher…

Fetters et al.'s (2013) mixed methods integration framework uses construction metaphors: building, connecting, merging, and embedding. In a similar vein, this article uses an architectural metaphor and introduces design patterns as building blocks for mixed methods research design. A design pattern embeds one specific design decision into its…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

This conceptual methods article parallels remarks given at the 2022 American Association on Intellectual and Developmental Disabilities conference highlighting the importance of including the voices of people with intellectual disability in research processes. The purpose of this article was to put forth a call to action to disability researchers…

Multisite cluster randomized trials (MCRTs), in which, the intermediate-level clusters (e.g., classrooms) are randomly assigned to the treatment or control condition within each site (e.g., school), are among the most commonly used experimental designs across a broad range of disciplines. MCRTs often align with the theory that programs are…

The present study sought to evaluate the reproducibility of prominent findings stated by Fehr et al. in their developmental resource allocation experiment "Egalitarianism in Young Children", published in 2008. The experiment involved children making decisions about distributing sweets between themselves and either an in-group or an…