Though previously unacknowledged, a SMART (Sequential Multiple Assignment Randomized Trial) design uses both regression discontinuity (RD) and randomized controlled trial (RCT) designs. This combination structure creates a conceptual symbiosis between the two designs that enables both RCT- and previously unrecognized, RD-based inferential claims.…

This paper scrutinizes the increasing trend of using international large-scale assessment (ILSA) data for causal inferences in educational research, arguing that such inferences are often tenuous. We explore the complexities of causality within ILSAs, highlighting the methodological constraints that challenge the validity of causal claims derived…

Qualitative thematic analysis is a commonly used and widely applicable form of qualitative analysis, though it can be challenging to implement. Due to its use across research questions, qualitative traditions, and fields, thematic analysis is also prevalent in mixed methods studies. Despite its widespread use, the term "thematic…

A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

Education researchers often encounter scenarios where an abrupt policy change occurs within or across jurisdictions or populations that affect key student outcomes. Difference-in-differences is a research design analysts can use to estimate causal effects of these "natural experiments." This article introduces education researchers to…

Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and…

Researchers increasingly take advantage of the comparative case design to build theory, but the degree of case dependence is occasionally discussed and theorized. We suggest that the comparative case study design might be subject to an often underappreciated threat--dependence across cases--under certain conditions. Using research on innovation…

Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

When conducting a postal survey, a traditional recommendation is to use paper postage stamps instead of an automated postage system, to make sure that invitations have a more personal and attractive appearance. In this research note, we investigate whether this traditional recommendation is still valid. In the autumn of 2020, a postal survey was…

Outside of education, many academic disciplines developed and promulgated checklists to evaluate the quality of qualitative studies. This article used an embedded mixed methods approach in three stages: development of a conceptual framework reviewing 62 guidelines; a content analysis of key areas of the guidelines; and review of dissertations to…

Within physics education research (PER), resource theory has proven to be a useful framework for investigating knowledge and learning and informing instructional design. To analyze learning over longer timescales and across cases, PER scholars must first identify and describe the resources activated within and across physics contexts and domains.…

Background: Views can be collected from individuals (self-report) or others on their behalf (proxy-report). Objective: We aimed to review the literature on methods and statistical approaches used to evaluate observer versus self-report responses from individuals with intellectual disability or Down syndrome. Methods: A series of key questions…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

It can be suggested that pre-service primary school teachers' sense of belonging to science may be influential to their professionalization within university-based teacher education programs, which intend to prepare them for teaching natural sciences in primary school. Nevertheless, because only few studies have examined teachers' sense of…

Recent years have witnessed a host of innovations for conducting research with qualitative comparative analysis (QCA). Concurrently, important issues surrounding its uses have been highlighted. In this article, we seek to help users design QCA studies. We argue that establishing inference with QCA involves three intertwined design components:…