In this commentary, we complement other constructive critiques of educational randomized control trials (RCTs) by calling attention to the commonly ignored role of context in causal mechanisms undergirding educational phenomena. We argue that evidence for the central role of context in causal mechanisms challenges the assumption that RCT findings…

Experience-sampling methods (ESM) enable us to learn about individuals' lives in context by measuring participants' feelings, thoughts, actions, context, and/or activities as they go about their daily lives. By capturing experience, affect, and action "in the moment" and with repeated measures, ESM approaches allow researchers…

Researcher-practitioner partnerships have gained increasing prominence within education in recent years, yet scholarship on partnerships and tools to guide partnerships' work remain in their infancy. Drawing on our own work in a partnership as well as analysis of abstracts for the 41 partnerships funded by the Institute of Education Sciences and…

Despite calls to expand early childhood education (ECE) in the United States, questions remain regarding its medium- and long-term impacts on educational outcomes. We use meta-analysis of 22 high-quality experimental and quasi-experimental studies conducted between 1960 and 2016 to find that on average, participation in ECE leads to statistically…

Experimental and quasi-experimental designs are used in educational research to establish causality and develop effective practices. These research designs rely on a counterfactual model that, in simple form, calls for a comparison between a treatment group and a control group. Developers of educational practices often assume that the population…

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

The present article responds briefly to the comments, in this issue of "Educational Researcher," of Petrosino and of Robinson to the "Propagation of Misinformation About Frequencies of RFTs/RCTs in Education: A Cautionary Tale." The authors emphasize that the context of how the quality of education research is perceived both within and outside the…

Design-based research (DBR) evolved near the beginning of the 21st century and was heralded as a practical research methodology that could effectively bridge the chasm between research and practice in formal education. In this article, the authors review the characteristics of DBR and analyze the five most cited DBR articles from each year of this…

The authors respond to the commentaries on a series of articles (in the March 2009 issue of "Educational Researcher") that discuss the challenges associated with measuring reading instruction. The authors argue that the teaching of reading is a complex, multifaceted phenomenon best studied through a variety of overlapping and complementary…

How doctoral programs train future researchers in quantitative methods has important implications for the quality of scientifically based research in education. The purpose of this article, therefore, is to examine how quantitative methods are used in the literature and taught in doctoral programs. Evidence points to deficiencies in quantitative…

Syntheses of research on educational programs have taken on increasing policy importance. Procedures for performing such syntheses must therefore produce reliable, unbiased, and meaningful information on the strength of evidence behind each program. Because evaluations of any given program are few in number, syntheses of program evaluations must…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

This response to Slavin's article (2008) explores the issues of transparency, representation, and warranting of claims in Slavin's descriptions of the work of others and his suggestions for program evaluation syntheses. Through contrastive analyses between Slavin's representations of the program evaluation synthesis efforts of five organizations…

Responding to Bulterman-Bos (2008), the author argues that the effort to make education research more relevant is counterproductive. Teachers and researchers have different orientations toward education that arise from different institutional settings, occupational constraints, daily work demands, and professional incentives. These are not…