Educators who are urged to use evidence-based practices to improve instruction often end up disappointed at the results, which fall short of those touted in the research and by the What Works Clearinghouse. Stanley Pogrow explains how common strategies researchers use to demonstrate evidence of success, such as statistical significance of or…

Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

In a candid conversation, two preeminent education researchers discuss the state of the field and their own methodological differences. Matthew A. Kraft, an influential education scholar and former K-12 teacher, talks with John Hattie, renowned author of Visible Learning. They debate their different viewpoints on effect sizes, discuss how evidence…

As the empirical literature in educational technology continues to grow, meta-analyses are increasingly being used to synthesise research to inform practice. However, not all meta-analyses are equal. To examine their evolution over the past 30 years, this study systematically analysed the quality of 52 meta-analyses (1988-2017) on educational…

Single-case design has a long history of use for assessing intervention effectiveness for children with disabilities. Although these designs have been widely employed for more than 50 years, recent years have been especially dynamic in terms of growth in the use of single-case design and application of standards designed to improve the validity…

This article reviews group counselling interventions conducted by school counsellors that aimed to improve academic achievement. A total of 12 studies met these criteria. The studies that used comprehensive/comparative tests and GPA as academic achievement outcome measures had moderate to large effect sizes. Secondly, this review broadly examined…

Increased attention on "what works" in education has led to an emphasis on developing policy from evidence based on comparing and combining a particular statistical summary of intervention studies: the standardised effect size. It is assumed that this statistical summary provides an estimate of the educational impact of interventions and…

Much of the evidential basis for recent policy decisions is grounded in effect size: the standardised mean difference in outcome scores between a study's intervention and comparison groups. This is interpreted as measuring educational influence, importance or effectiveness of the intervention. This article shows this is a category error at two…

This article reviews some of the strengths and limitations of the comparative use of meta-analysis findings, using examples from the Sutton Trust-Education Endowment Foundation Teaching and Learning "Toolkit" which summarizes a range of educational approaches to improve pupil attainment in schools. This comparative use of quantitative…

Background: Over the years, the quantity and quality of educational research has been rapidly improving. This can be attributed to the growing call to use evidence of effectiveness in decision-making by policymakers and practitioners. In fact, evidence sufficient to establish programs as "small", "moderate", or…

An analysis was conducted of the What Works Clearinghouse (WWC) research evidence base on the effectiveness of replicable education interventions. Most interventions were found to have little or no support from technically adequate research studies, and intervention effect sizes were of questionable magnitude to meet education policy goals. These…

Background: Most studies of teacher professional development (PD) do not rigorously test impact on teaching practice and student learning. This makes it difficult to define what is truly "effective." The "Science Teachers Learning from Lesson Analysis" (STeLLA) PD program, in contrast, was studied in a cluster randomized…

The primary obstacle to faster progress in U.S. education reform is hard to put your finger on, because it's an absence, not a presence. It is not an interest group or a manifest social problem. It is the infrastructure we never built for identifying what works. It is the organizational framework we've not yet constructed for building consensus…

It would be impossible to preface what follows with one of those "disclaimers" that insist "the views and opinions expressed in this article are those of the author and do not reflect the views of..." This would not only be disingenuous, it would deny the history that I draw on to make an argument about teaching, learning and…

The history of research on interventions for struggling readers in Grades 4 through 12 dates back to 19th-century case studies of seemingly intelligent children who were unable to learn to read. Physicians, psychologists, educators, and others were determined to help them. In the process, they launched a century of research on a wide variety of…