In 2020, the What Works Clearinghouse (WWC) for single-case experimental design (SCED) studies released an updated version of their standards and procedures handbook (Version 4.1). Because of these updates, there is a need to understand the implications for the field in terms of quality rating of the design, and subsequent synthesis of evidence at…

Clearinghouses set standards of scientific quality to vet existing research to determine how "evidence-based" an intervention is. This paper examines 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently[underlined] they rate the same program, and to probe why their judgments differ. All the…

Identifying evidence-informed programming (e.g., strategies, activities, pedagogies) facilitates both the intentional offering of programming that should "work" and the use of the outcomes assessment process to evaluate program effectiveness. Evidence-informed programming is more efficient than unsupported programming because the…

Utah Leading through Effective, Actionable, and Dynamic (ULEAD) Education is required to report on successful K-12 practices in Utah and other states and propose policy changes to remove barriers to implementation successful practices. These practices should result from ULEAD's innovative research reports and repository development. There have…

The What Works Clearinghouse (WWC) is a source that is used to report the empirical evidence for interventions. The purpose of this review was to understand the presence of Black children in research that has been classified as Meeting the Standards With and Without Reservations by the WWC. Results indicated that 16 interventions met the WWC…

The What Works Clearinghouse (WWC) is an investment of the U.S. Department of Education's Institute of Education Sciences. Its purpose is to provide educators, policymakers, researchers, and the public with a central and trusted source of scientific evidence on what works in education. The WWC's goal is to produce high-quality products that help…

Despite a history that can be tracked to 1867, the US Department of Education is a relative newcomer to applying evidence standards to education research. The What Works Clearinghouse (WWC) reviews intervention research to support evidence-based decision making. This is done by applying standards of research quality to studies and giving those…

The What Works Clearinghouse (WWC) seeks to provide practitioners information about "what works in education." One challenge in understanding "what works" is that effect sizes may not be comparable across studies, which limits the ability to compare the relative effectiveness of multiple interventions. One factor that…

The system of least prompts response prompting procedure has a rich history in special education research and practice. Recently, two independent systematic reviews were conducted to determine if the system of least prompts met criteria to be classified as an evidence-based practice. Both reviews used single-case design standards developed by What…

Following the theme of the first two presentations, this presentation will focus on the choices available for research synthesis when summarizing research evidence. The presenters will describe the current research synthesis practice of the What Works Clearinghouse (WWC) as well as several alternative models, including inverse-variance weighted…

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

We examined the extent to which mathematics program evaluations that have been conducted according to methodologically rigorous standards have attended to the theories underlying the programs being evaluated. Our analysis focused on the 37 reports of K-12 mathematics program evaluations in the last two decades that have met standards for inclusion…

The What Works Clearinghouse (WWC) is a central and trusted source of information of scientific evidence for what works in education. Towards that end, the WWC summarizes research on a range of practices, programs, and policies (interventions) and disseminates that research in a variety of forms on the free public website. In recent years, the WWC…

The purpose of this paper is to describe best practices in designing and implementing strong quasi-experimental designs (QED) when assessing the effectiveness of policies, programs or practices. The paper first discusses the issues researchers face when choosing to conduct a QED, as opposed to a more rigorous randomized controlled trial design.…

The push for evidence-based practice in education has led to a range of initiatives aimed at bridging the gap between research, policy and practice. Among these are the establishment of brokerage agencies with a mission to synthesise the findings of educational research. This development has been the subject of extensive controversy over the last…