Why we need better reports of teacher professional development interventions for finding out what works where: Worldwide, billions of dollars are invested yearly in the professional development of in-service teachers ($14 billion in the USA alone, as of 2014; Bill & Melinda Gates Foundation, 2014). This makes the question of what effects TPD…

These are the appendices for the report "The Effects of an Academic Language Program on Student Reading Outcomes." This study investigated WordGen Elementary, a program designed to improve fourth- and fifth-grade students' ability to understand and communicate academic language and their general reading skill. The program provider…

This guide provides experienced education researchers with suggestions for conducting high-quality effectiveness studies to overcome research challenges common to rural settings. The guide addresses four factors that researchers must consider when conducting educational effectiveness research in rural settings: (1) study design, (2) recruitment of…

Past research have pointed out that excellent strategies have been written but extremely small have been accomplished in their implementation. It has additionally been proposed that only 10% of formulated strategies are successfully implemented. However, crafting the best strategy is not the end in itself but the ultimate result will only be…

Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…

The purpose of this study is to extend the work of Spybrook and Raudenbush (2009) and examine how the research designs and sample sizes changed from the planning phase to the implementation phase in the first wave of studies funded by IES. The authors examine the impact of the changes in terms of the changes in the precision of the study from the…

To meet demands for accountability, most schools and departments of education at institutions of higher education (IHEs) gather information on their current students and graduates. This paper describes issues to consider when designing a longitudinal data collection and management system, drawing on seven years' experience developing such a…

The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…

E-learning researchers face considerable challenges in creating meaningful and generalizable studies due to the complex nature of this dynamic training medium. Our experience in conducting workplace e-learning research led us to create this guide for planning research on e-learning. We share the unanticipated complications we encountered in our…

Background: Despite considerable investment in UK government initiatives (e.g., the Physical Education School Sport [PESS] plan) aimed at improving the delivery and quality of physical education (PE) in primary schools, many remaining problems have been highlighted (e.g., facilities; staff training). It is suggested that the head teacher (school…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

This is the first of two reports that summarize the findings from an impact evaluation of a violence prevention intervention for middle schools. This report discusses findings after 1 year of implementation. A forthcoming report will discuss the findings after 2 years and 3 years of implementation. In 2004, the U.S. Department of Education (ED)…

Many difficulties are encountered when large-scale monitoring of federally-funded programs (including Title VII bilingual education programs) has been attempted. These difficulties may be categorized as follows: (1) differences in perception of the purpose of monitoring; (2) variance in the definition of the treatment (program) and expectations…

The federally supported Comprehensive School Reform Demonstration (CSRD) Program provides a minimum of $50,000 to local schools to engage in a comprehensive change process facilitated by the development and adoption of a comprehensive school reform plan, including technical assistance from an external model developer. This report summarizes the…