The global COVID-19 health pandemic caused major interruptions to educational assessment systems, partially due to shifts to remote learning environments, entering the post-COVID educational world into one that is more open to heterogeneity in instructional and assessment modes for secondary students. In addition, in 2020, educational inequities…

The global COVID-19 health pandemic caused major interruptions to educational assessment systems, partially due to shifts to remote learning environments, entering the post-COVID educational world into one that is more open to heterogeneity in instructional and assessment modes for secondary students. In addition, in 2020, educational inequities…

In this study, I investigated the effectiveness of a creativity-support system that I developed in the level editor of a learning game called "Physics Playground" on improving college students' creativity. Moreover, I investigated the validity and reliability of an in-game assessment of creativity to measure students' creativity.…

Screening and monitoring student reading progress can be costly and time consuming. Assessment embedded within the context of online instructional programs can capture ongoing student performance data while limiting testing time outside of instruction. This paper presents two studies that examined the validity of using performance measures from a…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

Full and durable implementation of school-based interventions is supported by regular evaluation of fidelity of implementation. Multiple assessments have been developed to evaluate the extent to which schools are applying the core features of school-wide positive behavioral interventions and supports (SWPBIS). The "SWPBIS Tiered Fidelity…

In the present study, we describe the innovative use of the National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination (CBSE) as a progress test during the preclerkship medical curriculum. The main aim of this study was to provide external validation of internally developed multiple-choice assessments in a new medical…

There is a growing body of research on the validity and reliability of value-added measures, but most of this research has focused on elementary grades. Driven by several federal initiatives such as Race to the Top, Teacher Incentive Fund, and ESEA waivers, however, many states have incorporated value-added measures into the evaluations not only…

In this report I share the results of a document-based, comparative case study aimed at increasing our understanding about the potential utility of state kindergarten entry assessments (KEAs) to provide evidence of English learner (EL) kindergartners' knowledge and skills and, in turn, inform kindergarten teachers' instruction. Using a sample of 9…

Value-added evaluations use student test scores to assess teacher effectiveness. How student achievement is judged can depend on which test is used to measure it. Thus it is reasonable to ask whether a teacher's value-added score depends on which test is used to calculate it. Would it change if a different test was used? Specifically, might a…

To improve the U.S. education system through more-effective classroom teaching, in school year 2009-2010, the Bill and Melinda Gates Foundation announced four Intensive Partnership for Effective Teaching sites. The Intensive Partnerships Initiative is based on the premise that efforts to improve instruction can benefit from high-quality measures…

Can districts and charter management organizations (CMOs) use contemporary ideas about teacher evaluation, management, and support to spark big improvements in student outcomes? To answer this question, the Bill & Melinda Gates Foundation launched the Intensive Partnerships for Effective Teaching initiative with seven sites across the country…

This document provides the final two appendixes for "Improving Teaching Effectiveness: Implementation. The Intensive Partnerships for Effective Teaching through 2013-2014" (ED580306). Appendix D provides detailed discussions of lever implementation for each site along with the detailed coded lever tables. Appendix E summarizes the…

School districts and states across the Regional Educational Laboratory Mid-Atlantic Region and the country as a whole have been modifying their teacher evaluation systems to identify more effective and less effective teachers and provide better feedback to improve instructional practice. The new systems typically include components related to…

Amidst the ethnic and linguistic diversity in adult English language classes, there is heightened importance to using culturally responsive teaching practices. However, there are limited quantitative examinations of this approach in adult learning environments. The purpose of this investigation was to describe patterns of culturally responsive…