Observations and ratings of classroom teaching and interactions collected over time are susceptible to trends in both the quality of instruction and rater behavior. These trends have potential implications for inferences about teaching and for study design. We use scores on the Classroom Assessment Scoring System-Secondary (CLASS-S) protocol from…

Student Growth Percentiles (SGPs) increasingly are being used in the United States for inferences about student achievement growth and educator effectiveness. Emerging research has indicated that SGPs estimated from observed test scores have large measurement errors. As such, little is known about "true" SGPs, which are defined in terms…

In this paper we consider the challenges involved in evaluating teacher preparation programs when controlling for school contextual bias. Including school fixed effects in the achievement models used to estimate preparation program effects controls for school environment by relying on differences among student outcomes within the same schools to…

The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large…

This article develops a model for longitudinal student achievement data designed to estimate heterogeneity in teacher effects across students of different achievement levels. The model specifies interactions between teacher effects and students' predicted scores on a test, estimating both average effects of individual teachers and interaction…

Studied the performance of rank (percentile) estimators in a basic two-stage hierarchical model capturing essential features of more complicated models commonly used to estimate effects. Simulation results highlight the need to assess whether even optimal percentile estimators perform sufficiently well to be used to evaluate teachers or schools.…

In the past two decades, several major initiatives were launched to improve mathematics and science education. One prominent feature in these efforts was a new approach to teaching mathematics and science, referred to as "reform-oriented" teaching. Although past studies suggest this approach may improve student achievement, the relationships…

A key component to the new wave of performance-based pay initiatives is the use of student achievement data to evaluate teacher performance. As greater amounts of student achievement data are being collected, researchers have been developing and applying innovative statistical and econometric models to longitudinal data to develop measures of an…

This monograph presents the findings of a multiyear study of the effectiveness of reform-oriented mathematics and science instruction. It builds on an earlier RAND study, called the Mosaic project, which found "a weak but positive relationship" between reform practices and student achievement (see Klein, Hamilton, McCaffrey, Stecher,…

New forms of governing and managing public schools have proliferated in recent years, spawning the establishment and growth of companies that operate public schools under contract. Among these education management organizations, or EMOs, the largest and most visible is Edison Schools, Inc., with a nationwide network in 2004-2005 of 103 managed…