Researchers and practitioners sometimes presume that using a previously "validated" instrument will produce "valid" scores; however, contemporary views of validity suggest that there are many reasons this assumption can be faulty. In order to demonstrate just some of the problems with this view, and to support comparisons of…

It is common knowledge that teacher quality is a key in-school factor affecting student achievement. While the quality of teaching clearly matters for how much students learn, this quality is challenging to measure. Evaluating teacher quality based on the level of their students' end-of-year test scores has been one method of assessing…

Observations and ratings of classroom teaching and interactions collected over time are susceptible to trends in both the quality of instruction and rater behavior. These trends have potential implications for inferences about teaching and for study design. We use scores on the Classroom Assessment Scoring System-Secondary (CLASS-S) protocol from…

Mean or median student growth percentiles (MGPs) are a popular measure of educator performance, but they lack rigorous evaluation. This study investigates the error in MGP due to test score measurement error (ME). Using analytic derivations, we find that errors in the commonly used MGP are correlated with average prior latent achievement: Teachers…

Under laws providing for equal access to quality education, most American students with disabilities are taught largely in general education classrooms. And along with all other students, they are included in standards-based reforms--policies that hold their schools and teachers accountable for what they do or do not learn. In more and more cases,…

Value-added models have caught the interest of policymakers because, unlike using student tests scores for other means of accountability, they purport to "level the playing field." That is, they supposedly reflect only a teacher's effectiveness, not whether she teaches high- or low-income students, for instance, or students in accelerated or…

Value-added evaluations use student test scores to assess teacher effectiveness. How student achievement is judged can depend on which test is used to measure it. Thus it is reasonable to ask whether a teacher's value-added score depends on which test is used to calculate it. Would it change if a different test was used? Specifically, might a…

As the education reform movement increasingly focuses on teachers and teaching, educators, policy-makers, and researchers need valid and reliable measures that can be used to evaluate individual teachers, provide guidance for improving teaching performance, and support research in ways that advance instruction and classroom dialog and practice. A…

Education policymakers have shown increased interest in incentive programs for teachers based on the outcomes of their students. This article examines a program in which bonuses were awarded to teams of middle school teachers based on their collective contribution to student test score gains. The study employs a randomized controlled trial to…

This article develops a validity argument approach for use on observation protocols currently used to assess teacher quality for high-stakes personnel and professional development decisions. After defining the teaching quality domain, we articulate an interpretive argument for observation protocols. To illustrate the types of evidence that might…

The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large…

In an effort to explore the impact of performance incentives in education, the National Center on Performance Incentives (NCPI) partnered with the Metropolitan Nashville Public Schools (MNPS) to conduct the Project on Incentives in Teaching, or POINT. The study examines the effects on student outcomes of paying eligible teachers bonuses of up to…

Studied the performance of rank (percentile) estimators in a basic two-stage hierarchical model capturing essential features of more complicated models commonly used to estimate effects. Simulation results highlight the need to assess whether even optimal percentile estimators perform sufficiently well to be used to evaluate teachers or schools.…

The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…