Researchers and practitioners sometimes presume that using a previously "validated" instrument will produce "valid" scores; however, contemporary views of validity suggest that there are many reasons this assumption can be faulty. In order to demonstrate just some of the problems with this view, and to support comparisons of…

Accreditation agencies and organizations calling for higher academic standards in the teaching profession have called for increasing minimum grade point averages and scores on standardized tests. However, it's not clear that these requirements actually improve teaching. Lisa Borden-King, Warren Gamas, Kathy Hintz, and Chelsie Hultz researched…

Building on the papers in this special issue, this article uses modern conceptions of validity theory to provide a framework for considering the evaluation of teaching quality. The 3 facets of teaching quality focused on are domain conceptualization, evidence and inferences, and their evaluation. Domain definitions vary in their specificity with…

The process of setting and evaluating student learning objectives (SLOs) has become increasingly popular as an example where classroom assessment is intended to fulfill the dual purpose use of informing instruction and holding teachers accountable. A concern is that the high-stakes purpose may lead to distortions in the inferences about students…

College students use online sources to obtain information about their institution's professors when preparing their schedules for the upcoming semester. While there is some disagreement among educators as to the validity of these student evaluations, students appear to find them to be quite useful. Might these evaluations, however, prove to be…

Following the trend of consequential accountability in US public education, New York City introduced a teacher evaluation program during the 2013-2014 school year that linked teachers' individual performance ratings with their students' exam scores. As this program systemically alters the nature of teacher--student relationships by transforming…

The five thoughtful papers included in this issue of "Educational Researcher" ("ER") raise new questions about the use of value-added methods (VAMs) to estimate teachers' contributions to students' learning as part of personnel evaluation. The papers address both technical and implementation concerns, considering potential…

Including growth models based on student test scores in teacher evaluations effectively holds teachers individually accountable for students improving their test scores. While an attractive policy for state administrators and advocates of education reform, value-added measures have been fraught with problems, and their use in teacher evaluation is…

Value-added models try to separate the contribution of individual teachers or schools to students' learning growth measured by standardized test scores. There is a policy trend to use value-added modeling to evaluate teachers because of its face validity and superficial objectiveness. This article investigates the potential long term consequences…

Proposals to evaluate teachers based on their "value-added" to student test scores generate intense debate. Underlying the debate are concerns about three factors: "bias," "precision," and "relevance." Previous Carnegie Foundation briefs have detailed the reasons why the first two are significant concerns.…

Our aim in this article is to draw attention to some underappreciated problems in the design and implementation of evaluation systems that incorporate value-added measures. We focus on four: (1) taking into account measurement error in teacher assessments, (2) revising teachers' scores as more information becomes available about their students,…

This report describes an analysis by the Tennessee Department of Education's Office of Research and Policy that proposes a second quantitative metric for assessing the practicality and usefulness of the ratings that teacher evaluators are giving to the teachers they observe by looking at the range of ratings given. The idea of the…

This article contributes to the body of knowledge on teacher evaluation systems by examining the actual design and performance of new teacher-evaluation systems in four school districts that are at the forefront of the effort to evaluate teachers meaningfully. The authors find first that the ratings assigned teachers by the districts'…

Current debates about test-based accountability policies revolve around questions of how to ensure that all students have access to high-quality schools and teachers. Whether and how one can meet this goal depend, in part, on the nature of the arguments that policy proponents and opponents mobilize in these debates. This article examines these…

Over the last several years, Tennessee has rapidly expanded the use of student growth portfolio models for the purpose of teacher evaluation. Participation, both in the number of districts and teachers, has increased steadily since portfolios were first introduced during the 2011-12 school year, and we expect that participation will continue to…