ERIC Number: ED529961
Record Type: Non-Journal
Publication Date: 2003
Pages: 191
Abstractor: As Provided
ISBN: ISBN-0-8330-3542-8
ISSN: N/A
EISSN: N/A
Evaluating Value-Added Models for Teacher Accountability. Monograph
McCaffrey, Daniel F.; Lockwood, J. R.; Koretz, Daniel M.; Hamilton, Laura S.
RAND Corporation
Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher evaluations or as part of test-based accountability. They are intrigued by VAM because of the view that its complex statistical techniques can provide estimates of the effects of teachers and schools that are not distorted by the powerful effects of such noneducational factors as family background. This monograph clarifies the primary questions raised by the use of VAM for measuring teacher effects, reviews the most important recent applications of VAM, and discusses a variety of statistical and measurement issues that might affect the validity of VAM inferences. The authors identify numerous possible sources of error and bias in teacher effects and recommend a number of steps for future research into these potential errors. They conclude that the research base is currently insufficient to support the use of VAM for high-stakes decisions about individual teachers or schools. It is important that policymakers, practitioners, and VAM researchers work together, so that research is informed by the practical needs and constraints facing users of VAM and that implementation of the models is informed by an understanding of what inferences and decisions the research currently supports. Each chapter contains footnotes. Technical Evaluations of the Methods of Sanders and Rivers (1996) and Wright, Horn, and Sanders (1997) are appended. (Contains 7 figures and 14 tables.) [This monograph was prepared for the Carnegie Corporation.]
Descriptors: Educational Change, Accountability, Inferences, Models, Merit Rating, Achievement Rating, Measurement Objectives, Measurement Techniques, Evaluation Needs, Research Needs, Error of Measurement, Literature Reviews, Teacher Effectiveness, Teacher Evaluation, Formative Evaluation, Educational Policy, Change Strategies, Item Analysis, Item Response Theory, Value Judgment, Educational Researchers, Theory Practice Relationship, Evaluation Criteria, Evaluation Methods, Evaluation Research, Evaluation Utilization, Evaluation Problems, Evidence
RAND Corporation. P.O. Box 2138, Santa Monica, CA 90407-2138. Tel: 877-584-8642; Tel: 310-451-7002; Fax: 412-802-4981; e-mail: order@rand.org; Web site: http://www.rand.org
Publication Type: Reports - Descriptive
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: Carnegie Corporation of New York
Authoring Institution: RAND Education
Grant or Contract Numbers: N/A
IES Cited: ED544345; ED544674; ED548024