Engineering design is being increasingly included in elementary education, typically to provide students with opportunities to apply science and mathematics concepts while developing their engineering practices. An important question is how to prepare teachers who can help students develop more informed engineering practices during classroom…

When employees expect evaluation and performance incentives will continue (or begin) in the future, the potential future rewards create an incentive to invest in relevant skills today. Because skills benefit job performance, the effects of evaluation can persist after the rewards end or even anticipate the start of rewards. I provide empirical…

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of fourth- and fifth-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations…

Student assessment nonparticipation (or opt out) has increased substantially in K-12 schools in states across the country. This increase in opt out has the potential to impact achievement and growth (or value-added) measures used for educator and institutional accountability. In this simulation study, we investigated the extent to which…

High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers'…

The purpose of this study was to develop a "Water strider" Inquiry Learning Program for improved inquiry learning, and to analyze the validity of the "Water strider." The Inquiry Learning Program's goal was to create an application for finding out an on-site applicability for the "Water strider" Inquiry Learning…

In an influential paper, Jesse Rothstein (2010) shows that standard value-added models (VAMs) suggest implausible and large future teacher effects on past student achievement. This is the basis of a falsification test that "appears" to indicate bias in typical VAM estimates of teacher contributions to student learning on standardized…

Student Growth Percentiles (SGPs) are increasingly being used in evaluations of teacher effectiveness. This study investigates two properties of SGPs: 1) SGP sensitivity to reference group characteristics such as sample size, free and reduced lunch (FRL) status, and English language learner (ELL) status; and 2) variation in score changes across…

New systems that seek to evaluate teachers with regard to their classroom quality often rely on observation instruments that capture general instructional pedagogies. However, decades of research suggest that content-specific dimensions of instruction also are important to differentiate teachers and improve student outcomes. We explore the degree…

Student Growth Percentiles (SGPs) increasingly are being used in the United States for inferences about student achievement growth and educator effectiveness. Emerging research has indicated that SGPs estimated from observed test scores have large measurement errors. As such, little is known about "true" SGPs, which are defined in terms…

Educator performance evaluation systems are a potential tool for improving student achievement by increasing the effectiveness of the educator workforce. For example, recent research suggests that giving more frequent, specific feedback on classroom practice may lead to improvements in teacher performance and student achievement. This report is…

Educator performance evaluation systems are a potential tool for improving student achievement by increasing the effectiveness of the educator workforce. For example, recent research suggests that giving more frequent, specific feedback on classroom practice may lead to improvements in teacher performance and student achievement. This report is…

Teacher value-added models (VAMs) must isolate teachers' contributions to student achievement to be valid. Well-known VAMs use different specifications, however, leaving policymakers with little clear guidance for constructing a valid model. We examine the sensitivity of teacher value-added estimates under different models based on whether they…

Several states have recently adopted or are pursuing policies that deny or revoke tenure from teachers who receive poor evaluation ratings over time based in part on quantitative measures of performance. Using data from the state of Florida, we estimate such value-added measures to consider the future effectiveness and number of teachers who would…

The purpose of this study was to investigate the relationship between the TVAAS growth score given by the Tennessee Department of Education and the overall Tennessee Educator Assessment Model (TEAM) observation rating for teachers in grades 3 through 8. The participating county public school system for this study is located in Northeast Tennessee.…