In this article, the authors provide a methodological critique of the current standard of value-added modeling forwarded in educational policy contexts as a means of measuring teacher effectiveness. Conventional value-added estimates of teacher quality are attempts to determine to what degree a teacher would theoretically contribute, on average,…

Linking evaluation methods to the several phases of a program's life cycle can provide evaluation planners and funders with guidance about what types of evaluation are most appropriate over the trajectory of social and educational programs and other interventions. If methods are matched to the needs of program phases, evaluation can and should…

In this rejoinder, Maydeu-Olivares states that, in item response theory (IRT) measurement applications, the application of goodness-of-fit (GOF) methods informs researchers of the discrepancy between the model and the data being fitted (the room for improvement). By routinely reporting the GOF of IRT models, together with the substantive results…

The purpose of this extended commentary article is to frame the set of studies in the first of two issues and recommend areas of inquiry for future research. This special series issue features studies examining the technical qualities of formative assessment procedures that were developed to inform intervention. This article intends to emphasize…

In "Assessing the Belief Bias Effect With ROCs: It's a Response Bias Effect," Dube, Rotello, and Heit (2010) examined the form of receiver operating characteristic (ROC) curves for reasoning and the effects of belief bias on measurement indices that differ in whether they imply a curved or linear ROC function. We concluded that the ROC…

In the United States, but not only here, the movement to evaluate teachers based on student test scores has received powerful political and parental support. The logic is simple. From one testing occasion to another students should show growth in their knowledge and skill. Similar types of students should show similar patterns of growth. Those…

This excellent set of papers is comprehensive and very well written. The Kane et al. paper lays out the theory for linear equating with the NEAT design using a clever but simple framework. The Suh et al. paper is an excellent empirical study of the various methods. The Mroch et al. paper provides an insightful evaluation of the methods as…

Black, Wilson, and Yao (this issue) commendably attempt to put descriptive theory at the center of pedagogy, assessment, and curriculum. The thrust of their article is that only through theories of learning will student progression be properly understood. Casting a critical eye over the faddish distinction between "formative" and "summative"…

This commentary examines the role of the unit from the perspective of the definition of measurement in physics as the ratio of two magnitudes, one of which is defined as the unit; it is an important and timely contribution to measurement in the social sciences. There are many different points that could be commented upon, but the author will…

Compared to traditional test theory, where person measures are typically referenced to the distribution of a population, item response theory allows for a much more meaningful interpretation of measures as they can be directly compared to item locations. However, Stephen Humphry shows that the crucial role of the unit of measurement has been…

Humphry (this issue) deserves credit for drawing attention to the long-neglected fact that differences in item discrimination parameters are often due to empirical factors and not the product of random error components. In doing so, Humphry offers a psychometrically elegant, coherent, and practically important new model that is more flexible while…

Humphry (this issue) has written a thought-provoking piece on the interpretation of item discrimination parameters as scale units in item response theory. One of the key features of his work is the description of an item response theory (IRT) model that he calls the logistic measurement function that combines aspects of two traditions in IRT that…

Behavioral scientists have struggled with units of measurement for as long as they have struggled with measurement itself. Psychology's sole attempt at an explicit unit of measurement--the Lexile Framework for Reading (Stenner, Burdick, Sanford, & Burdick, 2006)--has been and continues to be ignored by the psychometric "cognoscenti."…

This article presents Stephen Humphry's response to the commentaries for his article "The Role of the Unit in Physics and Psychometrics." The commentaries covered a range of important considerations and implications. Given that the author fully agrees with the majority of the content, attention will be confined mainly to points that call…

A "big idea" is a concept that gives meaning to discrete facts. In this article, the author proposes a small number of big ideas, as well as his own views on where he thinks the field needs to move to achieve its full promise in school-based behavioral and social-emotional assessment. The three big ideas he has selected include: (1) universal…