"Game-Based Assessments: A Promising Way to Create Idiographic Perspectives" (Adrienne Walker and George Englehard) comments on: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" by Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute. Here, Walker and Englehard write…

D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

This article raises a number of questions about the current unified theory of test validity that has construct validity at its center. The authors suggest a different way of conceptualizing the problem of establishing validity by considering whether the focus of the investigation of a test is internal to the test itself or focuses on constructs…

Need for closure, as formulated by Kruglanski and colleagues [Kruglanski, A. W. (1990). Lay epistemic theory in social-cognitive psychology. "Psychological Inquiry," 1(3), 181-197; Kruglanski, A. W., & Webster, D. M. (1996). Motivated closing of the mind: Seizing and freezing. "Psychological Review," 103, 263-283; Webster,…

This is a reaction to Borsboom's (2006) discussion paper on the issue that psychology takes so little notice of the modern developments in psychometrics, in particular, latent variable methods. Contrary to Borsboom, it is argued that latent variables are summaries of interesting data properties, that construct validation should involve studying…

The Implicit Association Test (IAT) requires responding to category contrasts such as young versus old, male versus female, and pleasant versus unpleasant. In introducing the IAT, A. G. Greenwald, D. E. McGhee, and J. L. K. Schwartz (1998) proposed that IAT measures reflect mental structures involving the nominal features of the IAT's categories…

Borsboom (2006) attacks psychologists for failing to incorporate psychometric advances in their work, discusses factors that contribute to this regrettable situation, and offers suggestions for ameliorating it. This commentary applauds Borsboom for calling the field to task on this issue and notes additional problems in the field regarding…

In their comment on K. Rothermund and D. Wentura, A. G. Greenwald, B. A. Nosek, M. R. Banaji, and K. C. Klauer agreed that salience asymmetries can be a source of Implicit Association Test (IAT) effects. The authors applaud this conclusion but point to problems with the other points that Greenwald et al. made. The authors have difficulties…

Smith's article "On Construct Validity: Issues of Method and Measurement" is a fine tribute to L. J. Cronbach and P. E. Meehl (1955) that clarifies the current state and future directions in the understanding of construct validity. Construct validity is a dynamic process, and fit indices need to be used at the service of understanding, not in…

The relative roles of general cognitive ability, speed and efficiency of elemental cognitive processing, and oral reading fluency in the prediction of reading comprehension are examined using multiple regression. The construct validity of the curriculum-based approach to measurement of reading comprehension is supported. Reliability is assessed…

This paper describes two measurement integrity analyses conducted using data on the Battelle Developmental Inventory, obtained from a sample of 78 children with severe disabilities. Procedures used to conduct internal reliability and construct validity analyses are discussed. Researchers are urged to evaluate a test's construct validity when their…

Teacher knowledge has been of theoretical and empirical interest for over two decades, and development of measures is overdue. The researchers represented in this volume have been breaking new ground by developing a measure of mathematical knowledge for teaching (MKT) without guiding precedents, and in the face of differing perspectives on teacher…

Operating from multiple literature bases in cognitive psychology, mathematics education, and theoretical and applied psychometrics, Schilling, Hill and their colleagues provide a systemic approach to studying the validity of scores of mathematical knowledge for teaching. This system encompasses an array of task formats and methodologies. The…

This reply to William A. Mehrens argues that test validity is the central issue in discussing the appropriate role of tests. It states that the procedures used to establish the validity of tests are inadequate because they depend primarily on content validity and not on construct and criterion validity. (JAZ)

Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…