This article presents the authors' response to the discussants of their article "A Suggested Change in Terminology and Emphasis Regarding Validity and Education" (this issue)--Susan E. Embretson, Joanna S. Gorin, Robert J. Mislevy, Pamela A. Moss, and Stephen G. Sireci. Their response is limited to a brief summarization of their position…

In response to Lissitz and Samuelsen (2007), the author reconstructs the historical arguments for the more comprehensive unitary concept of validity and the principles of scientific inquiry underlying it. Her response is organized in terms of four questions: (a) How did validity in educational measurement come to be conceptualized as unitary, and…

Lissitz and Samuelsen (2007) propose a new framework for validity theory and terminology, emphasizing a shift in theory and practice toward issues of test content rather than constructs. The author of this article argues that several of Lissitz and Samuelsen's critiques of validity theory focus on previously considered, but subsequently discarded,…

This is a reaction to Borsboom's (2006) discussion paper on the issue that psychology takes so little notice of the modern developments in psychometrics, in particular, latent variable methods. Contrary to Borsboom, it is argued that latent variables are summaries of interesting data properties, that construct validation should involve studying…

Need for closure, as formulated by Kruglanski and colleagues [Kruglanski, A. W. (1990). Lay epistemic theory in social-cognitive psychology. "Psychological Inquiry," 1(3), 181-197; Kruglanski, A. W., & Webster, D. M. (1996). Motivated closing of the mind: Seizing and freezing. "Psychological Review," 103, 263-283; Webster,…

The purpose of this article is to contribute to the discussion concerning the value and validity of fiction, and arts-based approaches more broadly, as research. I offer this contribution through a narrative: "Conference Story." The narrative involves its characters, in an Oxford pub, debating the merits and otherwise of Peter Clough's (2002)…

Comments on the article by B. Gawronski and G. V. Bodenhausen (see record 2006-10465-003). A metacognitive model (MCM) is presented to describe how automatic (implicit) and deliberative (explicit) measures of attitudes respond to change attempts. The model assumes that contemporary implicit measures tap quick evaluative associations, whereas…

Gardner [Gardner, H. (2006-this issue). On failing to grasp the core of MI theory: A response to Visser et al. "Intelligence"] criticized some aspects of our empirical examination [Visser, B. A., Ashton, M. C., & Vernon, P. A. (2006-this issue). Beyond "g": Putting multiple intelligences theory to the test. "Intelligence"] of his "Theory of…

Borsboom (2006) attacks psychologists for failing to incorporate psychometric advances in their work, discusses factors that contribute to this regrettable situation, and offers suggestions for ameliorating it. This commentary applauds Borsboom for calling the field to task on this issue and notes additional problems in the field regarding…

Though construct validity is widely employed in educational research, it is a difficult and confusing topic in methodology, and it is not clear whether all researchers share the same understanding. This essay describes origins of construct validity and suggests a plan for updating its foundations. (MT)

Discusses design and evaluation concepts and methodologies in the context of comprehensive system design (CSD) and considers the concept of error throughout. Topics addressed include six core concepts of CSD; design processes; evaluation concepts; evaluation processes, including criterion-related validity, construct validity, and systemic…

The Implicit Association Test (IAT) requires responding to category contrasts such as young versus old, male versus female, and pleasant versus unpleasant. In introducing the IAT, A. G. Greenwald, D. E. McGhee, and J. L. K. Schwartz (1998) proposed that IAT measures reflect mental structures involving the nominal features of the IAT's categories…

To validate a measure of a construct is to validate a theory: The process includes theory specification, theory elaboration, choice of methods, choice of research design, reliance on necessary auxiliary theories, and empirical observation. Evaluating the success of the process is likely to be enhanced through quantification. To date, scientists…

Verleger, Jaskowski, Aydemir, van der Lubbe, and Groen (see record 2004-21166-002) and Lleras and Enns (see record 2004-21166-001) have argued that negative compatibility effects (NCEs) obtained with masked primes do not reflect self-inhibition processes in motor control. Instead, NCEs are assumed to reflect activation of the response opposite to…

Explores the erroneous assumptions underlying Burleson's criticism of Beatty and Payne and examines in context the evidence selected by Burleson to support his criticism. (NKA)