Virtual learning environments (VLEs) are increasingly used at-scale in educational contexts to facilitate teaching and promote learning, and the data they produce can be used for educational research purposes. Meanwhile, the U.S. Department of Education's Office of Educational Technology has repeatedly emphasized the importance of using evidence…

Virtual learning environments (VLE) are increasingly used at-scale in educational contexts to facilitate teaching and promote learning, and the data they produce can be used for educational research purposes. Meanwhile, the U.S. Department of Education's Office of Educational Technology has repeatedly emphasized the importance of using evidence to…

The goal of this special issue is to examine the use of self-report measures in the study of motivation and strategy use. This commentary reviews the articles contained in this special issue to address the primary objective of determining if and when self-report measures contribute to understanding these major constructs involved in self-regulated…

A common theme running through recent research on Situational Judgment Tests (SJTs) and this special issue is the aim to improve the measurement of constructs via SJTs. Construct-driven SJTs differ from traditional SJTs in that they present a trait activating situation to test-takers and a more unidimensional set of response options that depict…

The authors of the focus article describe an important issue related to the use and interpretation of causal indicators within the context of structural equation modeling (SEM). In the focus article, the authors illustrate with simulated data the effects of omitting a causal indicator. Since SEMs are used extensively in the social and behavioral…

Keith Marcus congratulates Almond et al. on an interesting article bringing together two topics that are important to the field of testing. He states that some aspects of the exposition came across as not yet fully developed, as if the manuscript had been hurried to press. In this commentary, he attempts to expand aspects of the article, which he…

In this response to "Measuring Students' Writing Ability on a Computer Analytic Developmental Scale: An Exploratory Validity Study," the authors agree that assessments should seek parsimony in both theory and application wherever possible. Doing so allows maximal dissemination and implementation while minimizing costs. The Writing…

There is something about the topic of validity that seems to provoke dissatisfaction in many of those who encounter it--a sense that something is not right, and that something needs to be done to sort it out. Paul E. Newton in his target essay does not attempt a radical reconstruction of the validity edifice. His position is that the "consensus…

As illuminated forcefully by Professor Newton's provocative analytical and historical excursion, as long as tests are employed to practical ends (prediction, selection, etc.) there is little cause for the metatheoretic angst that occasions rounds of papers on the topic of validity. But then, also, there seems little need, within this context of…

For the last century, there has been a continuing debate about the nature of emotion. In the most recent offering in this scientific dialogue, Lench, Flores, and Bench (2011) reported a meta-analysis of emotion induction research and claimed support for the natural kind hypothesis that discrete emotions (e.g., happiness, sadness, anger, and…

Paul E. Newton's article on the consensus definition of validity tackles a number of big issues and makes a number of strong claims. I agreed with much of what he said, and I disagreed with a number of his claims, but I found his article to be consistently interesting and thought provoking (whether I agreed or not). I will focus on three general…

This commentary on the article titled "Examining the Internal Structure Evidence for the Performance Assessment for California Teachers: A Validation Study of the Elementary Literacy Teaching Event for Tier 1 Teacher Licensure" provides an overview of Performance Assessment for California Teachers (PACT), its relationship to edTPA and…

"Game-Based Assessments: A Promising Way to Create Idiographic Perspectives" (Adrienne Walker and George Englehard) comments on: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" by Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute. Here, Walker and Englehard write…

This paper presents the authors' critique on "Clarifying the Consensus Definition of Validity" by Paul E. Newton (this issue). There are serious differences of opinion regarding the topic of validity. Newton is aware of these differences, as made clear by his choice of references and particularly his effort to respond to the various Borsboom…

Lillard et al. (2013) concluded that pretend play is not causally related to child outcomes and charged that the field is subject to a "play ethos", whereby research is tainted by a bias to find positive effects of play on child development. In this commentary, we embrace their call for a more solidly scientific approach to questions in this…