In their examination of the effectiveness of affect regulation strategies, Webb, Miles, and Sheeran (2012) offered the results of a broad meta-analysis of studies on regulatory interventions. Their analysis provides an alternative to our earlier, more focused meta-analysis of the affect regulation literature (Augustine & Hemenover, 2009).…

There are three fundamental problems in Sijtsma ("Psychometrika," 2008): (1) contrary to the name, the glb is not the greatest lower bound of reliability but rather is systematically less than omega[subscript t] (McDonald, "Test theory: A unified treatment," Erlbaum, Hillsdale, 1999), (2) we agree with Sijtsma that when considering how well a test…

The 12th annual William H. Angoff Memorial Lecture was presented by Dr. Michael T. Kane, ETS's (Educational Testing Service) Samuel J. Messick Chair in Test Validity and the former Director of Research at the National Conference of Bar Examiners. Dr. Kane argues that it is important for policymakers to recognize the impact of errors of measurement…

During the past 30 years many pediatric assessment and outcome measures have been developed. Based on Rasch analysis, the Pediatric Evaluation of Disability Inventory (PEDI) was designed to measure functional status by asking parents about both the skills of their children and the performance of daily tasks in three functionally important domains…

In 2006, C. F. Bond Jr. and B. M. DePaulo provided a meta-analysis of means and concluded that average lie detection accuracy was significantly greater than chance for most people. Now, they have presented an analysis of standard deviations (C. F. Bond Jr. & B. M. DePaulo, 2008), claiming that there are no reliable individual differences in lie…

People can use a variety of different strategies to perform tasks and these strategies all have two characteristics in common. First, they can be evaluated in comparison with either an absolute or a relative standard. Second, they can be used at varying levels of consistency. In the present article, the authors develop a general theory of task…

In this article I examine the consequences of the dominance of intuitive thinking in moral judging and deciding for the role of moral reasoning in moral education. I argue that evidence for the reliability of moral intuitions is lacking. We cannot determine when we can trust our intuitive moral judgements. Deliberate and critical reasoning is…

In this commentary, the authors discuss some of the issues regarding the use of diagnostic classification models that practitioners should keep in mind. In the authors experience, these issues are not as well known as they should be. The authors then provide recommendations on diagnostic scoring.

Presents a critical appraisal of resilience, a construct connoting the maintenance of positive adaptation by individuals despite significant adversity. Addresses common criticisms, proposes solutions for those considered legitimate, and clarifies misunderstandings surrounding less valid criticisms. Concludes that work on resilience possesses…

The role of theory in the restructuring of schools and curriculum is discussed. Theory is defined as a set of assumptions from which laws or principles may be derived. The descriptive, analytical, and predictive characteristics of theory are described. The examination of the relationship of theory to practice leads to the conclusion that they are…

This paper contends that behavior observation data relating to speech-language pathology are reliable if they are not affected by differences among observers or other variations in the recording context. The theoretical bases of methods used to estimate reliability for observational data are reviewed, and suggestions are provided for improving the…

Discusses the conditions for validating customary phylogenetic procedures. Concludes that the requisites of homogeneity and completeness for proved short lineages seem satisfied by the Hennigian but not the Haeckelian procedure. The epistemological antinomy of the two procedures is emphasized for the first time. (Author/RH)

Arguments are presented for conceptualizing validity within a postmodern approach. Validity, reliability, and generalizability have been a holy trinity of social science research, and standard definitions of validity have been taken from criteria developed for psychometric tests. From a postmodern point of view, validity is sometimes discarded as…

A study examined identification and consistency theory of interface between rhetorical and communication theory, to demonstrate the compatibility of specific principles in Kenneth Burke's theory with those in the work of Fritz Heider and other consistency theorists and to make suggestions toward a Burkeian theory of identification through…

This essay argues that reliability should be reconceptualized in a way that reflects the importance of the theoretical expectations of the test specialist and the learning and problem solving of the test takers. It is time to characterize clearly the substantive theoretical framework supporting reliability studies and the technical evaluation of…