In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Students entering English-medium universities around the world come from diverse linguistic backgrounds and many find it difficult to cope with the language demands of their degree courses. This speech focuses first on the motivations for introducing what are known in Australia as post-entry language assessments (PELAs). I discuss in particular…

The notion of validity in the social sciences is evolving and is influenced by philosophy of science, critiques of objectivity, and epistemological debates. Methodology for validation of the knowledge claims is diverse across different philosophies of science. In other words, definition and the way to establish of validity have evolved as…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

The 1999 "Standards for Educational and Psychological Testing" defines validity as the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests. Although quite explicit, there are ways in which this definition lacks precision, consistency, and clarity. The history of validity has taught us…

This article describes the development and validation of a six-scale survey to assess school climate in terms of students' perceptions of the degree to which they feel welcome and connected, together with a scale to assess students' perceptions of bullying. The development of each survey involved a multi-stage approach, including: 1) an extensive…

The rise in the prevalence of autism creates a need for a reliable and valid measure of attitudes towards autism. The current study describes the development of a brief 16-item measure of Societal Attitudes towards Autism (SATA) that exhibits sound psychometric properties and has a demonstrated ability to discriminate between expert and general…

The Career Adapt-Abilities Scale--South African Form (CAAS) consists of four scales, each with six items that measure concern, control, curiosity, and confidence as psychosocial resources for managing occupational transitions, developmental tasks and work traumas. Internal consistency estimates for the subscale and total scores ranged from good to…

This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is…

The construct of social justice in counseling is defined and operationalized in this article. This is followed by a discussion about the intersection between social justice in counseling and philosophy, ethics, and spirituality. A call to action for counseling professionals is offered. (Contains 1 figure.)

The reemergence of positive psychology in the past 15 years has brought a renewed focus on psychological dispositions such as gratitude and their relationship to youth's subjective well-being and academic achievement. Similarly, youth development and developmental asset literatures have emphasized the value of examining youth positive…

The Buddhist construct of mindfulness is a central element of mindfulness-based interventions and derives from an age-old systematic phenomenological program to investigate subjective experience. Recent enthusiasm for "mindfulness" in psychology has resulted in proliferation of self-report inventories that purport to measure mindful awareness as a…

The dangers of a single story in current U.S. large-scale writing assessment are that assessment practice does not align with theory and this practice has negative effects on instruction and students. In this article, I analyze the connections or lack of connections among writing theory, writing assessment, and writing instruction, critique the…

This article describes the logic and procedures behind testing for factorial invariance across groups in the context of construct validation. The procedures include testing for configural, measurement, and structural invariance in the framework of multiple-group confirmatory factor analysis (CFA). The "forward" (sequential constraint imposition)…