Empirical research in education has largely adopted quantitative approaches to measure teachers' and students' perceptions of fairness and justice in classroom contexts. The purpose of this study is to understand the validity evidence of fairness and justice instruments including how fairness and justice have been conceptualized in measures.…

Goal attainment scaling (GAS) is an internationally recognized measure that is widely used in educational, counseling, and clinical settings to identify and evaluate relevant goals for an individual. The GAS is an unusual measure because its content, which consists of goals, is formed by the respondent and/or users in the process of completing the…

Background: The positive youth development (PYD) framework orients developmental scholarship to focusing on youth's strengths rather than deficits, however, validity evidence on PYD measures among ethnic-minority youth is limited. Objectives: The objectives of the current study were to (a) examine the factor structure of a PYD measure within a…

The Cognitive Test Anxiety Scale (CTAS) is a unidimensional scale designed to measure the cognitive aspect of test anxiety. The instrument has been adapted in several countries, and convincing psychometric properties have been found; however, uncertainties remain regarding its factor structure. Therefore, the aim of this study is twofold: to…

This article draws on argument-based validation to gather and evaluate construct-related evidence (i.e., the explanation inference) of a high-stakes test. The data stemmed from the listening component of a French test used for immigration to Canada through the province of Quebec. An expert panel with varied backgrounds in applied linguistics…

Background: There is an agreement that the methodological quality of randomized trials should be assessed in systematic reviews, but there is a debate on how this should be done. We conducted a construct validation study of the Physiotherapy Evidence Database (PEDro) scale, which is widely used to assess the quality of trials in physical therapy…

We describe the use of think alouds to examine substantive processes involved in performance on a formative assessment of computational thinking (CT) designed to support self-regulated learning (SRL). Our task design model included three phases of work on a computational thinking problem: forethought, performance, and reflection. The cognitive…

This report provides a brief overview of how the "TOEIC"® program has adopted an argument-based approach to validity in order to support the use of the TOEIC tests. This approach emphasizes the need to explicitly state claims about the measurement quality and intended use of a test and to support those claims with evidence. This report…

The "AssessToday" observation protocol was created to measure teachers' use of short-cycle formative assessment through observation of teachers in a single instructional period. This classroom observation instrument utilized seven dimensions: "learning target, question quality, nature of questioning, self-evaluation,…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

This study presents the reliability and validity of the Teacher Evaluation Experience Scale--Teacher Form (TEES-T), a multidimensional measure of educators' attitudes and beliefs about teacher evaluation. Confirmatory factor analyses of data from 583 teachers were conducted on the TEES-T hypothesized five-factor model, as well as on alternative…

The Hellenic WISC-III (Wechsler, 1997) is currently the only standardized and officially published tool for the assessment of the intelligence of children and adolescents in Greece. The test is also used with caution in Cyprus, among Greek speakers, but no specific norms exist for use in this country. The purpose of this study was to provide…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…