Empirical research in education has largely adopted quantitative approaches to measure teachers' and students' perceptions of fairness and justice in classroom contexts. The purpose of this study is to understand the validity evidence of fairness and justice instruments including how fairness and justice have been conceptualized in measures.…

Goal attainment scaling (GAS) is an internationally recognized measure that is widely used in educational, counseling, and clinical settings to identify and evaluate relevant goals for an individual. The GAS is an unusual measure because its content, which consists of goals, is formed by the respondent and/or users in the process of completing the…

Background: The positive youth development (PYD) framework orients developmental scholarship to focusing on youth's strengths rather than deficits, however, validity evidence on PYD measures among ethnic-minority youth is limited. Objectives: The objectives of the current study were to (a) examine the factor structure of a PYD measure within a…

The Cognitive Test Anxiety Scale (CTAS) is a unidimensional scale designed to measure the cognitive aspect of test anxiety. The instrument has been adapted in several countries, and convincing psychometric properties have been found; however, uncertainties remain regarding its factor structure. Therefore, the aim of this study is twofold: to…

This article draws on argument-based validation to gather and evaluate construct-related evidence (i.e., the explanation inference) of a high-stakes test. The data stemmed from the listening component of a French test used for immigration to Canada through the province of Quebec. An expert panel with varied backgrounds in applied linguistics…

Background: There is an agreement that the methodological quality of randomized trials should be assessed in systematic reviews, but there is a debate on how this should be done. We conducted a construct validation study of the Physiotherapy Evidence Database (PEDro) scale, which is widely used to assess the quality of trials in physical therapy…

We describe the use of think alouds to examine substantive processes involved in performance on a formative assessment of computational thinking (CT) designed to support self-regulated learning (SRL). Our task design model included three phases of work on a computational thinking problem: forethought, performance, and reflection. The cognitive…

This report provides a brief overview of how the "TOEIC"® program has adopted an argument-based approach to validity in order to support the use of the TOEIC tests. This approach emphasizes the need to explicitly state claims about the measurement quality and intended use of a test and to support those claims with evidence. This report…

Validity is critical for meaningful assessment of surgical competency. According to the Standards for Educational and Psychological Testing, validation involves the integration of data from well-defined classifications of evidence. In the authoritative framework, data from all classifications support construct validity claims. The two aims of this…

It is widely believed that subscores can give us more information about an examinee. Thus they can be useful in planning instructional and remedial efforts, or making vocational or academic placement decisions. However, past research has shown that subscores are often not as useful as hoped either because they do not have high reliability or…

The "AssessToday" observation protocol was created to measure teachers' use of short-cycle formative assessment through observation of teachers in a single instructional period. This classroom observation instrument utilized seven dimensions: "learning target, question quality, nature of questioning, self-evaluation,…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

This study presents the reliability and validity of the Teacher Evaluation Experience Scale--Teacher Form (TEES-T), a multidimensional measure of educators' attitudes and beliefs about teacher evaluation. Confirmatory factor analyses of data from 583 teachers were conducted on the TEES-T hypothesized five-factor model, as well as on alternative…

Portfolio assessment (PA) has been extensively adopted for writing development in the past three decades. Much research on PA primarily investigates students' and teachers' perceptions of its benefits, and how it influences students' motivation and general writing abilities. Despite its purported effectiveness, not much has been…

The Hellenic WISC-III (Wechsler, 1997) is currently the only standardized and officially published tool for the assessment of the intelligence of children and adolescents in Greece. The test is also used with caution in Cyprus, among Greek speakers, but no specific norms exist for use in this country. The purpose of this study was to provide…