Empirical research in education has largely adopted quantitative approaches to measure teachers' and students' perceptions of fairness and justice in classroom contexts. The purpose of this study is to understand the validity evidence of fairness and justice instruments including how fairness and justice have been conceptualized in measures.…

The Cognitive Test Anxiety Scale (CTAS) is a unidimensional scale designed to measure the cognitive aspect of test anxiety. The instrument has been adapted in several countries, and convincing psychometric properties have been found; however, uncertainties remain regarding its factor structure. Therefore, the aim of this study is twofold: to…

Validity is critical for meaningful assessment of surgical competency. According to the Standards for Educational and Psychological Testing, validation involves the integration of data from well-defined classifications of evidence. In the authoritative framework, data from all classifications support construct validity claims. The two aims of this…

It is widely believed that subscores can give us more information about an examinee. Thus they can be useful in planning instructional and remedial efforts, or making vocational or academic placement decisions. However, past research has shown that subscores are often not as useful as hoped either because they do not have high reliability or…

The "best available evidence" is one of the three basic inputs into evidence-based practice. This paper sets out a framework for evaluating the quality of systematic reviews that are intended to identify empirically supported interventions as a way of summarizing the best available evidence. The premise of this paper is that the process of…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

This article examines the Consortium on Reading Excellence-Phonics Survey (CORE-PS), an informal, inexpensive, and widely disseminated assessment tool that is used to determine primary-grade students' knowledge of and abilities to apply key alphabetic and phonics understandings to decode a mix of real and pseudo-words. Evidence is reported of the…

In a recent article, Nadelson and Southerland (2010. Development and preliminary evaluation of the Measure of Understanding of Macroevolution: Introducing the MUM. "The Journal of Experimental Education", 78, 151-190) reported on their development of a multiple-choice concept inventory intended to assess college students' understanding…

To validate an interpretation or use of test scores is to evaluate the plausibility of the claims based on the scores. An argument-based approach to validation suggests that the claims based on the test scores be outlined as an argument that specifies the inferences and supporting assumptions needed to get from test responses to score-based…

The 1999 "Standards for Educational and Psychological Testing" defines validity as the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests. Although quite explicit, there are ways in which this definition lacks precision, consistency, and clarity. The history of validity has taught us…

This study explores factors related to the language learning strategies of second language learners, specifically Generation 1.5 Korean immigrant students--the seventh-largest and one of the fastest growing foreign-born groups in the USA. Participants in this study were members of the Korean communities located in Pittsburgh and Philadelphia who…

Inappropriate or excessive guilt is listed as a symptom of depression by the American Psychiatric Association ("1994"). Although many measures of guilt have been developed, definitional and operational problems exist, especially in the application of such measures in childhood and adolescence. To address these problems, the current study…

Despite the importance of work values in the process of career adjustment (Dawis, 2002), little empirical research has focused on articulating the domains represented within the construct of work values and the examination of evidence of validity for the construct has been limited. Furthermore, the larger number of work values measures has made it…

When a self-report instrument includes a balanced number of positively and negatively worded items, factor analysts often use method factors to aid model fitting. The nature of these factors, often referred to as acquiescence, is still debated. Relying upon previous results (Alessandri et al., 2010; DiStefano & Motl, 2006, 2008; Rauch, Schweizer,…

An attempt was made to modify the Gambling Functional Assessment (GFA), which was proposed to identify four possible contingencies maintaining the respondent's gambling behavior. However, previous research found that it only identified two contingencies (i.e., positive vs. negative reinforcement), with some items cross-loading on both…