In using the Rasch model to improve the quality of an instrument, analysis purports to determine if the sample collaborates well with the items in the instrument such that the results are measuring a single underlying variable. The relevant properties of Rasch analysis are reliability and validity which are key indicators of the quality of a…

One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

The model presented in this article aspires to represent a theoretically valid and coherent definition and description of writing, as a basis for teaching and assessing writing as a key competency in school. It represents a critique as well as an extension of previous alternatives in that it views writing as a culturally and individually…

The notion of validity in the social sciences is evolving and is influenced by philosophy of science, critiques of objectivity, and epistemological debates. Methodology for validation of the knowledge claims is diverse across different philosophies of science. In other words, definition and the way to establish of validity have evolved as…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

Educational measurement is generally thought of as empirical, quantitative, and large-scale, whose purpose is to monitor educational systems. Sociocognitive studies, on the other hand, are associated with small-scale, theoretical, and qualitative studies, the purpose of which is to conduct fine-grained analysis of learning or teaching, or to…

This article discusses the development of a scale informed by the construct of emotional intelligence designed to measure student development outcomes identified as co-curricular goals. Supervisors, staff, and coaches provided firsthand accounts of student development outcomes at a small, private, liberal arts work college, generating data on…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

The reactions by Ridley and Shaw-Ridley (EJ832451) and Lichtenberg (EJ832452) to the authors' meta-analysis on the effects of experience on judgment accuracy add positively to what is hoped will become an ever more focused discourse on this most basic question: How can mental health clinical decision making be improved? In this rejoinder, the…

The authors describe the development and validation of the Avoidance and Fusion Questionnaire for Youth (AFQ-Y), a child-report measure of psychological inflexibility engendered by high levels of cognitive fusion and experiential avoidance. Consistent with the theory underlying acceptance and commitment therapy (ACT), items converged into a…

The distinction between automatic processes and controlled processes is a central organizational theme across areas of psychology. However, this dichotomy conceals important differences among qualitatively different processes that independently contribute to ongoing behavior. The Quadruple process model is a multinomial model that provides…

Developing instruments to assess teacher competence requires a model of competent performance which can guide both the collection and appraisal of evidence in task situations. Following Kane (1992), the validation of statements about teachers' competence is regarded as the evaluation of interpretive argumentation. Based on contemporary insights…

Although hypochondriasis is associated with the costly use of unnecessary medical resources, this mental health problem remains largely neglected. A lack of clear conceptual models and valid measures has impeded accurate assessment and hindered progress. The Multidimensional Inventory of Hypochondriacal Traits (MIHT) addresses these deficiencies…

The paper reviews a construct validation framework for research on the selection and evaluation of residents. The application of the proposed methodology to surgery residents is described. The need to measure non-cognitive and neuropsychological factors in addition to cognitive knowledge and technical ability is emphasized. (Author/MLW)