This article draws on argument-based validation to gather and evaluate construct-related evidence (i.e., the explanation inference) of a high-stakes test. The data stemmed from the listening component of a French test used for immigration to Canada through the province of Quebec. An expert panel with varied backgrounds in applied linguistics…

Validity of a measurement refers to appropriate test score meanings, uses, and interpretations (Messick, 1989; Kane, 1992). There are different approaches to validity: an evidentiary aspect of validity is one requiring gathering statistical evidence to evaluate test score meaning. A common approach to validation is comparisons of test score equity…

This study examines the construct validity of the First-Year Inventory 2.0 with respect to other established instruments in a sample of high-risk infant siblings of children with Autism Spectrum Disorder. The First-Year Inventory 2.0 is a parent-report screening instrument designed to identify 12-month-old infants at risk for an eventual diagnosis…

Despite advances in child maltreatment research, accurate measurement of exposure remains a key issue. In this study, we evaluated a short form (CEVQ-SF) of the Childhood Experiences of Violence Questionnaire (CEVQ) in a sample of adolescents involved with child protection services in an urban city in Ontario, Canada. Focusing on the two most…

The goal of this study was to create and validate a brief multidimensional scale of teacher engagement--the Engaged Teachers Scale (ETS)--that reflects the particular characteristics of teachers' work in classrooms and schools. We collected data from three separate samples of teachers (total N = 810), and followed five steps in developing and…

Using generalizability (G-) theory, this study examined the accuracy and validity of the writing scores assigned to secondary school ESL students in the provincial English examinations in Canada. The major research question that guided this study was: Are there any differences between the accuracy and construct validity of the analytic scores…

The present study, using a sample of 1,491 grade 10 students from a mid-western province in Canada, examined the validity evidence on the Canadian Tests of Basic Skills. Factor analysis of the 34 micro-skills (content by skill/process classification of items) of the four tests indicated that the Reading Comprehension, Written Expression, and Using…

The design and evaluation of a rating scale for program evaluation in problem-based medical curricula are described. The design process was guided by a theory of how students learn in problem-based learning as modeled by W. H. Gijselaers and H. G. Schmidt (1988). The rating scale was used in an evaluation of a new problem-based, community-oriented…