The typical process for assessing inter-rater reliability is facilitated by training raters within a research team. Lacking is an understanding if inter-rater reliability scores "between" research teams demonstrate adequate reliability. This study examined inter-rater reliability between 16 researchers who assessed fundamental motor…

Background: Individuals with dementia have communication limitations resulting from cognitive impairments that define the syndrome. Whereas there are numerous cognitive assessments for individuals with dementia, there are far fewer communication assessments. The Profiling Communication Ability in Dementia (P-CAD) was developed to address this gap.…

There is a strong and growing focus on self-determination in French-speaking countries, and this pilot study reports the technical adequacy of the Self-Determination Inventory: Student Report (SDI:SR) French Translation. Data were collected with 471 French-speaking youth with and without disabilities in Canada (Quebec), Switzerland, France, and…

We evaluated structural, construct, and concurrent validity evidence for State-Interpersonal Reactivity Index scores among 208 telemental health counselors. Confirmatory factor analysis results supported a three-factor model. Partial correlation analyses yielded evidence for construct and concurrent validity evidence for scores. We discuss…

Few and fairly limited measures of public energy literacy exist, especially in the Canadian context. We argue that more needs to be known about the public with respect to their energy-related literacy, given their increasing involvement as informants to and participants in energy systems and sustainability transitions. In this article, we describe…

Student Evaluations of Teaching (SETs) gather crucial feedback on student experiences of teaching and learning and have been used for decades to evaluate the quality of teaching and student experience of instruction. In this paper, we make the case for an important improvement to the analysis of SET data that can further refine its interpretation.…

Both school and district administrators use the results of standardized, large-scale tests to inform decisions about the need for, or success of, educational programs and interventions. However, test results at the school level are subject to random fluctuations due to changes in cohort, test items, and other factors outside of the school's…

There is a broad literature in multiple-choice test development, both in terms of item-writing guidelines, and psychometric functionality as a measurement tool. However, most of the published literature concerns multiple-choice testing in the context of expert-designed high-stakes standardized assessments, with little attention being paid to the…

Children's oral language proficiency (OLP) is integral for developing literacy skills. Storytelling or retelling is often used by parents and educators to elicit children's OLP, yet it is less commonly used for assessment purposes. Leveraged by natural language processing and machine learning, this study examined the extent to which computational…

Validity of a measurement refers to appropriate test score meanings, uses, and interpretations (Messick, 1989; Kane, 1992). There are different approaches to validity: an evidentiary aspect of validity is one requiring gathering statistical evidence to evaluate test score meaning. A common approach to validation is comparisons of test score equity…

The reliability and factorial validity of the Wechsler Intelligence Scale for Children--Fifth Edition: Canadian (WISC-V[superscript CDN]) was investigated. The higher-order model preferred by Wechsler (2014b) contained five group factors but lacked discriminant validity. An alternative bifactor model with four group factors and one general factor,…

Background: While empirical testing of many of the interRAI Child and Youth Mental Health (ChYMH) assessment scales have been found to be reliable and valid across both child and adult samples, other scales have yet to be psychometrically evaluated within child populations. Objective: The current study evaluates the psychometric properties of the…

The psychometric properties of a new multidimensional measure of test anxiety, the Test Anxiety Measure for College Students (TAM-C), based on theory and current research were examined in a sample of 312 Canadian college students online. The TAM-C consists of a Facilitating Anxiety scale and five test anxiety (Cognitive Interference, Physiological…

Existing measures of test anxiety used with the college student population are old with old norms and old items, and they do not capture the multiple dimensions of the test anxiety construct or assess facilitating anxiety. In the present study, the validity of the scores of a new, multidimensional measure of test anxiety with a facilitating…

The study of dispositions for effective teaching has become a key topic in education. Diverse characteristics, skills, and behaviors have been proposed as centrally important. Nevertheless, little work has been done on evaluating these disparate claims, or whether importance varies across primary and secondary teaching contexts. We address these…