Student Evaluations of Teaching (SETs) gather crucial feedback on student experiences of teaching and learning and have been used for decades to evaluate the quality of teaching and student experience of instruction. In this paper, we make the case for an important improvement to the analysis of SET data that can further refine its interpretation.…

In the Early Childhood Education and Care (ECEC) sector there is a move to reduce oversight costs by reducing the frequency of quality assessments in providers who score highly consistently across time. However, virtually nothing is known about the stability of ECEC quality assessments over time. Using a validated measure of overall classroom…

The use of the aggregate scoring method for scoring concordance tests requires the weighting of test items to be derived from the performance of a group of experts who take the test under the same conditions as the examinees. However, the average score of experts constituting the reference panel remains a critical issue in the use of these tests.…

Purpose: To gain a better understanding of the assessment practices currently implemented by Quebec physical education teachers regarding reporting and grading. Method: Exploratory mixed-methods study using semistructured interviews (n = 13), interviews to the double (n = 12), and a questionnaire (n = 164) with elementary and high school physical…

We evaluated structural, construct, and concurrent validity evidence for State-Interpersonal Reactivity Index scores among 208 telemental health counselors. Confirmatory factor analysis results supported a three-factor model. Partial correlation analyses yielded evidence for construct and concurrent validity evidence for scores. We discuss…

Psychoeducational assessments provide clinicians with the foundation for diagnostic determinations and meaningful recommendations for youth with neurodevelopmental disorders. Due to the COVID-19 pandemic, the field shifted from seeing clients face-to-face (FTF) to conducting evaluations virtually via teleneuropsychology (TNP) in the client's own…

AI-based simulations for educational and assessment purposes are gaining global recognition. Informed by cultural comparison research, this study investigates cross-country variations in users' utilization and perceptions of a simulation-based assessment. Specifically, we conducted a comparative analysis between a sample of South African and…

In Canada, high stakes objective structured clinical examinations (OSCEs) administered by the Medical Council of Canada have relied exclusively on physician examiners (PEs) for scoring. Prior research has looked at using SPs to replace PEs. This paper reports on two studies that implement and evaluate a standardized patient (SP) scoring tool to…

This study examined the oral language skills of grade-two anglophone children enrolled in French Immersion and English-stream programs. The study had two objectives: (1) to compare performance between the groups on measures of receptive vocabulary, narrative comprehension, and narrative production (i.e., structure and language) in English; and (2)…

There is a broad literature in multiple-choice test development, both in terms of item-writing guidelines, and psychometric functionality as a measurement tool. However, most of the published literature concerns multiple-choice testing in the context of expert-designed high-stakes standardized assessments, with little attention being paid to the…

There are positive feedback loops between students' grades and emotions. However, subjective appraisals, not grades, are theorized to trigger emotions. We extended previous research by comparing the effects of objective score and subjective appraisals of the score (i.e., satisfaction) on emotions. We used an ecologically-valid quasi-experimental…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

Most Canadian universities participate in the US-based National Survey of Student Engagement (NSSE) that measures various aspects of "student engagement." The higher the level of engagement, the greater the probability of positive outcomes and the better the quality of the school. "Maclean's" magazine publishes some of the…

While Ontario has received international accolades for its enactment of province-wide standardised testing upon the formation of the Education Quality and Accountability Office (EQAO), a closer look at provincial assessments over a 20-year span reveals successes as well as systemic tensions and fissures. The purpose of this paper is twofold.…

Purpose: The purpose of this paper is to utilize the Objective Knowledge Growth Framework (OKGF) to promote a better understanding of the evaluating tenure and promotion processes. Design/Methodology/Approach: A scenario is created to illustrate the concept of using OKGF. Findings: The framework aims to support decision makers in identifying the…