The typical process for assessing inter-rater reliability is facilitated by training raters within a research team. Lacking is an understanding if inter-rater reliability scores "between" research teams demonstrate adequate reliability. This study examined inter-rater reliability between 16 researchers who assessed fundamental motor…

We evaluated structural, construct, and concurrent validity evidence for State-Interpersonal Reactivity Index scores among 208 telemental health counselors. Confirmatory factor analysis results supported a three-factor model. Partial correlation analyses yielded evidence for construct and concurrent validity evidence for scores. We discuss…

Instability in early childhood education and care (ECEC) arrangements may have detrimental consequences on children's mental health. This study examined ECEC trajectories in the first 30 months of life for 373 children from low-income families in Toronto. We provide information about patterns of instability and reasons for instability. We also…

Research Findings: A growing number of stakeholders in early childhood education (ECE) rely on self-assessment to assess and improve the quality of ECE. In this systematic review, we investigated the reliability and validity of self-assessment in ECE, summarizing findings from 27 publications. We meta-analytically synthesized findings from 25…

Variability is underemphasized in domains such as engineering. Statistics and data science education research offers a variety of frameworks for understanding variability, but new frameworks for domain applications are necessary. This study investigated the professional practices of working engineers to develop such a framework. The Neglected,…

Following 20 years of publishing rank and reputation scores for Canada's 49 institutions of higher education, the present analysis tested five hypotheses: (1) rank and reputation should be positively correlated across schools for each year; (2) rank and reputation should be positively correlated across the 20 years for each school; (3) a school's…

This study aimed to expand the psychometric properties of the Theory Evaluation Scale (TES), specifically its structure, construct validity, and internal consistency. A demographically diverse sample of 113 social work faculty (N = 113) utilized the TES to appraise a social work theory and their responses were used for exploratory factor analysis…

Student Evaluations of Teaching (SETs) gather crucial feedback on student experiences of teaching and learning and have been used for decades to evaluate the quality of teaching and student experience of instruction. In this paper, we make the case for an important improvement to the analysis of SET data that can further refine its interpretation.…

Early childhood educators (ECEs) play a vital role in encouraging healthy physical activity (PA) in childcare. As such, measuring ECEs' self-efficacy to facilitate such programming is important. The "ECE Confidence in Outdoor Movement, PA, and Sedentary and Screen Behaviors" (ECE-COMPASS) questionnaire (30 items) was developed via expert…

In Saskatchewan, school divisions have been largely tasked with creating classroom-based assessment policy as, until very recently, the province lacked a current, Ministry-produced guiding document. Using an inductive and qualitative approach to summative content analysis, informed by a policy analysis framework, this project focused on school…

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

The problem investigated was many junior high teachers do not consistently implement technology-based gamification (TBG) within class activities despite evidence showing it as a useful learning tool for student engagement. This study aimed to explore why junior high teachers do not consistently implement TBG and identify the barriers and potential…

Children have repeatedly been shown to selectively prefer to learn from previously accurate informants rather than those who have been inaccurate in the past. However, the stability of individual differences in performance on such tasks has yet to be studied. We presented preschoolers with two identical selective learning tasks conducted one week…

This study proposes a multi-informant (youth, teachers, and parents) measure of relationship quality with adults for youth with intellectual disabilities (ID). A sample of 395 youth with mild (49.15%) and moderate (50.85%) ID, aged 11-22 (M = 15.82) was recruited in Canada (French-speaking, N = 142), and Australia (English-speaking, N = 253).…

Children's oral language proficiency (OLP) is integral for developing literacy skills. Storytelling or retelling is often used by parents and educators to elicit children's OLP, yet it is less commonly used for assessment purposes. Leveraged by natural language processing and machine learning, this study examined the extent to which computational…