We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

The Force Concept Inventory (FCI) is one of the research-based assessments established by the physics education research community to measure students' understanding of Newtonian mechanics. Former works have often recorded the notion of gendered mean FCI scores favoring male students notably in the North American (NA) based studies. Nevertheless,…

This study aimed to provide meta-analytic reliability information of the Columbia-Suicide Severity Rating Scale (C-SSRS). We implemented systematic search procedures to 35 eligible studies (N = 23,247; Mage = 26.74 years) that reported reliability estimates. The synthesized average values of Cronbach's alpha were 0.88 (95% CI [0.85, 0.92]) for the…

Objective: Brief Self-Control Scale (BSCS) is the most widely used instrument to assess self-control. The purpose of this reliability generalization meta-analysis was to examine the degree to which consistency reliability coefficients for scores on the BSCS generalize across age groups and languages. Method: We included studies using the BSCS and…

Computational thinking (CT), an essential 21st century skill, incorporates key computer science concepts such as abstraction, algorithms, and debugging. Debugging is particularly underrepresented in the CT training literature. This multi-level meta-analysis focused on debugging as a core CT skill, and investigated the effects of various debugging…

Second language (L2) listening comprehension is a function of many variables. We focused on metacognitive awareness, which we measured using the Metacognitive Awareness Listening Questionnaire (MALQ; Vandergrift et al., 2006), and meta-analyzed (a) the factor structure of the MALQ and (b) the relationship between metacognitive awareness and L2…

This study employs meta-analysis to synthesize findings from 30 articles investigating gender differences in computational thinking (CT) among K-12 students. Encompassing 51 independent effect sizes, the meta-analysis involves a participant pool of 9181 individuals from various countries, comprising 4254 males and 4927 females. Results indicate…

The success of teachers is tied to their effectiveness in managing student behavior. In this meta-analysis, we identified 49 single-case-design studies that evaluated the effectiveness of teacher training on their implementation of behavioral support strategies. Training was most often provided in a one-on-one format (n = 18) and included ongoing…

The purpose of this study was to estimate the overall reliability values for the scores produced by Runco Ideational Behavior Scale (RIBS) and explore the variability of RIBS score reliability across studies. To achieve this, a reliability generalization meta-analysis was carried out using the 86 Cronbach's alpha estimates obtained from 77 studies…

Empirical research investigating the association between teacher pay incentives and student test scores has grown rapidly over the past decade. To integrate the findings from these studies and help inform the debate over teacher merit pay, this meta-analysis synthesizes effect sizes across 37 primary studies, 26 of which were conducted in the…

Tingir et al. (2017) concluded from their meta-analysis that the subject areas taught through mobile devices had significantly higher achievement scores (d = 0.48) than the ones taught with traditional teaching methods. Given the relatively high positive effect of mobile devices on student achievement, we carefully analysed the selected research…

Becoming one of six official United Nations languages, English proficiency has become a prominent requirement for students and professionals entering international education and/ or careers, as assessed through standardized English proficiency tests. English learners conducted varied procedures to pursue the minimum test score criteria, including…

Four decades of research have shown that students' low test-taking effort is a serious threat to the validity of score-based inferences from low-stakes, group-based educational assessments. This meta-analysis sought to identify effective interventions for improving students' test-taking effort in such contexts. Included studies: (1) used a…

As the empirical literature in educational technology continues to grow, meta-analyses are increasingly being used to synthesise research to inform practice. However, not all meta-analyses are equal. To examine their evolution over the past 30 years, this study systematically analysed the quality of 52 meta-analyses (1988-2017) on educational…

Background: The structure provided by school settings even with no specific obesity-intervention may prevent weight gain. This meta-analytic study considered this premise by examining weight outcomes from control groups in published randomized controlled trials of school-year obesity-related interventions conducted in-school and out-of-school.…