Inconsistent reporting of critical facets of classroom interventions and their related impact evaluations hinders the field's ability to describe and synthesize the existing evidence base. In this essay, we present a set of reporting guidelines intended to steer authors of classroom intervention studies toward providing more systematic reporting…

Systematic reviews and meta-analyses aggregate research findings across studies and populations, making them a valuable form of research evidence. Over the past decade, studies in medical education using these methods have increased by 630%. However, many manuscripts are not publication-ready due to inadequate planning and insufficient analyses.…

The literature search underpins data collection for all systematic reviews (SRs). The SR reporting guideline PRISMA, and its extensions, aim to facilitate research transparency and reproducibility, and ultimately improve the quality of research, by instructing authors to provide specific research materials and data upon publication of the…

We developed "metadta," a flexible, robust, and user-friendly statistical procedure that fuses established and innovative statistical methods for meta-analysis, meta-regression, and network meta-analysis of diagnostic test accuracy studies in Stata. Using data from published meta-analyses, we validate "metadta" by comparing and…

Meta-analyses can be used to comprehensively summarize the state of a given literature base, understand development and relations between constructs, and synthesize intervention effects to identify "what works for whom," all of which can directly inform research, practice, and policy. In this tutorial, we first argue that data reporting…

The United States Chairman of the Joint Chiefs of Staff declared critical thinking as a capability imperative for Force XXI. He directed Military Services to develop critical thinkers. There is limited evidence of success in terms of developing critical thinking abilities. Specifically, the U.S. Army lacks a single, generally accepted, codified…

To assess the meaningfulness of an intervention effect on students' achievement, researchers may apply empirical benchmarks as standards for comparisons, involving normative expectations for students' academic growth as well as performance gaps between weak and average schools or policy-relevant groups (e.g., male and female students, students…

N-of-1 trials, a special case of Single Case Experimental Designs (SCEDs), are prominent in clinical medical research and specifically psychiatry due to the growing significance of precision/personalized medicine. It is imperative that these clinical trials be conducted, and their data analyzed, using the highest standards to guard against threats…

Purpose: Systematic review and meta-analysis are regarded as standard and valuable tools for providing an objective and reproducible synthesis of research findings in the literature. Their increasing popularity has led to heightened expectations for comprehensiveness and rigor in conducting scientific reviews and analyses. The purpose of this…

There has recently been a surge of interest in improving the replicability of second language (L2) research. However, less attention is paid to replicability in the context of L2 meta-analyses. I argue that conducting interrater reliability (IRR) analyses is a key step toward improving the replicability of L2 meta-analyses. To that end, I first…

Estimation of within-trial interactions in meta-analysis is crucial for reliable assessment of how treatment effects vary across participant subgroups. However, current methods have various limitations. Patients, clinicians and policy-makers need reliable estimates of treatment effects within specific covariate subgroups, on relative and absolute…

This meta-analysis reviews 79 studies (N = 46,605) that examined the existence of gender difference on intelligence in school-aged children. To do so, we limited the literature search to works that assessed the construct of intelligence through the Wechsler Intelligence Scales for Children (WISC) batteries, evaluating eventual gender differences…

With the promulgation of the Apostolic Constitution Veritatis Gaudium in 2018, Roman Catholic ecclesiastical higher education institutions had a quality evaluation process imposed on them, developed by the Holy See's Agency for the Evaluation and Promotion of Quality in Ecclesiastical Universities and Faculties (AVEPRO). It is yet a case of 'lex…

Background: The structure provided by school settings even with no specific obesity-intervention may prevent weight gain. This meta-analytic study considered this premise by examining weight outcomes from control groups in published randomized controlled trials of school-year obesity-related interventions conducted in-school and out-of-school.…

The technology, pedagogy, and content knowledge (TPACK) framework describes seven domains of knowledge that teachers rely on for teaching with technology. The framework includes an eighth element labelled "contexts," representing the situated nature of instruction. This latter construct has been inconsistently represented and defined…