Precision Teaching is a behavior measurement system that emphasizes the development of behavioral repertoires and utilizes Standard Celeration Charts as its primary tool. This system has been applied across various areas, including mainstream and special education, and has successfully improved academic, motor, communication, and other skills.…

In any meta-analysis, it is critically important to report the dispersion in effects as well as the mean effect. If an intervention has a moderate clinical impact "on average" we also need to know if the impact is moderate for all relevant populations, or if it varies from trivial in some to major in others. Or indeed, if the…

As a measure of heterogeneity in meta-analysis, the coefficient of variation (CV) has been recently considered, providing researchers with a complement to the very popular I[superscript 2] measure. While I[superscript 2] measures the proportion of total variance that is due to variance of the random effects, the CV is the ratio of the standard…

Diffraction has emerged as a concept and methodology through opposing reflexivity. In this paper, I argue that reflexivity and diffraction are not external to each other. In contrast, I propose that they blur into each other and so we do not find ourselves using pure reflexivity or diffraction. Furthermore, I contend that categorically…

We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

Extracting data from studies is the norm in meta-analyses, enabling researchers to generate effect sizes when raw data are otherwise not available. While there has been a general push for increased reproducibility in meta-analysis, the transparency and reproducibility of the data extraction phase is still lagging behind. Unfortunately, there is…

A random-effects model is often applied in meta-analysis when considerable heterogeneity among studies is observed due to the differences in patient characteristics, timeframe, treatment regimens, and other study characteristics. Since 2014, the journals "Research Synthesis Methods" and the "Annals of Internal Medicine" have…

Systematic reviews and meta-analyses aggregate research findings across studies and populations, making them a valuable form of research evidence. Over the past decade, studies in medical education using these methods have increased by 630%. However, many manuscripts are not publication-ready due to inadequate planning and insufficient analyses.…

To enable optimal decision-making based on the best evidence available, open syntheses are called for. To make data accessible and comprehensible even for decision-makers without proficient knowledge in meta-analysis, a graphical user interface (GUI) provides flexible data visualizations including interpretation aids. Moreover, due to a growing…

Auburn University engaged in the reaffirmation process with SACSCOC (institutional accreditor) and received recommendations surrounding assessment practices. It was from these recommendations that the Office of Academic Assessment (OAA) was created in July 2015, providing dedicated assessment support to faculty responsible for educational…

Network meta-analysis (NMA) is an established method for assessing the comparative efficacy and safety of competing interventions. It is often the case that we deal with interventions that consist of multiple, possibly interacting, components. Examples of interventions' components include characteristics of the intervention, mode (face-to-face,…

Meta-analysis of proportions is conceptually simple: Faced with a binary outcome in multiple studies, we seek inference on some overall proportion of successes/failures. Under common effect models, exact inference has long been available, but is not when we more realistically allow for heterogeneity of the proportions. Instead a wide range of…

Meta-analyses can be used to comprehensively summarize the state of a given literature base, understand development and relations between constructs, and synthesize intervention effects to identify "what works for whom," all of which can directly inform research, practice, and policy. In this tutorial, we first argue that data reporting…

Introduction: Interrupted Time Series (ITS) studies may be used to assess the impact of an interruption, such as an intervention or exposure. The data from such studies are particularly amenable to visual display and, when clearly depicted, can readily show the short- and long-term impact of an interruption. Further, well-constructed graphs allow…

Statistical methods are increasingly being used to integrate findings from the ever-expanding universe of empirical research. Meta-analysis encompasses various techniques for synthesizing summary statistics, and mega-analysis pools raw data across studies. This paper offers an introduction to meta-analysis and mega-analysis that complements the…