A random-effects model is often applied in meta-analysis when considerable heterogeneity among studies is observed due to the differences in patient characteristics, timeframe, treatment regimens, and other study characteristics. Since 2014, the journals "Research Synthesis Methods" and the "Annals of Internal Medicine" have…

Meta-analyses can be used to comprehensively summarize the state of a given literature base, understand development and relations between constructs, and synthesize intervention effects to identify "what works for whom," all of which can directly inform research, practice, and policy. In this tutorial, we first argue that data reporting…

Meta-analysis results are usually presented in forest plots, which show the individual study results and the summary effect along with their confidence intervals. In this paper, we propose a system of linear springs as a mechanical analogue of meta-analysis that enables visualization and enhances intuition. The length of a spring corresponds to a…

Overlap in meta-reviews results from the use of multiple identical primary studies in similar reviews. It is an important area for research synthesists because overlap indicates the degree to which reviews address the same or different literatures of primary research. Current guidelines to address overlap suggest that assessing and documenting the…

Researchers often seek to synthesize results of multiple studies on the same topic to draw statistical or substantive conclusions and to estimate effect sizes that will inform power analyses for future research. The most popular synthesis approach is meta-analysis. There have been few discussions and applications of other synthesis approaches.…

High-quality systematic literature reviews provide a systematic process for identifying, synthesizing, and critiquing multiple studies and, in turn, inform theory, research, practice, and policy. With a focus on special education systematic reviews, we propose four core principles (i.e., coherence, contextualization, generativity, and…

Research indicating many study results do not replicate has raised questions about the credibility of science and prompted concerns about a potential reproducibility crisis. Moreover, most published research is not freely accessible, which limits the potential impact of science. Open science, which aims to make the research process more open and…

Multivariate meta-analysis, which jointly analyzes multiple and possibly correlated outcomes in a single analysis, is becoming increasingly popular in recent years. An attractive feature of the multivariate meta-analysis is its ability to account for the dependence between multiple estimates from the same study. However, standard inference…

At the beginning of the development of meta-analysis, understanding the role of moderators was given the highest priority, with meta-regression provided as a method for achieving this goal. Yet in current practice, meta-regression is not as commonly used as anticipated. This paper seeks to understand this mismatch by reviewing the history of…

Data for individual trials included in systematic reviews may be available in multiple sources. For example, a single trial might be reported in 2 journal articles and 3 conference abstracts. Because of differences across sources, source selection can influence the results of systematic reviews. We used our experience in the Multiple Data Sources…

Systematic reviews often encounter primary studies that report multiple effect sizes based on data from the same participants. These have the potential to introduce statistical dependency into the meta-analytic data set. In this paper, we provide a tutorial on dealing with effect size multiplicity within studies in the context of meta-analyses of…

Having surveyed the history and methods of meta-regression in a previous paper, in this paper, we review which and how meta-regression methods are applied in recent research syntheses. To do so, we reviewed studies published in 2016 across four leading research synthesis journals: "Psychological Bulletin," the "Journal of Applied…

Primarily focused on answering questions why and how, this qualitative research relates to human being and behavior and could bring understanding of socially constructed phenomena, including people's needs, experiences, behavior, motives, desires and expectations. Meta-synthesis is an important method that provides valuable insights into the…

We describe a meta-analytic scatterplot that indicates precision of points for two variables paired within studies; this is equivalent in form to a 'cross-hairs' plot used to portray specificity and sensitivity in diagnostic testing. At the user's discretion, the plot also displays boxplots for each of the X and Y variable distributions, means for…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…