Single-case research design is a useful methodology to investigate counseling treatment effects through a time-series graph. A systematic review of 42 counseling journals was conducted, yielding 50 studies, including 272 graphs. Most graphs did not meet recommended guidelines. How graphs impact visual analysis and suggestions to enhance…

Purpose: Recent reports by the National Academy of Sciences, Engineering, and Medicine have ignited a new wave of discourse regarding the future of education research and reinvigorated calls for education research to be more relevant to practice. An emerging research paradigm, continuous improvement research (CIR), responds to that debate by…

It has been over 60 years since interpreter and translator trainers began to generate and disseminate knowledge in the 1950s. Although there have been reviews of 10 to 15 years of research, no attempts have been made to review the literature published over the past six decades for an overall landscape of knowledge creation in T&I education.…

Using a sample of 70,399 published p-values from 192 meta-analyses, we empirically estimate the counterfactual distribution of p-values in the absence of any biases. Comparing observed p-values with counterfactually expected p-values allows us to estimate how many p-values are published as being statistically significant when they should have been…

In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate balancing weights, a generalization of inverse propensity score weights that solve a convex optimization problem…

Single-case design (SCD) is a quantitative experimental technique in which participants serve as their own control. The use of an effect size in SCD allows evaluation of outcomes as well as comparison of outcomes via meta-analyses. Characteristics of SCD research make the selection of an appropriate effect size complicated. Additionally, there are…

A key aspect of metacognition is metacognitive accuracy, i.e., the degree to which confidence judgments differentiate between correct and incorrect trials. To quantify metacognitive accuracy, researchers are faced with an increasing number of different methods. The present study investigated false positive rates associated with various measures of…

Although quality guidelines for single-case intervention research emphasize the importance of concurrent baselines in multiple-baseline and multiple-probe designs, nonconcurrent variations on these designs persist in the research literature. This study describes a systematic review of special education intervention studies (k = 406) between 1988…

Evaluation designs seek to provide evidence of impact and collect formative data to understand and improve programs and inform decisions. Formative data is commonly used at the onset of developing a new program to modify and improve before full implementation. However, formative data is often collected throughout the life of the program to shape…

The Cochrane Rapid Review Methods Group (RRMG) first released interim guidance in March 2020 to support authors in conducting rapid reviews (RRs). The objective of this mixed-methods study was to assess the adherence and investigate authors' understanding of the RRMG guidance. We identified all documents citing the Interim Cochrane RRMG guidance…

Introduction: Missing data are bound to occur in education intervention research. Reasons vary but always have the consequence of reducing sample sizes and can, under certain conditions, seriously bias estimated intervention effects. A wide array of methods have been developed for handling missing data (Enders, 2023). Whereas older approaches…

Mediation analysis in Single Case Experimental Designs (SCEDs) evaluates intervention mechanisms for individuals. Despite recent methodological developments, no clear guidelines exist for maximizing power to detect the indirect effect in SCEDs. This study compares frequentist and Bayesian methods, determining (1) minimum required sample size to…

When designing cluster-randomized trials (CRTs), one important consideration is determining the proper sample sizes across levels and treatment conditions to cost-efficiently achieve adequate statistical power. This consideration is usually addressed in an optimal design framework by leveraging the cost structures of sampling and optimizing the…

Differentiated Instruction (DI) is a hot topic in educational research. Keeping abreast of its latest developments and frontiers can provide new perspectives for future study. Using CiteSpace software, 1086 publications included in the Web of Science core collection from 2000 to 2020 were analysed to create knowledge maps of DI research. The…

Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are…