ERIC Number: ED624247
Record Type: Non-Journal
Publication Date: 2020-Sep-30
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Multilevel Meta-Analysis of Individual Participant Data of Single-Case Experimental Designs: One-Stage versus Two-Stage Methods
Declercq, Lies; Jamshidi, Laleh; Fernández-Castilla, Belen; Moeyaert, Mariola; Natasha, Beretvas S.; Ferron, John M.; Van den Noortgate, Wim
Grantee Submission
To conduct a multilevel meta-analysis of multiple single-case experimental design (SCED) studies, the individual participant data (IPD) can be analyzed in one or two stages. In the one-stage approach, a multilevel model is estimated based on the raw data. In the two-stage approach, an effect size is calculated for each participant and these effect sizes and their sampling variances are subsequently combined to estimate a meta-analytic multilevel model. The multilevel model in the two-stage approach has fewer parameters to estimate, in exchange for the reduction of information of the raw data to effect sizes. In this paper we explore how the one-stage and two-stage IPD approaches can be applied in the context of meta-analysis of single-case designs. Both approaches are compared for several single-case designs of increasing complexity. Through a simulation study we show that the two-stage approach obtains better convergence rates for more complex models, but that model estimation does not necessarily converge at a faster speed. The point estimates of the fixed effects are unbiased for both approaches across all models, as such confirming results from methodological research on IPD meta-analysis of group-comparison designs. In light of these results, we discuss the implementation of both methods in R. [This is the online version of an article published in "Multivariate Behavioral Research."]
Descriptors: Research Design, Data Analysis, Effect Size, Models, Meta Analysis, Research Methodology, Data
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D110024