ERIC Number: EJ1447368
Record Type: Journal
Publication Date: 2024-Nov
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1759-2879
EISSN: EISSN-1759-2887
Conducting Power Analysis for Meta-Analysis with Dependent Effect Sizes: Common Guidelines and an Introduction to the POMADE R Package
Research Synthesis Methods, v15 n6 p1214-1230 2024
Sample size and statistical power are important factors to consider when planning a research synthesis. Power analysis methods have been developed for fixed effect or random effects models, but until recently these methods were limited to simple data structures with a single, independent effect per study. Recent work has provided power approximation formulas for meta-analyses involving studies with multiple, dependent effect size estimates, which are common in syntheses of social science research. Prior work focused on developing and validating the approximations but did not address the practice challenges encountered in applying them for purposes of planning a synthesis involving dependent effect sizes. We aim to facilitate the application of these recent developments by providing practical guidance on how to conduct power analysis for planning a meta-analysis of dependent effect sizes and by introducing a new R package, "POMADE," designed for this purpose. We present a comprehensive overview of resources for finding information about the study design features and model parameters needed to conduct power analysis, along with detailed worked examples using the POMADE package. For presenting power analysis findings, we emphasize graphical tools that can depict power under a range of plausible assumptions and introduce a novel plot, the traffic light power plot, for conveying the degree of certainty in one's assumptions.
Descriptors: Sample Size, Robustness (Statistics), Effect Size, Social Science Research, Research Design, Predictor Variables, Test Reliability, Test Construction, Test Reviews
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: Researchers
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Data File: URL: https://osf.io/vpnmb/