ERIC Number: EJ1387051
Record Type: Journal
Publication Date: 2023-Apr
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2325-3193
EISSN: EISSN-2325-3215
On the Reproducibility of Power Analyses in Motor Behavior Research
Journal of Motor Learning and Development, v11 n1 p29-44 Apr 2023
Recent metascience suggests that motor behavior research may be underpowered, on average. Researchers can perform a priori power analyses to ensure adequately powered studies. However, there are common pitfalls that can result in underestimating the required sample size for a given design and effect size of interest. Critical evaluation of power analyses requires successful analysis reproduction, which is conditional on the reporting of sufficient information. Here, we attempted to reproduce every power analysis reported in articles (k = 84/635) in three motor behavior journals between January 2019 and June 2021. We reproduced 7% of analyses using the reported information, which increased to 43% when we assumed plausible values for missing parameters. Among studies that reported sufficient information to evaluate, 63% reported using the same statistical test in the power analysis as in the study itself, and in 77%, the test addressed at least one of the identified hypotheses. Overall, power analyses were not commonly reported with sufficient information to ensure reproducibility. A nontrivial number of power analyses were also affected by common pitfalls. There is substantial opportunity to address the issue of underpowered research in motor behavior by increasing adoption of power analyses and ensuring reproducible reporting practices.
Descriptors: Statistical Analysis, Psychomotor Skills, Motor Development, Research Design, Sampling, Sample Size, Replication (Evaluation)
Human Kinetics, Inc. 1607 North Market Street, Champaign, IL 61820. Tel: 800-474-4457; Fax: 217-351-1549; e-mail: info@hkusa.com; Web site: https://journals.humankinetics.com/view/journals/jmld/jmld-overview.xml
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A