ERIC Number: EJ1376423
Record Type: Journal
Publication Date: 2022-Dec
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0278-7393
EISSN: EISSN-1939-1285
Severe Publication Bias Contributes to Illusory Sleep Consolidation in the Motor Sequence Learning Literature
Rickard, Timothy C.; Pan, Steven C.; Gupta, Mohan W.
Journal of Experimental Psychology: Learning, Memory, and Cognition, v48 n12 p1787-1796 Dec 2022
We explored the possibility of publication bias in the sleep and explicit motor sequence learning literature by applying precision effect test (PET) and precision effect test with standard errors (PEESE) weighted regression analyses to the 88 effect sizes from a recent comprehensive literature review (Pan & Rickard, 2015). Basic PET analysis indicated pronounced publication bias; that is, the effect sizes were strongly predicted by their standard error. When variables that have previously been shown to both moderate the sleep gain effect and substantially reduce unaccounted for effect size heterogeneity were included in that analysis, evidence for publication bias remained strong. The estimated postsleep gain was negative, suggesting forgetting rather than facilitation, and it was statistically indistinguishable from the estimated postwake gain. In a qualitative review of a smaller group of more recent studies we observed that (a) small sample sizes--a major factor behind the publication bias--are still the norm, (b) use of demonstrably flawed experimental design and analysis remains prevalent, and (c) when authors conclude in favor of sleep-dependent consolidation, they frequently do not cite the articles in which those methodological flaws have been demonstrated. We conclude that there is substantial publication bias, that there is no consolidation-based, absolute performance gain following sleep, and that strong conclusions regarding the hypothesis of less forgetting after sleep than after wakefulness should await further research. Recommendations are made for reducing publication bias in future work.
Descriptors: Publications, Bias, Sleep, Psychomotor Skills, Sequential Learning, Effect Size, Error Patterns, Memory, Sample Size, Research Design, Research Problems, Citations (References), Meta Analysis
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A