ERIC Number: EJ1307573
Record Type: Journal
Publication Date: 2021-Sep
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1053-0819
EISSN: N/A
Available Date: N/A
P < .05 Is in the Eye of the Beholder: A Response to Beaujean and Farmer (2020)
Yi, Zhihui; Schreiber, James B.; Paliliunas, Dana; Barron, Becky F.; Dixon, Mark R.
Journal of Behavioral Education, v30 n3 p489-511 Sep 2021
The recent commentary by Beaujean and Farmer (2020) on the original paper by Dixon et al. (2019) serves a cautionary tale of selective p-values, the law of small N sizes, and the type-II error. We believe these authors have crafted a somewhat questionable argument in which only 57% of the original Dixon et al. data were re-analyzed, based on a series of assumptions that removed significant power from the original statistical analysis. We here provide an additional 12 re-analyses of the original data and demonstrated that depending on the testing assumptions and data inclusion criteria, p-value may or may not exceed the commonly used 0.05 level. Although we support healthy discussion on experimental methods, and appreciate the reinterpretation of our findings, the reader is cautioned that because Beaujean and Farmer's conclusions are limited to such a restricted range of data and different pre-analytic assumptions, the actual importance of their obtained p-value must remain in the eye of the beholder. [For Beaujean and Farmer's "Conceptual and Methodological Concerns: A Commentary on "Randomized Controlled Trial Evaluation of ABA Content on IQ Gains in Children with Autism," see EJ1307568. For Dixon et al.'s "Randomized Controlled Trial Evaluation of ABA Content on IQ Gains in Children with Autism," see EJ1307558.]
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Publication Type: Journal Articles; Reports - Evaluative; Opinion Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A