ERIC Number: EJ1398889
Record Type: Journal
Publication Date: 2023
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1091-367X
EISSN: EISSN-1532-7841
Trust the "Process"? When Fundamental Motor Skill Scores Are Reliably Unreliable
Measurement in Physical Education and Exercise Science, v27 n4 p391-402 2023
The typical process for assessing inter-rater reliability is facilitated by training raters within a research team. Lacking is an understanding if inter-rater reliability scores "between" research teams demonstrate adequate reliability. This study examined inter-rater reliability between 16 researchers who assessed fundamental motor skills using the Test of Gross Motor Development-3rd edition. Total score agreement (ICC = 0.363) and locomotor subscale agreement (ICC = 0.383) were "very poor," while ball skills subscale agreement (ICC = 0.478) was "poor." Consistencies of total (ICC = 0.757), locomotor (ICC = 0.730), and ball skills (ICC = 0.746) scores were "fair." Component percentage agreement ranged from 40.5% to 96.2%. These data suggest that there are significant differences in how different research groups evaluate fundamental motor skills based on the subjective nature of scoring. Consistency and agreement among users need to be addressed in motor development research to allow for direct comparisons across studies that use process-oriented measures.
Descriptors: Psychomotor Skills, Scores, Reliability, Interrater Reliability, Motor Development, Children, Norm Referenced Tests, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United States; Canada; Brazil; Australia; Portugal; Indonesia; Finland; Ireland; Spain; Iran
Identifiers - Assessments and Surveys: Test of Gross Motor Development
Grant or Contract Numbers: N/A