ERIC Number: EJ1345248
Record Type: Journal
Publication Date: 2022-May
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1092-4388
EISSN: EISSN-1558-9102
Structural Validity, Internal Consistency, and Rater Reliability of the Modified Barium Swallow Impairment Profile: Breaking Ground on a 52,726-Patient, Clinical Data Set
Journal of Speech, Language, and Hearing Research, v65 n5 p1659-1670 May 2022
Purpose: The purpose of this study was to extend the assessment of the psychometric properties of the Modified Barium Swallow Impairment Profile (MBSImP). Here, we re-examined structural validity and internal consistency using a large clinical-registry data set and formally examined rater reliability in a smaller data set. Method: This study consists of a retrospective structural validity and internal consistency analysis of MBSImP using a large data set (N = 52,726) drawn from the MBSImP Swallowing Data Registry and a prospective study of the interrater and intrarater reliability of a subset of studies (N = 50) rated by four MBSImP-trained speech-language pathologists. Structural validity was assessed via exploratory factor analysis. Internal consistency was measured using Cronbach's alpha for each of the multicomponent MBSImP domains, namely, the oral and pharyngeal domains. Interrater reliability and intrarater reliability were measured using the intraclass correlation coefficient (ICC). Results: The exploratory factor analysis showed a two-factor solution with factors precisely corresponding to the scale's oral and pharyngeal domains, consistent with findings from the initial study. Component 17, that is, the esophageal domain, did not load onto either factor. Internal consistency was good for both the oral and pharyngeal domains ([alpha][subscript oral] = 0.81, [alpha][subscript pharyngeal] = 0.87). Interrater reliability was found to be good with ICC[subscript interrater] = 0.78 (95% confidence interval [CI; 0.76, 0.80]). Intrarater reliability was good for each rater, ICC[subscript Rater-1] = 0.82 (95% CI [0.77, 0.86]), ICC[subscript Rater-2] = 0.83 (95% CI [0.79, 0.87]), ICC[subscript Rater-3] = 0.87 (95% CI [0.83, 0.90]), and ICC[subscript Rater-4] = 0.87 (95% CI [0.83, 0.90]). Conclusions: This study leverages a large-scale, clinical data set to provide strong, generalizable evidence that the MBSImP assessment method has excellent structural validity and internal consistency. In addition, the results show that MBSImP-trained speech-language pathologists can demonstrate good interrater and intrarater reliability.
Descriptors: Diagnostic Tests, Disability Identification, Physical Disabilities, Eating Disorders, Test Validity, Test Reliability, Interrater Reliability, Speech Language Pathology, Factor Analysis, Factor Structure, Generalizability Theory, Allied Health Personnel
American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Institute on Deafness and Other Communication Disorders (NIDCD) (DHHS/NIH)
Authoring Institution: N/A
Grant or Contract Numbers: 2K24DC0128010