NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1281447
Record Type: Journal
Publication Date: 2020-Dec
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1092-4388
EISSN: N/A
A Tool for Automatic Scoring of Spelling Performance
Themistocleous, Charalambos; Neophytou, Kyriaki; Rapp, Brenda; Tsapkini, Kyrana
Journal of Speech, Language, and Hearing Research, v63 n12 p4179-4192 Dec 2020
Purpose: The evaluation of spelling performance in aphasia reveals deficits in written language and can facilitate the design of targeted writing treatments. Nevertheless, manual scoring of spelling performance is time-consuming, laborious, and error prone. We propose a novel method based on the use of distance metrics to automatically score spelling. This study compares six automatic distance metrics to identify the metric that best corresponds to the gold standard--manual scoring--using data from manually obtained spelling scores from individuals with primary progressive aphasia. Method: Three thousand five hundred forty word and nonword spelling productions from 42 individuals with primary progressive aphasia were scored manually. The gold standard--the manual scores--were compared to scores from six automated distance metrics: sequence matcher ratio, Damerau-Levenshtein distance, normalized Damerau-Levenshtein distance, Jaccard distance, Masi distance, and Jaro-Winkler similarity distance. We evaluated each distance metric based on its correlation with the manual spelling score. Results: All automatic distance scores had high correlation with the manual method for both words and nonwords. The normalized Damerau-Levenshtein distance provided the highest correlation with the manual scoring for both words (r[subscript s] = 0.99) and nonwords (r[subscript s] = 0.95). Conclusions: The high correlation between the automated and manual methods suggests that automatic spelling scoring constitutes a quick and objective approach that can reliably substitute the existing manual and time-consuming spelling scoring process, an important asset for both researchers and clinicians.
American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Institute on Deafness and Other Communication Disorders (NIDCD)
Authoring Institution: N/A
Grant or Contract Numbers: R01DC014475