ERIC Number: EJ1322497
Record Type: Journal
Publication Date: 2021
Pages: 29
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0969-594X
EISSN: N/A
Investigating the Potential of NLP-Driven Linguistic and Acoustic Features for Predicting Human Scores of Children's Oral Language Proficiency
Assessment in Education: Principles, Policy & Practice, v28 n4 p477-505 2021
Children's oral language proficiency (OLP) is integral for developing literacy skills. Storytelling or retelling is often used by parents and educators to elicit children's OLP, yet it is less commonly used for assessment purposes. Leveraged by natural language processing and machine learning, this study examined the extent to which computational linguistic and acoustic indices predict human ratings of children's (n=184 aged 9 to 11) OLP using two story retell stimuli presented in written and aural forms. Human raters scored children's OLP on five oral proficiency criteria: vocabulary, grammar, idea development, task-fulfilment, and speech delivery, using a 4-point scale, and linguistic and acoustic features were used to predict each criterion. Results showed the efficacy of automated indices to predict human scores of children's OLP. This study calls for attention to discrepancies in human and machine speech delivery scores and stimulus effects on story retelling performance among children of different language backgrounds.
Descriptors: Scores, Natural Language Processing, Oral Language, Language Proficiency, Artificial Intelligence, Acoustics, Computational Linguistics, Prediction, Story Telling, Reliability, Elementary School Students, Foreign Countries, Language Tests
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada
Grant or Contract Numbers: N/A