NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1459053
Record Type: Journal
Publication Date: 2025-Feb
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: EISSN-1365-2729
AI-Assisted Assessment of Inquiry Skills in Socioscientific Issue Contexts
Wen Xin Zhang; John J. H. Lin; Ying-Shao Hsu
Journal of Computer Assisted Learning, v41 n1 e13102 2025
Background Study: Assessing learners' inquiry-based skills is challenging as social, political, and technological dimensions must be considered. The advanced development of artificial intelligence (AI) makes it possible to address these challenges and shape the next generation of science education. Objectives: The present study evaluated the SSI inquiry skills of students in an AI-enabled scoring environment. An AI model for socioscientific issues that can assess students' inquiry skills was developed. Responses to a learning module were collected from 1250 participants, and the open-ended responses were rated by humans in accordance with a designed rubric. The collected data were then preprocessed and used to train an AI rater that can process natural language. The effects of two hyperparameters, the dropout rate and complexity of the AI neural network, were evaluated. Results and Conclusion: The results suggested neither of the two hyperparameters was found to strongly affect the accuracy of the AI rater. In general, the human and AI raters exhibited certain levels of agreement; however, agreement varied among rubric categories. Discrepancies were identified and are discussed both quantitatively and qualitatively.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A