ERIC Number: EJ1377914
Record Type: Journal
Publication Date: 2023-Jan
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1176-3647
EISSN: EISSN-1436-4522
Application of Artificial Intelligence Techniques in Analysis and Assessment of Digital Competence in University Courses
Yang, Tzu-Chi
Educational Technology & Society, v26 n1 p232-243 Jan 2023
The development of digital competence has become an important part of higher education, and digital competence assessments have attracted considerable attention and concerns. Previous studies in this area mainly focused on self-reporting and manual review methods such as questionnaires, which offer limited assessment value. To solve this issue, this study uses natural language processing (NLP)--a current promising artificial intelligence (AI) technology--to analyze syllabi for assessing digital competence in universities. Analysis results show that the proposed method can achieve an average accuracy and consistency of over 80% with excellent efficiency. Moreover, the method demonstrates high consistency with manual evaluation results (kappa > 0.6) and enables automated large-scale objective assessment. In brief, the results suggest that the proposed method is efficient, effective, and reliable, making it a valuable solution for digital competence assessment. We accordingly explore the application expansion of this method in building the digital competence of universities. Furthermore, we discuss the theoretical, methodological, and applied contributions of this study.
Descriptors: Artificial Intelligence, Digital Literacy, Natural Language Processing, Higher Education, Course Descriptions, Competence, Teaching Methods
International Forum of Educational Technology & Society. Available from: National Yunlin University of Science and Technology. No. 123, Section 3, Daxue Road, Douliu City, Yunlin County, Taiwan 64002. e-mail: journal.ets@gmail.com; Web site: https://www.j-ets.net/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A