ERIC Number: EJ1426259
Record Type: Journal
Publication Date: 2024-Jun
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1560-4292
EISSN: EISSN-1560-4306
Identifying Informative Features to Evaluate Student Knowledge as Causal Maps
Bao Wang; Philippe J. Giabbanelli
International Journal of Artificial Intelligence in Education, v34 n2 p301-331 2024
Knowledge maps have been widely used in knowledge elicitation and representation to evaluate and guide students' learning. To effectively evaluate maps, instructors must select the most informative map features that capture students' knowledge constructs. However, there is currently no clear and consistent criteria to select such features, as empirical studies continue to reflect the (implicit) preferences of scholars. This is challenging for instructors, who may thus ignore critical aspects of a map and/or waste their efforts by examining highly correlated features. To address the research gap of selecting informative graph metrics to assess knowledge maps, this study adopts the machine learning technique of Unsupervised Feature Selection (UFS). Specifically, we extract 12 features used in the prior literature on map assessment (e.g., density, diameter) and use 8 UFS algorithms to rank their importance. By using 202 maps originating from four case studies, we identify features that are generally (un)informative and observe nuances due to context (e.g., learning task, participant profiles). Results suggest that features commonly reported (e.g., number of edges) may not be as informative as less commonly examined aspects (e.g., average degree). Differences exist between maps: the diameter is valuable when learners produce maps from detailed studies, but less informative when maps are directly elicited from the learners' perspectives. The 8 UFS algorithms show five distinct ways to rank features in maps, hence future works may elicit the preferences of instructors for grading and map these preferences to an algorithmic approach (i.e., UFS) that produces a desired ranking.
Descriptors: Concept Mapping, Evaluation Methods, Student Evaluation, Algorithms, Artificial Intelligence, Knowledge Level
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A