ERIC Number: EJ1387197
Record Type: Journal
Publication Date: 2023
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1929-7750
Serious Game Analytics by Design: Feature Generation and Selection Using Game Telemetry and Game Metrics--Toward Predictive Model Construction
Journal of Learning Analytics, v10 n1 p168-188 2023
The construction of prediction models reflecting players' learning performance in serious games currently faces various challenges for learning analytics. In this study, we design, implement, and field test a learning analytics system for a serious game, advancing the field by explicitly showing which in-game features correspond to differences in learner performance. We then deploy and test a system that provides instructors with clear signals regarding student learning and progress in the game, which instructors could depend upon for interventions. Within the study, we examined, coded, and filtered a substantial gameplay corpus, determining expertise in the game. Mission HydroSci (MHS) is a serious game that teaches middle-school students water science. Using our logging system, designed and implemented along with game design and development, we captured around 60 in-game features from the gameplay of 373 students who completed Unit 3 of MHS in its first field test. We tested eight hypotheses during the field test and presented this paper's results to participating teachers. Our findings reveal several features with statistical significance that will be critical for creating a validated prediction model. We discuss how this work will help future research establish a framework for designing analytics systems for serious games and advancing gaming design and analytics theory.
Descriptors: Educational Games, Learning Analytics, Design, Game Based Learning, Performance Based Assessment, Predictive Measurement, Middle School Students, Science Instruction, Water, Computer Simulation, Information Science
Society for Learning Analytics Research. 121 Pointe Marsan, Beaumont, AB T4X 0A2, Canada. Tel: +61-429-920-838; e-mail: info@solaresearch.org; Web site: https://learning-analytics.info/index.php/JLA/index
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Office of Innovation and Improvement (ED), Investing in Innovation (i3)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A150364; U411C140081