NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1394266
Record Type: Journal
Publication Date: 2023-Dec
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2211-1662
EISSN: EISSN-2211-1670
Available Date: N/A
If We Build It, Will They Learn? An Analysis of Students' Understanding in An Interactive Game during and after a Research Project
Horwitz, Paul; Reichsman, Frieda; Lord, Trudi; Dorsey, Chad; Wiebe, Eric; Lester, James
Technology, Knowledge and Learning, v28 n4 p1825-1839 Dec 2023
Studies of educational games often treat them as "black boxes" (Black and Wiliam in Phi Delta Kappan 80: 139-48, 1998; Buckley et al. in Int J LearnTechnol 5:166-190, 2010; Buckley et al. in J Sci Educ Technol 13: 23-41, 2010) and measure their effectiveness by exposing a treatment group of students to the game and comparing their performance on an external assessment to that of a control group taught the same material by some other method. This precludes the possibility of monitoring, evaluating, and reacting to the actions of individual students as they progress through the game. To do that, however, one must know what to look for because superficial measures of success are unlikely to identify unproductive behaviors such as "gaming the system." (Baker in Philipp Comput J, 2011; Downs et al. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, USA, 2010) The research reported here advances the ultimate goal of creating educational games that can provide real time, meaningful feedback on the progress of their users, enabling teachers or the game itself to intervene in a timely manner. We present the results of an in-depth analysis of students' actions in "Geniventure," an interactive digital game designed to teach genetics to middle and high school students. "Geniventure" offers a sequence of challenges of increasing difficulty and records students' actions as they progress. We analyzed the resulting log files, taking into account not only whether a student achieved a certain goal, but also the quality of the student's performance on each attempt. Using this information, we quantified students' performance and correlated it to their learning gain as estimated by scores on identical multiple-choice tests administered before and after exposure to "Geniventure." This analysis was performed in classes taught by teachers who had participated in professional development as part of a research project. A two-tailed paired-sample t-test of mean pre-test and post-test scores in these classes indicates a significant positive difference with a large effect size. Multivariate regression analysis of log data finds no correlation between students' post-test scores and their performance on "practice" challenges that invite experimentation, but a highly significant positive correlation with performance on "assessment" challenges, presented immediately following the practice challenges, that required students to invoke relevant mental models. We repeated this analysis with similar results using a second group of classes led by teachers who implemented "Geniventure" on their own after the conclusion of, and with no support from, the research project.
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education; High Schools
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF), Division of Research on Learning in Formal and Informal Settings (DRL)
Authoring Institution: N/A
Grant or Contract Numbers: DRL1503311
Author Affiliations: N/A