ERIC Number: EJ1272620
Record Type: Journal
Publication Date: 2020-Oct
Pages: 46
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1551-6709
EISSN: N/A
Assessing Mathematics Misunderstandings via Bayesian Inverse Planning
Rafferty, Anna N.; Jansen, Rachel A.; Griffiths, Thomas L.
Cognitive Science, v44 n10 e12900 Oct 2020
Online educational technologies offer opportunities for providing individualized feedback and detailed profiles of students' skills. Yet many technologies for mathematics education assess students based only on the correctness of either their final answers or responses to individual steps. In contrast, examining the choices students make for how to solve the equation and the ways in which they might answer incorrectly offers the opportunity to obtain a more nuanced perspective of their algebra skills. To automatically make sense of step-by-step solutions, we propose a Bayesian inverse planning model for equation solving that computes an assessment of a learner's skills based on her pattern of errors in individual steps and her choices about what sequence of problem-solving steps to take. Bayesian inverse planning builds on existing machine learning tools to create a generative model relating (mis)-understandings to equation solving choices. Two behavioral experiments demonstrate that the model can interpret people's equation solving and that its assessments are consistent with those of experienced teachers. A third experiment uses this model to tailor guidance for learners based on individual differences in misunderstandings, closing the loop between assessing understanding, and using that assessment within an educational technology. Finally, because the bottleneck in applying inverse planning to a new domain is in creating the model of possible student misunderstandings, we show how to combine inverse planning with an existing production rule model to make inferences about student misunderstandings of fraction arithmetic.
Descriptors: Computer Assisted Testing, Mathematics Tests, Mathematics Skills, Student Evaluation, Algebra, Equations (Mathematics), Problem Solving, Bayesian Statistics, Planning, Models, Error Patterns, Test Interpretation, Educational Technology, Fractions, Arithmetic
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF), Division of Research on Learning in Formal and Informal Settings (DRL)
Authoring Institution: N/A
Grant or Contract Numbers: 1420732