Loading [a11y]/accessibility-menu.js
Group Optimization to Maximize Peer Assessment Accuracy Using Item Response Theory and Integer Programming | IEEE Journals & Magazine | IEEE Xplore

Group Optimization to Maximize Peer Assessment Accuracy Using Item Response Theory and Integer Programming

Open Access

Abstract:

With the wide spread large-scale e-learning environments such as MOOCs, peer assessment has been popularly used to measure the learner ability. When the number of learner...Show More

Abstract:

With the wide spread large-scale e-learning environments such as MOOCs, peer assessment has been popularly used to measure the learner ability. When the number of learners increases, peer assessment is often conducted by dividing learners into multiple groups to reduce the learner's assessment workload. However, in such cases, the peer assessment accuracy depends on the method of forming groups. To resolve that difficulty, this study proposes a group formation method to maximize peer assessment accuracy using item response theory and integer programming. Experimental results, however, have demonstrated that the method does not present sufficiently higher accuracy than a random group formation method does. Therefore, this study further proposes an external rater assignment method that assigns a few outside-group raters to each learner after groups are formed using the proposed group formation method. Through results of simulation and actual data experiments, this study demonstrates that the proposed external rater assignment can substantially improve peer assessment accuracy.
Published in: IEEE Transactions on Learning Technologies ( Volume: 13, Issue: 1, 01 Jan.-March 2020)
Page(s): 91 - 106
Date of Publication: 12 February 2019

ISSN Information:

Funding Agency:


References

References is not available for this document.