Abstract:
With the wide spread large-scale e-learning environments such as MOOCs, peer assessment has been popularly used to measure the learner ability. When the number of learner...Show MoreMetadata
Abstract:
With the wide spread large-scale e-learning environments such as MOOCs, peer assessment has been popularly used to measure the learner ability. When the number of learners increases, peer assessment is often conducted by dividing learners into multiple groups to reduce the learner's assessment workload. However, in such cases, the peer assessment accuracy depends on the method of forming groups. To resolve that difficulty, this study proposes a group formation method to maximize peer assessment accuracy using item response theory and integer programming. Experimental results, however, have demonstrated that the method does not present sufficiently higher accuracy than a random group formation method does. Therefore, this study further proposes an external rater assignment method that assigns a few outside-group raters to each learner after groups are formed using the proposed group formation method. Through results of simulation and actual data experiments, this study demonstrates that the proposed external rater assignment can substantially improve peer assessment accuracy.
Published in: IEEE Transactions on Learning Technologies ( Volume: 13, Issue: 1, 01 Jan.-March 2020)
Funding Agency:
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Item Response Theory ,
- Simulation Experiments ,
- Random Method ,
- Formation Of Groups ,
- Learning Ability ,
- External Evaluation ,
- Assignment Method ,
- Number Of Learners ,
- Root Mean Square Error ,
- High Ability ,
- Markov Chain Monte Carlo ,
- Low Ability ,
- Ability Levels ,
- Group Learning ,
- Fisher Information ,
- Probability Of Response ,
- True Parameter ,
- Learning Management System ,
- True Parameter Values ,
- Task Parameters ,
- Item Response Theory Models ,
- Integer Programming Problem ,
- E-learning Course ,
- Ability Estimates ,
- Graded Response Model ,
- Average Bias ,
- First Vertical ,
- Assumption Of Local Independence ,
- Parameter Estimates ,
- Model Assumptions
- Author Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Item Response Theory ,
- Simulation Experiments ,
- Random Method ,
- Formation Of Groups ,
- Learning Ability ,
- External Evaluation ,
- Assignment Method ,
- Number Of Learners ,
- Root Mean Square Error ,
- High Ability ,
- Markov Chain Monte Carlo ,
- Low Ability ,
- Ability Levels ,
- Group Learning ,
- Fisher Information ,
- Probability Of Response ,
- True Parameter ,
- Learning Management System ,
- True Parameter Values ,
- Task Parameters ,
- Item Response Theory Models ,
- Integer Programming Problem ,
- E-learning Course ,
- Ability Estimates ,
- Graded Response Model ,
- Average Bias ,
- First Vertical ,
- Assumption Of Local Independence ,
- Parameter Estimates ,
- Model Assumptions
- Author Keywords