NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1404392
Record Type: Journal
Publication Date: 2023
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1939-1382
Improving Peer Assessment Validity and Reliability Through a Fuzzy Coherence Measure
El Alaoui, Mohamed
IEEE Transactions on Learning Technologies, v16 n6 p892-899 2023
Classical evaluation methods, assessments, exams, and so forth accentuate the perception of one against all, professor versus learners. Including students in the assessment process, allows transforming the professor from an opponent to a critical friend, with the role of helping students to recognize both their strengths and weaknesses. However, assessing peers is not as easy as it may appear, since reliability and validity issues still represent a major concern. To improve reliability, this study proposes a consensus-reaching measure that reduces the impact of inconsistent evaluations (harsh or overvalued) through minimizing iteratively the sum of weighted incoherencies. Furthermore, it improves validity by computing the similarity of each assessment to the professor's evaluation. Moreover, it is easier for students to assess with linguistic grades "Good," "Fair," etc., than with classical numbers, hence fuzzy logic is used to encompass the inherent uncertainty of students' assessments. This pilot study included 23 students in the 4th year project management course where learners assessed their peers' oral presentations. Results suggest that the used measures permit achieving high reliability even with students from different cultures.
Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://bibliotheek.ehb.be:2578/xpl/RecentIssue.jsp?punumber=4620076
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A