ERIC Number: EJ1320051
Record Type: Journal
Publication Date: 2021
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0260-2938
EISSN: N/A
Accuracy of Peer Ratings on the Quality of Spoken-Language Interpreting
Assessment & Evaluation in Higher Education, v46 n8 p1299-1313 2021
The accuracy of peer ratings on students' performance has attracted much attention from higher education researchers. In this study, we attempted to explore the accuracy of peer ratings on the quality of spoken-language interpreting in the context of tertiary-level interpreter training. We sought to understand how different types of peer raters (experienced versus novice) would affect the accuracy of their ratings on three quality dimensions (fidelity, fluency and expression) of bi-directional interpretation (English-to-Chinese and Chinese-to-English). Our data analysis, based on a rater accuracy model, shows that: (1) overall, it was easier for the peer raters to score the English-to-Chinese interpretation accurately than the opposite direction and to assess fidelity accurately than fluency and expression; (2) the experienced peer raters scored the interpretations more accurately than their novice counterparts; and (3) the higher-quality interpretations were easier to be scored accurately than those of lower quality. However, the directionality of interpreting may moderate these relationships. These findings are expected to enrich and deepen our understanding of rater accuracy as a function of distal and proximal factors in the Brunswik's lens model, and to help us better organize peer assessment in the higher educational context.
Descriptors: Accuracy, Peer Evaluation, Oral Language, Interpretive Skills, Translation, Language Fluency, Fidelity, Chinese, English (Second Language), Second Language Learning, Interrater Reliability
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A