NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1370886
Record Type: Journal
Publication Date: 2022
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1750-399X
EISSN: EISSN-1757-0417
Available Date: N/A
Holistic versus Analytic Scoring of Spoken-Language Interpreting: A Multi-Perspectival Comparative Analysis
Chen, Jing; Yang, Huabo; Han, Chao
Interpreter and Translator Trainer, v16 n4 p558-576 2022
Rubric scoring has been gaining traction as an emergent method to assess spoken-language interpreting, with two of the most well-known methods being rating scale-based holistic and analytic scoring. While the former provides a single global score, the latter generates separate scores on different dimensions of interpreting performance. Despite the growing use of the two methods, there has been little research documenting their uses in interpreting assessment. We therefore conducted the present study to find out how scoring methods (i.e. holistic versus analytic) would affect the dependability of rater-generated scores, rater behaviour, assessment outcomes, and rater perceptions. Overall, our quantitative data analysis indicates that although the two methods rank-ordered performances similarly, the holistic scoring led to relatively higher score dependability, regardless of interpreting directions, and that the raters' assessments of interpreting into their less dominant language were less dependable. Our content analysis of the qualitative data reveals raters' concerns with the substantive meaning of holistic scores and the design of analytic descriptors. We discussed these findings in light of available literature on interpreting assessment. By doing so, we hope to provide some evidential basis for scale selection in rater-mediated assessment of spoken-language interpreting.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A