ERIC Number: EJ1219197
Record Type: Journal
Publication Date: 2019
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Can Subject Matter Experts Rate the English Language Skills of Customer Services Representatives (CSRs) at Work in Indian Contact Centre?
Lockwood, Jane; Raquel, Michelle
Language Assessment Quarterly, v16 n1 p87-104 2019
Millions of customer services representatives are assessed each year by subject matter experts (e.g., recruiters, team leaders) in Asian contact centres to ensure good spoken communication skills when serving customers on the phones. In other workplace contexts, language experts are employed to do this work but in Asian contact centres, a successful transfer of language expert assessment knowledge and skills to subject matter experts is preferred for practical and cost reasons. To date however, no studies have been carried out to demonstrate that subject matter experts can do this language assessment in a reliable way. This study explores how a linguistically-informed spoken assessment rubric, called the Business Performance Assessment Scale (BUPLAS), is used by subject matter experts to assess the English communication skills of customer service representatives employed in an India-based contact centre. After a week-long training programme on how to use BUPLAS, the results revealed that the subject matter experts had high intra-rater and inter-rater reliability when they scored real calls. They also understood, interpreted, and 'indigenously scored' the linguistically-informed criteria. The implications of these results in deferring to subject matter experts to conduct language assessments in this workplace are discussed.
Descriptors: English (Second Language), Second Language Learning, Language Skills, Telecommunications, Service Occupations, Scoring Rubrics, Work Environment, Specialists, Speech Communication, Language Tests, Indians, Employees, Interrater Reliability, Communication Skills, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: India
Grant or Contract Numbers: N/A