ERIC Number: EJ1397032
Record Type: Journal
Publication Date: 2023
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: EISSN-1543-4311
Examining the Scoring of Content Integration in a Listening-Speaking Test: A G-Theory Analysis
Language Assessment Quarterly, v20 n3 p319-338 2023
Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a listening-speaking test in Chinese. International students who were non-native speakers of Chinese took the test that comprised two retell tasks and an oral presentation linked by an academic scenario. They were scored for content integration, organization, delivery, and language control for all three tasks. Multivariate generalizability theory (G-theory) was used to investigate the functioning of content integration in the analytic rubric of the retell tasks and oral presentation respectively. Overall, this study aimed to illuminate issues on dependability and construct validity for the two task types, focusing on content integration particularly. The findings suggested that content integration functioned differently to some extent when compared with the other dimensions studied.
Descriptors: Listening Comprehension Tests, Generalization, Chinese, Second Language Learning, Task Analysis, Course Content, Oral Language, Language Tests, Scoring Rubrics, Communicative Competence (Languages), Language Usage, Foreign Students, College Students, Foreign Countries, Evaluators, Language Proficiency
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A