ERIC Number: EJ1219193
Record Type: Journal
Publication Date: 2019
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Validating an L2 Academic Group Oral Assessment: Insights from a Spoken Learner Corpus
Language Assessment Quarterly, v16 n1 p39-63 2019
This study determines the fine-grained bottom-up linguistic features involved in successful second language (L2) English academic group oral tutorial discussion through the use of a spoken learner corpus composed of more than 20 hrs of L2 production. Student performances were graded by teacher-raters using a can-do rating scale, which assessed students' ability to participate in a group academic oral discussion. The performances were transcribed and annotated for linguistic features such as L2 errors, a range of interactive and interpersonal metadiscourse features, and a range of temporal, prosodic, lexical, and syntactic markers (or "fluencemes") of (dis)fluency. The results of the corpus study suggest that frequent use of metadiscourse is the primary indicator of raters' positive evaluation of student performance in L2 academic tutorial discussion, alongside frequent use of discourse markers, filled pauses, and a high speech rate per minute as fluencemes. Most L2 error types and syntactic fluencemes did not particularly feature in raters' positive (or negative) evaluations. The detailed cross-sectional data afforded by this corpus analysis serve as quantitative evidence of the linguistic features accompanying each grade awarded across the rating scale and contributing to the construct validity of the assessment.
Descriptors: Computational Linguistics, Second Language Learning, Second Language Instruction, Error Patterns, Interpersonal Communication, Syntax, Intonation, Suprasegmentals, Oral Language, Group Discussion, English (Second Language), Language Fluency, Language Usage, Evaluators, Rating Scales, Construct Validity, Academic Language, Foreign Countries, Undergraduate Students, English for Academic Purposes, Scoring Rubrics, Grades (Scholastic), Language Tests, Language Proficiency, Test Validity
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Hong Kong
Grant or Contract Numbers: N/A