ERIC Number: EJ1335281
Record Type: Journal
Publication Date: 2022-Apr
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
What the Analytic versus Holistic Scoring of International Teaching Assistants Can Reveal: Lexical Grammar Matters
Language Testing, v39 n2 p239-264 Apr 2022
Second-language (L2) testing researchers have explored the relationship between speakers' overall speaking ability, reflected by holistic scores, and the speakers' performance on speaking subcomponents, reflected by analytic scores (e.g., McNamara, 1990; Sato, 2011). These research studies have advanced applied linguists' understanding of how raters view the components of effective speaking skills, but the authors of the studies either used analytic composite scores, instead of true holistic ratings, or ran regression analyses with highly correlated subscores, which is problematic. To address these issues, 10 experienced ITA raters rated the speaking of 127 international teaching assistant (ITA) candidates using a four-component analytic rubric. In addition, holistic ratings were provided for the 127 test takers from a separate (earlier) scoring by two experienced ITA raters. The two types of scores differentiated examinees in similar ways. The variability observed in students' holistic scores was reflected in their analytic scores. However, among the four analytic subscales, examinees' scores on Lexical and Grammatical Competence had the greatest differentiating power. Its scores indicated with a high level of accuracy who passed the test and who did not. The paper discusses the components contributing to ITAs' L2 oral speaking proficiency, and reviews pedagogical implications.
Descriptors: Language Tests, Teaching Assistants, Second Language Learning, Second Language Instruction, Scores, Graduate Students, Evaluators, Scoring Rubrics, Holistic Approach, Pronunciation, Speech Communication, Grammar, Vocabulary Skills, Accuracy, Teaching Methods, Language Proficiency, Oral Language, Foreign Students, Applied Linguistics, Teacher Education Programs, Language Teachers, Majors (Students), State Universities
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Michigan
Grant or Contract Numbers: N/A
Data File: URL: https://bibliotheek.ehb.be:2102/10.3886/E115966V2