ERIC Number: EJ1378538
Record Type: Journal
Publication Date: 2023-May
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0272-2631
EISSN: EISSN-1470-1545
A Closer Look at a Marginalized Test Method: Self-Assessment as a Measure of Speaking Proficiency
Winke, Paula; Zhang, Xiaowan; Pierce, Steven J.
Studies in Second Language Acquisition, v45 n2 p416-441 May 2023
Second language (L2) teachers may shy away from self-assessments because of warnings that students are not accurate self-assessors. This information stems from meta-analyses in which self-assessment scores on average did not correlate highly with proficiency test results. However, researchers mostly used Pearson correlations, when polyserial could be used. Furthermore, self-assessments today can be computer adaptive. With them, nonlinear statistics are needed to investigate their relationship with other measurements. We wondered, if we explored the relationship between self-assessment and proficiency test scores using more robust measurements (polyserial correlation, continuation-ratio modeling), would we find different results? We had 807 L2-Spanish learners take a computer-adaptive, L2-speaking self-assessment and the ACTFL Oral Proficiency Interview-computer (OPIc). The scores correlated at 0.61 (polyserial). Using continuation-ratio modeling, we found each unit of increase on the OPIc scale was associated with a 131% increase in the odds of passing the self-assessment thresholds. In other words, a student was more likely to move on to higher self-assessment subsections if they had a higher OPIc rating. We found computer-adaptive self-assessments appropriate for low-stakes L2-proficiency measurements, especially because they are cost-effective, make intuitive sense to learners, and promote learner agency.
Descriptors: Second Language Learning, Second Language Instruction, Self Evaluation (Individuals), Language Proficiency, Scores, Measurement Techniques, Oral Language, Cost Effectiveness, Student Attitudes, Personal Autonomy
Cambridge University Press. 100 Brook Hill Drive, West Nyack, NY 10994. Tel: 800-872-7423; Tel: 845-353-7500; Fax: 845-353-4141; e-mail: subscriptions_newyork@cambridge.org; Web site: https://www.cambridge.org/core/what-we-publish/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: ACTFL Oral Proficiency Interview
Grant or Contract Numbers: N/A