This study examines a 30-item Spanish elicited imitation task (EIT) as a measure of global language proficiency for heritage language (HL) learners of Spanish. Results from Rasch modeling suggest that, while EIT scores demonstrated excellent reliability, the ability of much of the HL sample far exceeded the difficulty of the items. Differential…

In the assessment of second language oral communication, the video-call speaking test has received increasing attention as a test method with higher practicality than its in-person counterpart, but still with broad coverage of the test construct. Previous studies into video-call assessment have focussed on the individual (as opposed to paired or…

Complexity, accuracy, and fluency (CAF) as measures of language proficiency have been used extensively in assessing second language production in English language studies related to task-based language teaching. The present review adds the following critical elements to the existing body of literature: (i) Provides synthesis and critical analysis…

The main aim of this study was to investigate how oral fluency is assessed across different levels of proficiency in the Test of English for Educational Purposes (TEEP). Working with data from 56 test-takers performing a monologic task at a range of proficiency levels (equivalent to approximately levels 5.0, 5.5, 6.5, and 7.5 in the IELTS scoring…

A language 'test' is a systematic procedure for observing a person's behavior and describing it with the aid of a numerical scale or category system (Cronbach LJ 1971: 26). A test cannot be based on a selection of items chosen on linguistic grounds alone, and that to devise an effective test, it is necessary to specify how an examinee requires to…

This paper represents a summary and discussion of the three studies presented at the morning session of the Fall 2022 JALT Vocabulary SIG. The papers, which were written by Ali Al-Hoorie, Masaki Eguchi, Derek Canning, Stuart McLean, Christopher Nicklin, and Joseph Vitta, represent a range of topics and study designs that are common in recent…

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…

This study examined the perceived and assessed speaking proficiency levels of 10 in-service Spanish teachers, their use of Spanish in and outside of work, and factors that motivate or hinder the maintenance or development of their proficiency. It also compared their current proficiency levels with their proficiency levels before completion of…

This study examines the developmental relationship between L2 Chinese oral fluency and self-repair in Dutch students learning Chinese. In this study, 76 junior Dutch students were split into two different groups based on level and were tested at two time periods (T1 and T2) for L2 Chinese fluency, which included the control variables of repetition…

In response to the calls for making key stakeholders' perspectives relevant in the test validation process, the study discussed in this report sought test-taker feedback as part of collecting validity evidence and supporting the ongoing field testing efforts of the new "TOEFL ITP"® Speaking section. Specifically, I aimed to investigate…

The study aims to determine whether exposing EFL Saudi undergraduate students to TED talks could effectively contribute to the improvement of their oral language proficiency. To achieve this goal, 32 English as a Foreign Language Saudi undergraduate students were recruited to participate in the study. These students were selected based on their…

Social media is a communication tool that facilitates EFL students to improve their speaking proficiency as it enables them to fully engage in oral communication, exchange information, and form long-term bonds in this modern era. This study intended to investigate EFL students' social media as speaking strategies used vis-a-vis their speaking…

We closely replicated Wu and Ortega (2013), who found that an elicited imitation test (EIT) reliably distinguished low-level from high-level language abilities among instructed second language (L2) learners of Mandarin Chinese. The original study sampled learners: (1) from second-level courses to represent low-level language abilities; and (2)…

Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a…

This study builds upon previous research investigating the construct validity of phraseological complexity as an index of L2 development and proficiency. Whereas previous studies have focused on cross-sectional comparisons of written productions across proficiency levels, the current study compares the "longitudinal" development of…