The factors that influence rater scoring have been a subject of great interest to researchers in second language assessment. However, the research on the impact of test-takers' speech profiles (e.g., a jagged or a flat profile reflecting analytic subscores) on raters' scoring behaviors remains to be seen. To investigate the role of speech profiles…

Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US…

Second language (L2) learners can assess their oral skills with some accuracy. A question is whether learners can reliably use self-assessment to track their language gains over time. During the spring of two subsequent years, 80 university L2 Chinese learners completed an oral skills self-assessment based on the NCSSFL-ACTFL Can-Do Statements…

Answering calls to map college-level proficiency development (Modern Language Association, 2007) and longitudinally chart language learning (Barkaoui, 2014; Ortega & Byrnes, 2008), we mapped the oral proficiency growth of 1,922 lower-division college students of Chinese, French, Russian, and Spanish (in the second, third, or fourth semester of…

This study represents program-level action research. A U.S. university Spanish language program had a goal for students to reach the ACTFL (2012) Intermediate Mid level after 2 years. An empirical question that resulted after regular end-of-year testing was whether the students were doing their best on assessments. To investigate this, 253…

To examine the effects of listening test preparation, we had three groups, two experimental and one control (63 learners total), partake in three types of instruction sandwiched between two equally difficult listening tests (pretests and posttests). The first experimental group took four practice tests and received "explicit"…

Based on evidence that listeners may favor certain foreign accents over others (Gass & Varonis, 1984; Major, Fitzmaurice, Bunta, & Balasubramanian, 2002; Tauroza & Luk, 1997) and that language-test raters may better comprehend and/or rate the speech of test takers whose native languages (L1s) are more familiar on some level (Carey,…

We adapted three practice College Scholastic Ability Tests (CSAT) of English listening, each with five-option items, to create four- and three-option versions by asking 73 Korean speakers or learners of English to eliminate the least plausible options in two rounds. Two hundred and sixty-four Korean high school English-language learners formed…

This study investigated the effects of captioning during video-based listening activities. Second- and fourth-year learners of Arabic, Chinese, Spanish, and Russian watched three short videos with and without captioning in randomized order. Spanish learners had two additional groups: one watched the videos twice with no captioning, and another…