Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

Integrated test tasks, such as listening-to-speak or reading-to-write, are increasingly used in second language assessment despite relatively limited empirical insights into what they assess. Most research on integrated tasks has primarily focused on the productive skills involved; studies exploring the receptive skills mostly investigated tasks…

This study examines how foreign language anxiety (FLA) and proficiency relate to second language (L2) utterance fluency during a final oral exam. Thirty-eight learners of Spanish (L1 English) completed unplanned narratives that were coded for ratio and length of pauses between and within Analysis of Speech Units, mean length of run, phonation-time…

We addressed Deville and Chalhoub-Deville's (2006), Schoonen's (2012), and Xi and Mollaun's (2006) call for research into the contextual features that are considered related to person-by-task interactions in the framework of generalizability theory in two ways. First, we quantitatively synthesized the generalizability studies to determine the…

There is growing research on the linguistic features that most contribute to making second language (L2) speech easy or difficult to understand. Comprehensibility, which is usually captured through listener judgments, is increasingly viewed as integral to the L2 speaking construct. However, there are shortcomings in how this construct is…

Despite the growing popularity of paired format speaking assessments, the effects of pre-task planning time on performance in these formats are not yet well understood. For example, some studies have revealed the benefits of planning but others have not. Using a multifaceted approach including analysis of the process of speaking performance, the…

Performance on integrated tasks requires candidates to engage skills and strategies beyond language proficiency alone, in ways that can be difficult to define and measure for testing purposes. While it has been widely recognized that stimulus materials impact test performance, our understanding of the way in which test takers make use of these…

This study examines the associations between the speaking proficiency of 181 adult learners of Dutch as a second language and their linguistic competences. Performance in eight speaking tasks was rated on a scale of communicative adequacy. After extrapolation of these ratings to the Overall Oral Production scale of the Common European Framework of…

Motivated by cognitive theories of graph comprehension, this study systematically manipulated characteristics of a line graph description task in a speaking test in ways to mitigate the influence of graph familiarity, a potential source of construct-irrelevant variance. It extends Xi (2005), which found that the differences in holistic scores on…

The assessment of oral language is now quite commonly done in pairs or groups, and there is a growing body of research which investigates the related issues (e.g. May, 2007). Writing generally tends to be thought of as an individual activity, although a small number of studies have documented the advantages of collaboration in writing in the…

Reviews assumptions underlying approaches to research into speaking task difficulty and questions the view that test scores always vary with task conditions or discourse variation. Offers a new approach to defining task difficulty in terms of the interaction between pragmatic task features and first language cultural background. Results of a study…

This article examines the effects of test format and task type on candidate output in direct and semidirect versions of the oral interaction subtest of the Australian Assessment of Communicative English Skills. Results are discussed in relation to the degree of interactiveness and other factors that appear to influence lexical density and to the…

Investigated the impact of performance conditions on perceptions of task difficulty in a test of spoken language, in light of the cognitive complexity framework proposed by Skehan (1998). Candidates performed narrative tasks whose characteristics and the conditions under which they were performed were manipulated, and the impact of these on task…

Examines what opportunities test takers have to display their knowledge of managing conversations in the second language in two types of tasks: nonscripted interviews and guided role-play activities. Data consists of 30 interviews and 30 role-play activities between near-native examiners and intermediate learners used in language exams in Hungary.…

FACETS many-facet Rasch analysis software was utilized to look at two consecutive administrations of a large-scale second language oral assessment in the form of a peer group discussion task with Japanese English-major university students. Results are discussed. (Author/VWL)