This study compared holistic and analytic marking methods for their effects on parameter estimation (of examinees, raters, and items) and rater cognition in assessing speech act production in L2 Chinese. Seventy American learners of Chinese completed an oral Discourse Completion Test assessing requests and refusals. Four first-language (L1)…

This study examines language attitudes towards different varieties of English through listener judgments of speaker and speech traits; in addition, the study explores the relationship of these judgments to the intelligibility, as well as the perceived accentedness and comprehensibility, of varieties of Asian English and General American English.…

Factors that affect comprehension of accented English (e.g., Harding, 2011) have been well studied, but little research examines how listeners' proficiency affects their sensitivity to second language (L2) accent. The current study investigated the effect of test takers' English proficiency on their comprehension ratings and ability to correctly…

Adopting Linacre's guidelines for evaluating rating scale effectiveness, we examined whether and how a six-point rating scale functioned differently across raters, speech acts, and second language (L2) proficiency levels. We developed a 12-item Computerized Oral Discourse Completion Task (CODCT) for assessing the production of requests, refusals,…

The speech of second language learners is often influenced by phonetic patterns of their first language. This can make them difficult to understand, but sometimes for listeners of the same first language to a lesser extent than for native listeners. The present study investigates listeners' awareness of the accent by asking whether accented speech…

The effects of repeated oral reading and timed reading on L2 oral reading fluency were examined among Japanese university students (N = 50) over 12 weeks. Three quasi-experimental groups were used in the study. Group 1 practiced two types of reading: Repeated oral reading with chunking practice and timed reading. Group 2 did timed reading only.…

The current study examined the extent to which native speakers of North American and Singapore English differentially perceive the comprehensibility (ease of understanding) of second language (L2) speech. Spontaneous speech samples elicited from 50 Japanese learners of English with various proficiency levels were first rated by 10 Canadian and 10…

The current study examined how two groups of native speakers--monolingual Canadians and multilingual Singaporeans--differentially perceive foreign accentedness in spontaneous second language (L2) speech. The Singaporean raters, who had exposure to various models of English and also spoke multiple L2s on a daily basis, demonstrated more lenient…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

Research in second language speech has often focused on listeners' accent judgment and factors that affect their perception. However, the topic of listeners' application of specific sound categories in their own perceptual judgments has not been widely investigated. The current study explored how listeners from diverse language backgrounds weighed…

This study reports the development of a scale to evaluate the speech act performance by intermediate-level Chinese learners of English. A qualitative analysis of the American raters' comments was conducted on learner scripts in response to a total of 16 apology and request written discourse completion task (WDCT) situations. The results showed…