Two experiments investigate the effectiveness of audiovisual (AV) speech cues (cues derived from both seeing and hearing a talker speak) in facilitating perceptual learning of spectrally distorted speech. Speech was distorted through an eight channel noise-vocoder which shifted the spectral envelope of the speech signal to simulate the properties…

Previous research has shown that in different languages ironic speech is acoustically modulated compared to literal speech, and these modulations are assumed to aid the listener in the comprehension process by acting as cues that mark utterances as ironic. The present study was conducted to identify paraverbal features of German "ironic…

While visual signals that accompany spoken language serve to augment the communicative message, the same visual ingredients form the substance of the linguistic system in sign languages. This article provides an analysis of visual signals that comprise part of the intonational system of a sign language. The system is conveyed mainly by particular…

In this article we report on two experiments about the perception of audiovisual cues to emotional speech. The article addresses two questions: (1) how do visual cues from a speaker's face to emotion relate to auditory cues, and (2) what is the recognition speed for various facial cues to emotion? Both experiments reported below are based on tests…

The present study investigated the existence of a Japanese mental syllabary and units stored therein for speech production. Experiment 1 compared naming latencies between high and low initial mora frequencies using CVCVCV nonwords, indicating that nonwords with a high initial mora frequency were named faster than those with a low frequency initial…

A visual semantic categorization task in English was performed by native English speakers (Experiment 1) and late bilinguals whose first language was Japanese (Experiment 2) or Spanish (Experiment 3). In the critical conditions, the target word was a homophone of a correct category exemplar (e.g., A BODY OF WATER-SEE; cf. SEA) or a word that…

Whereas several studies have explored the expression of emotions, little is known on how the visual and audio channels are combined during production of what we call the more controlled social affects, for example, "attitudinal" expressions. This article presents a perception study of the audovisual expression of 12 Japanese and 6 French…

This paper compares the production and perception of the rise-fall contour of contrastive statements and the final rise-fall part of polar questions in Greek. The results show that these superficially similar rise-falls exhibit fine phonetic differences in the alignment of tonal targets with the segmental string, and that these differences can be…

We report four experiments designed to determine whether visual information affects judgments of acoustically-specified nonspeech events as well as speech events (the "McGurk effect"). Previous findings have shown only weak McGurk effects for nonspeech stimuli, whereas strong effects are found for consonants. We used click sounds that…