ERIC Number: EJ874815
Record Type: Journal
Publication Date: 2010-Apr
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0010-0277
EISSN: N/A
Cross-Modal Facilitation in Speech Prosody
Foxton, Jessica M.; Riviere, Louis-David; Barone, Pascal
Cognition, v115 n1 p71-78 Apr 2010
Speech prosody has traditionally been considered solely in terms of its auditory features, yet correlated visual features exist, such as head and eyebrow movements. This study investigated the extent to which visual prosodic features are able to affect the perception of the auditory features. Participants were presented with videos of a speaker pronouncing two words, with visual features of emphasis on one of these words. For each trial, participants saw one video where the two words were identical in both pitch and amplitude, and another video where there was a difference in either pitch or amplitude that was congruent or incongruent with the visual changes. Participants were asked to decide which video contained the sound difference. Thresholds were obtained for the congruent and incongruent videos, and for an auditory-alone condition. It was found that the congruent thresholds were better than the incongruent thresholds for both pitch and amplitude changes. Interestingly, the congruent thresholds for amplitude were better than for the auditory-alone condition, which implies that the visual features improve sensitivity to loudness changes. These results demonstrate that visual stimuli can affect auditory thresholds for changes in pitch and amplitude, and furthermore support the view that visual prosodic features enhance speech processing. (Contains 1 table and 3 figures.)
Descriptors: Visual Stimuli, Speech Communication, Suprasegmentals, Human Body, Motion, Speech, Auditory Perception, Video Technology, Evaluation Methods, Language Processing
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://bibliotheek.ehb.be:2131
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A