Document Detail


Prosodic Temporal Alignment of Co-speech Gestures to Speech Facilitates Referent Resolution.
MedLine Citation:
PMID:  22545598     Owner:  NLM     Status:  Publisher    
Abstract/OtherAbstract:
Using a referent detection paradigm, we examined whether listeners can determine the object speakers are referring to by using the temporal alignment between the motion speakers impose on objects and their labeling utterances. Stimuli were created by videotaping speakers labeling a novel creature. Without being explicitly instructed to do so, speakers moved the creature during labeling. Trajectories of these motions were used to animate photographs of the creature. Participants in subsequent perception studies heard these labeling utterances while seeing side-by-side animations of two identical creatures in which only the target creature moved as originally intended by the speaker. Using the cross-modal temporal relationship between speech and referent motion, participants identified which creature the speaker was labeling, even when the labeling utterances were low-pass filtered to remove their semantic content or replaced by tone analogues. However, when the prosodic structure was eliminated by reversing the speech signal, participants no longer detected the referent as readily. These results provide strong support for a prosodic cross-modal alignment hypothesis. Speakers produce a perceptible link between the motion they impose upon a referent and the prosodic structure of their speech, and listeners readily use this prosodic cross-modal relationship to resolve referential ambiguity in word-learning situations. (PsycINFO Database Record (c) 2012 APA, all rights reserved).
Authors:
Alexandra Jesse; Elizabeth K Johnson
Related Documents :
2630388 - Consideration of spatial orientation mechanisms as related to elderly fallers.
20226498 - Functional morphology of cercopithecoid primate metacarpals.
3346688 - Postural adjustments associated with rapid voluntary arm movements. ii. biomechanical a...
18719898 - Asymmetric adaptation with functional advantage in human sensorimotor control.
6620718 - Circadian rhythm of human electroretinogram.
23583318 - Light sources used in evaluating oral leukoplakia: broadband white light versus narrowb...
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2012-4-30
Journal Detail:
Title:  Journal of experimental psychology. Human perception and performance     Volume:  -     ISSN:  1939-1277     ISO Abbreviation:  -     Publication Date:  2012 Apr 
Date Detail:
Created Date:  2012-5-1     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  7502589     Medline TA:  J Exp Psychol Hum Percept Perform     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Why Confessions Trump Innocence.
Next Document:  Spatial attention modulates the precedence effect.