Audiovisual integration of emotional signals from others' social interactions


Piwek, L., Pollick, F. and Petrini, K., 2015. Audiovisual integration of emotional signals from others' social interactions. Frontiers in Psychology, 6, 611.

Related documents:

This repository does not currently have the full-text of this item.
You may be able to access a copy if URLs are provided below. (Contact Author)

Official URL:

Related URLs:


Audiovisual perception of emotions has been typically examined using displays of a solitary character (e.g., the face-voice and/or body-sound of one actor). However, in real life humans often face more complex multisensory social situations, involving more than one person. Here we ask if the audiovisual facilitation in emotion recognition previously found in simpler social situations extends to more complex and ecological situations. Stimuli consisting of the biological motion and voice of two interacting agents were used in two experiments. In Experiment 1, participants were presented with visual, auditory, auditory filtered/noisy, and audiovisual congruent and incongruent clips. We asked participants to judge whether the two agents were interacting happily or angrily. In Experiment 2, another group of participants repeated the same task, as in Experiment 1, while trying to ignore either the visual or the auditory information. The findings from both experiments indicate that when the reliability of the auditory cue was decreased participants weighted more the visual cue in their emotional judgments. This in turn translated in increased emotion recognition accuracy for the multisensory condition. Our findings thus point to a common mechanism of multisensory integration of emotional signals irrespective of social stimulus complexity.


Item Type Articles
CreatorsPiwek, L., Pollick, F. and Petrini, K.
Related URLs
Uncontrolled Keywordsanger,happiness,multisensory integration,point-light displays,social interactions,voice
DepartmentsSchool of Management
Faculty of Humanities & Social Sciences > Psychology
ID Code46262


Actions (login required)

View Item