Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds

Qingqing Li, Qiong Wu, Yiyang Yu, Fengxia Wu, Satoshi Takahashi, Yoshimichi Ejima, Jiajia Yang, Jinglong Wu

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects.

Original languageEnglish
Journali-Perception
Volume11
Issue number6
DOIs
Publication statusPublished - 2020

Keywords

  • attentional load
  • audiovisual integration
  • common object
  • dual-task paradigm
  • semantic congruency

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Ophthalmology
  • Sensory Systems
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds'. Together they form a unique fingerprint.

Cite this