Task-irrelevant auditory stimuli affect audiovisual integration in a visual attention task: Evidence from event-related potentials

Jingjing Yang, Qi Li, Yulin Gao, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Integration of information from multiple senses is fundamental to perception and cognition, but the neural activity of multimodal audiovisual integration remains unclear. This study used event-related potentials (ERPs) to demonstrate that onset synchronous task-irrelevant auditory stimuli affect the audiovisual integration. The behavioral results showed that the responses to audiovisual target stimuli were faster than that to unimodal visual target stimuli. Moreover, the ERPs were recorded in response to unimodal auditory (A), unimodal visual (V) and bimodal (AV) stimuli. Cross-modal interactions were estimated using the additive [AV - (A + V)] model. Four ERP components related to audiovisual integration were observed: (1) over central and occipital areas at around100 to 160ms; (2) over the central and occipital areas at around 160 to 200ms; (3) over the occipital areas at around 200 to 240ms. (4) over frontal-central areas at around 280 to 320ms. These findings confirmed the main neural activity of audiovisual integration. In addition, our study provided evidence that multimodal integration can be generated even if the auditory stimulus was task- irrelevant.

Original languageEnglish
Title of host publication2011 IEEE/ICME International Conference on Complex Medical Engineering, CME 2011
Pages248-253
Number of pages6
DOIs
Publication statusPublished - Jul 11 2011
Event2011 5th IEEE/ICME International Conference on Complex Medical Engineering, CME 2011 - Harbin, China
Duration: May 22 2011May 25 2011

Publication series

Name2011 IEEE/ICME International Conference on Complex Medical Engineering, CME 2011

Other

Other2011 5th IEEE/ICME International Conference on Complex Medical Engineering, CME 2011
CountryChina
CityHarbin
Period5/22/115/25/11

Keywords

  • Audiovisual integration
  • event-related potential
  • task-irrelevant

ASJC Scopus subject areas

  • Biomedical Engineering

Cite this

Yang, J., Li, Q., Gao, Y., & Wu, J. (2011). Task-irrelevant auditory stimuli affect audiovisual integration in a visual attention task: Evidence from event-related potentials. In 2011 IEEE/ICME International Conference on Complex Medical Engineering, CME 2011 (pp. 248-253). [5876744] (2011 IEEE/ICME International Conference on Complex Medical Engineering, CME 2011). https://doi.org/10.1109/ICCME.2011.5876744