Multisensory interactions of audiovisual stimuli presented at different locations in auditory-attention tasks: A event-related potential (ERP) study

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

we applied behavioral and event-related potential (ERP) measures to study the multisensory interactions of audiovisual stimuli presented at different locations in an auditory-attention task in which an irrelevant visual stimulus occasionally accompanied the auditory stimulus. A stream of visual (V), auditory (A), spatially congruent audiovisual (AV-Con), and spatially incongruent audiovisual (AV-Inc) stimuli were randomly presented to the left and/or right side; subjects covertly attended to the auditory stimuli on either the left or right side and promptly responded to auditory targets on that side. In present study, we only investigated the results which were related with multisensory interactions of audiovisual stimuli presented at different locations. ERPs to A, V-Inc which is at opposite locations with A, and AV-Inc stimuli were recorded. The neural basis of multisensory interactions of audiovisual stimuli presented at different location was studied by comparing ERPs to the AV-Inc stimuli with the sum of the ERPs to the unimodal A and V-Inc stimuli. ERPs results showed that main audiovisual interactions were found as a negativity in mid-central scalp sites around a latency of 300ms during the later stage of processing. The present results revealed the neural basis of multisensory interaction of audiovisual stimuli presented at different locations in an auditory-attention task. The study can offer base data for multi-sensor data fusion algorithms and robotics.

Original languageEnglish
Title of host publication2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009
Pages146-151
Number of pages6
DOIs
Publication statusPublished - Dec 1 2009
Event2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009 - Changchun, China
Duration: Aug 9 2009Aug 12 2009

Publication series

Name2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009

Other

Other2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009
CountryChina
CityChangchun
Period8/9/098/12/09

Keywords

  • Audiovisual interaction
  • Electrophysiology
  • Event-related potentials
  • Multi-sensor data fusion

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Multisensory interactions of audiovisual stimuli presented at different locations in auditory-attention tasks: A event-related potential (ERP) study'. Together they form a unique fingerprint.

  • Cite this

    Li, Q., & Wu, J. (2009). Multisensory interactions of audiovisual stimuli presented at different locations in auditory-attention tasks: A event-related potential (ERP) study. In 2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009 (pp. 146-151). [5245991] (2009 IEEE International Conference on Mechatronics and Automation, ICMA 2009). https://doi.org/10.1109/ICMA.2009.5245991