The effect of temporal asynchrony on audiovisual integration

Jingjing Yang, Xiujun Li, Qi Li, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many studies have shown that temporal asynchrony of visual-auditory stimuli can influence the integration between visual and auditory modality, however, the multisensory mechanisms of asynchronous inputs were not well understood. To investigate the effect of temporal asynchrony on audiovisual integration, we measured event-related potentials (ERPs) and behavior in human subjects. In this study, visual and auditory stimuli onset asynchronous (SOA= ±100 ms, ±50 ms, 0 ms), both the auditory and visual stimuli were attended. Using event-related potential, the differences of audiovisual integration elicited by asynchronous audiovisual stimuli were found at 140-200 ms over a wide parietal and occipital regions. These results revealed the asynchronous audiovisual stimuli enhanced the detection and elicited audiovisual integration. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2338-2343
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - Sep 1 2016
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: Aug 7 2016Aug 10 2016

Other

Other13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
CountryChina
CityHarbin, Heilongjiang
Period8/7/168/10/16

Keywords

  • Audiovisual interaction
  • event-related potential
  • spatial information

ASJC Scopus subject areas

  • Mechanical Engineering
  • Artificial Intelligence
  • Computer Science Applications
  • Software

Fingerprint Dive into the research topics of 'The effect of temporal asynchrony on audiovisual integration'. Together they form a unique fingerprint.

Cite this