The effect of visual stimuli on auditory detection in a auditory attention task

Jingjing Yang, Xiujun Li, Qi Li, Xinwei Xiao, Qiong Wu, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8°), right (+8°) or central (0°) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1567-1572
Number of pages6
ISBN (Electronic)9781509067572
DOIs
Publication statusPublished - Aug 23 2017
Event14th IEEE International Conference on Mechatronics and Automation, ICMA 2017 - Takamatsu, Japan
Duration: Aug 6 2017Aug 9 2017

Other

Other14th IEEE International Conference on Mechatronics and Automation, ICMA 2017
CountryJapan
CityTakamatsu
Period8/6/178/9/17

Keywords

  • Audiovisual interaction
  • Event-related potential
  • Spatial information

ASJC Scopus subject areas

  • Control and Optimization
  • Instrumentation
  • Artificial Intelligence
  • Industrial and Manufacturing Engineering
  • Mechanical Engineering

Fingerprint Dive into the research topics of 'The effect of visual stimuli on auditory detection in a auditory attention task'. Together they form a unique fingerprint.

  • Cite this

    Yang, J., Li, X., Li, Q., Xiao, X., Wu, Q., & Wu, J. (2017). The effect of visual stimuli on auditory detection in a auditory attention task. In 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017 (pp. 1567-1572). [8016050] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2017.8016050