The effect of visual stimuli on auditory detection in a auditory attention task

Jingjing Yang, Xiujun Li, Qi Li, Xinwei Xiao, Qiong Wu, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8°), right (+8°) or central (0°) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1567-1572
Number of pages6
ISBN (Electronic)9781509067572
DOIs
Publication statusPublished - Aug 23 2017
Event14th IEEE International Conference on Mechatronics and Automation, ICMA 2017 - Takamatsu, Japan
Duration: Aug 6 2017Aug 9 2017

Other

Other14th IEEE International Conference on Mechatronics and Automation, ICMA 2017
CountryJapan
CityTakamatsu
Period8/6/178/9/17

Fingerprint

visual stimuli
auditory stimuli
stimuli
Artificial intelligence
Display devices
Spatial Information
Inconsistent
artificial intelligence
flash
Vision
Flash
Interaction
interactions
Biased
Artificial Intelligence
Display

Keywords

  • Audiovisual interaction
  • Event-related potential
  • Spatial information

ASJC Scopus subject areas

  • Control and Optimization
  • Instrumentation
  • Artificial Intelligence
  • Industrial and Manufacturing Engineering
  • Mechanical Engineering

Cite this

Yang, J., Li, X., Li, Q., Xiao, X., Wu, Q., & Wu, J. (2017). The effect of visual stimuli on auditory detection in a auditory attention task. In 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017 (pp. 1567-1572). [8016050] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2017.8016050

The effect of visual stimuli on auditory detection in a auditory attention task. / Yang, Jingjing; Li, Xiujun; Li, Qi; Xiao, Xinwei; Wu, Qiong; Wu, Jinglong.

2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 1567-1572 8016050.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, J, Li, X, Li, Q, Xiao, X, Wu, Q & Wu, J 2017, The effect of visual stimuli on auditory detection in a auditory attention task. in 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017., 8016050, Institute of Electrical and Electronics Engineers Inc., pp. 1567-1572, 14th IEEE International Conference on Mechatronics and Automation, ICMA 2017, Takamatsu, Japan, 8/6/17. https://doi.org/10.1109/ICMA.2017.8016050
Yang J, Li X, Li Q, Xiao X, Wu Q, Wu J. The effect of visual stimuli on auditory detection in a auditory attention task. In 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1567-1572. 8016050 https://doi.org/10.1109/ICMA.2017.8016050
Yang, Jingjing ; Li, Xiujun ; Li, Qi ; Xiao, Xinwei ; Wu, Qiong ; Wu, Jinglong. / The effect of visual stimuli on auditory detection in a auditory attention task. 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1567-1572
@inproceedings{f72f8012549f4bdc92315b1383120c45,
title = "The effect of visual stimuli on auditory detection in a auditory attention task",
abstract = "Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8°), right (+8°) or central (0°) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.",
keywords = "Audiovisual interaction, Event-related potential, Spatial information",
author = "Jingjing Yang and Xiujun Li and Qi Li and Xinwei Xiao and Qiong Wu and Jinglong Wu",
year = "2017",
month = "8",
day = "23",
doi = "10.1109/ICMA.2017.8016050",
language = "English",
pages = "1567--1572",
booktitle = "2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - The effect of visual stimuli on auditory detection in a auditory attention task

AU - Yang, Jingjing

AU - Li, Xiujun

AU - Li, Qi

AU - Xiao, Xinwei

AU - Wu, Qiong

AU - Wu, Jinglong

PY - 2017/8/23

Y1 - 2017/8/23

N2 - Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8°), right (+8°) or central (0°) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

AB - Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8°), right (+8°) or central (0°) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

KW - Audiovisual interaction

KW - Event-related potential

KW - Spatial information

UR - http://www.scopus.com/inward/record.url?scp=85030326103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030326103&partnerID=8YFLogxK

U2 - 10.1109/ICMA.2017.8016050

DO - 10.1109/ICMA.2017.8016050

M3 - Conference contribution

AN - SCOPUS:85030326103

SP - 1567

EP - 1572

BT - 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -