Different effects of auditory detection and discretion by visual spatial information

Jingjing Yang, Xiujun Li, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The integration of spatially consistent audiovisual stimuli have been focused by many studies. In previous studies both visual and auditory stimuli were attended. The effects of unnoticed visual pictures on auditory information processing were not well understood. Here, this experiment studied the effect of visual spatial information on auditory detection and discretion in a auditory attention task. Two speakers were used to present the auditory stimuli. The speakers were placed on both sides of the screen. The visual stimuli were presented on the left, right locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. This study provided evidence that auditory detection and discretion can be affected by the visual stimuli present from left or right even if visual stimuli were not attended. Furthermore, detection and discretion tasks had different effects. In the detection task, all visual stimuli contribute to auditory discovery, and only spatial consistent visual stimuli facilitate judgment in the discretion task. Visual stimuli that were not attended affect auditory information processing, which is associated with experimental tasks.

Original languageEnglish
Title of host publicationProceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-5
Number of pages5
Volume2018-January
ISBN (Electronic)9781538619377
DOIs
Publication statusPublished - Feb 22 2018
Event10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017 - Shanghai, China
Duration: Oct 14 2017Oct 16 2017

Other

Other10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017
CountryChina
CityShanghai
Period10/14/1710/16/17

Fingerprint

Automatic Data Processing
Experiments

Keywords

  • Audiovisual interaction
  • detection
  • discretion
  • spatial information

ASJC Scopus subject areas

  • Health Informatics
  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Biomedical Engineering

Cite this

Yang, J., Li, X., & Wu, J. (2018). Different effects of auditory detection and discretion by visual spatial information. In Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017 (Vol. 2018-January, pp. 1-5). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CISP-BMEI.2017.8302283

Different effects of auditory detection and discretion by visual spatial information. / Yang, Jingjing; Li, Xiujun; Wu, Jinglong.

Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-5.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, J, Li, X & Wu, J 2018, Different effects of auditory detection and discretion by visual spatial information. in Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017. vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1-5, 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017, Shanghai, China, 10/14/17. https://doi.org/10.1109/CISP-BMEI.2017.8302283
Yang J, Li X, Wu J. Different effects of auditory detection and discretion by visual spatial information. In Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017. Vol. 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-5 https://doi.org/10.1109/CISP-BMEI.2017.8302283
Yang, Jingjing ; Li, Xiujun ; Wu, Jinglong. / Different effects of auditory detection and discretion by visual spatial information. Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1-5
@inproceedings{afb3231fcce44e02859f285a6cd9ca9a,
title = "Different effects of auditory detection and discretion by visual spatial information",
abstract = "The integration of spatially consistent audiovisual stimuli have been focused by many studies. In previous studies both visual and auditory stimuli were attended. The effects of unnoticed visual pictures on auditory information processing were not well understood. Here, this experiment studied the effect of visual spatial information on auditory detection and discretion in a auditory attention task. Two speakers were used to present the auditory stimuli. The speakers were placed on both sides of the screen. The visual stimuli were presented on the left, right locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. This study provided evidence that auditory detection and discretion can be affected by the visual stimuli present from left or right even if visual stimuli were not attended. Furthermore, detection and discretion tasks had different effects. In the detection task, all visual stimuli contribute to auditory discovery, and only spatial consistent visual stimuli facilitate judgment in the discretion task. Visual stimuli that were not attended affect auditory information processing, which is associated with experimental tasks.",
keywords = "Audiovisual interaction, detection, discretion, spatial information",
author = "Jingjing Yang and Xiujun Li and Jinglong Wu",
year = "2018",
month = "2",
day = "22",
doi = "10.1109/CISP-BMEI.2017.8302283",
language = "English",
volume = "2018-January",
pages = "1--5",
booktitle = "Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Different effects of auditory detection and discretion by visual spatial information

AU - Yang, Jingjing

AU - Li, Xiujun

AU - Wu, Jinglong

PY - 2018/2/22

Y1 - 2018/2/22

N2 - The integration of spatially consistent audiovisual stimuli have been focused by many studies. In previous studies both visual and auditory stimuli were attended. The effects of unnoticed visual pictures on auditory information processing were not well understood. Here, this experiment studied the effect of visual spatial information on auditory detection and discretion in a auditory attention task. Two speakers were used to present the auditory stimuli. The speakers were placed on both sides of the screen. The visual stimuli were presented on the left, right locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. This study provided evidence that auditory detection and discretion can be affected by the visual stimuli present from left or right even if visual stimuli were not attended. Furthermore, detection and discretion tasks had different effects. In the detection task, all visual stimuli contribute to auditory discovery, and only spatial consistent visual stimuli facilitate judgment in the discretion task. Visual stimuli that were not attended affect auditory information processing, which is associated with experimental tasks.

AB - The integration of spatially consistent audiovisual stimuli have been focused by many studies. In previous studies both visual and auditory stimuli were attended. The effects of unnoticed visual pictures on auditory information processing were not well understood. Here, this experiment studied the effect of visual spatial information on auditory detection and discretion in a auditory attention task. Two speakers were used to present the auditory stimuli. The speakers were placed on both sides of the screen. The visual stimuli were presented on the left, right locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. This study provided evidence that auditory detection and discretion can be affected by the visual stimuli present from left or right even if visual stimuli were not attended. Furthermore, detection and discretion tasks had different effects. In the detection task, all visual stimuli contribute to auditory discovery, and only spatial consistent visual stimuli facilitate judgment in the discretion task. Visual stimuli that were not attended affect auditory information processing, which is associated with experimental tasks.

KW - Audiovisual interaction

KW - detection

KW - discretion

KW - spatial information

UR - http://www.scopus.com/inward/record.url?scp=85047475856&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047475856&partnerID=8YFLogxK

U2 - 10.1109/CISP-BMEI.2017.8302283

DO - 10.1109/CISP-BMEI.2017.8302283

M3 - Conference contribution

AN - SCOPUS:85047475856

VL - 2018-January

SP - 1

EP - 5

BT - Proceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -