The effect of spatial consistence on visual detection and discretion

Jingjing Yang, Jinlong Chu, Xiujun Li, Qi Li, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

Original languageEnglish
Title of host publicationProceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2388-2393
Number of pages6
ISBN (Electronic)9781538660720
DOIs
Publication statusPublished - Oct 5 2018
Event15th IEEE International Conference on Mechatronics and Automation, ICMA 2018 - Changchun, China
Duration: Aug 5 2018Aug 8 2018

Other

Other15th IEEE International Conference on Mechatronics and Automation, ICMA 2018
CountryChina
CityChangchun
Period8/5/188/8/18

Fingerprint

Brain
Information Processing
Selective Attention
Artificial intelligence
Reaction Time
Vision
Artificial Intelligence
Experiments
Experimental Results
Interaction
Experiment
Human
Influence

Keywords

  • Audiovisual interaction
  • Event-related potential
  • Spatial information

ASJC Scopus subject areas

  • Biomedical Engineering
  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Mechanical Engineering
  • Control and Optimization

Cite this

Yang, J., Chu, J., Li, X., Li, Q., & Wu, J. (2018). The effect of spatial consistence on visual detection and discretion. In Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018 (pp. 2388-2393). [8484523] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2018.8484523

The effect of spatial consistence on visual detection and discretion. / Yang, Jingjing; Chu, Jinlong; Li, Xiujun; Li, Qi; Wu, Jinglong.

Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 2388-2393 8484523.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, J, Chu, J, Li, X, Li, Q & Wu, J 2018, The effect of spatial consistence on visual detection and discretion. in Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018., 8484523, Institute of Electrical and Electronics Engineers Inc., pp. 2388-2393, 15th IEEE International Conference on Mechatronics and Automation, ICMA 2018, Changchun, China, 8/5/18. https://doi.org/10.1109/ICMA.2018.8484523
Yang J, Chu J, Li X, Li Q, Wu J. The effect of spatial consistence on visual detection and discretion. In Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 2388-2393. 8484523 https://doi.org/10.1109/ICMA.2018.8484523
Yang, Jingjing ; Chu, Jinlong ; Li, Xiujun ; Li, Qi ; Wu, Jinglong. / The effect of spatial consistence on visual detection and discretion. Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 2388-2393
@inproceedings{5ea7b24483e24a69ab3d5eb227d7a8a7,
title = "The effect of spatial consistence on visual detection and discretion",
abstract = "The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.",
keywords = "Audiovisual interaction, Event-related potential, Spatial information",
author = "Jingjing Yang and Jinlong Chu and Xiujun Li and Qi Li and Jinglong Wu",
year = "2018",
month = "10",
day = "5",
doi = "10.1109/ICMA.2018.8484523",
language = "English",
pages = "2388--2393",
booktitle = "Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - The effect of spatial consistence on visual detection and discretion

AU - Yang, Jingjing

AU - Chu, Jinlong

AU - Li, Xiujun

AU - Li, Qi

AU - Wu, Jinglong

PY - 2018/10/5

Y1 - 2018/10/5

N2 - The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

AB - The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

KW - Audiovisual interaction

KW - Event-related potential

KW - Spatial information

UR - http://www.scopus.com/inward/record.url?scp=85056299689&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056299689&partnerID=8YFLogxK

U2 - 10.1109/ICMA.2018.8484523

DO - 10.1109/ICMA.2018.8484523

M3 - Conference contribution

SP - 2388

EP - 2393

BT - Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -