Study of audiovisual asynchrony signal processing: Robot recognition system of different ages

Yanna Ren, Weiping Yang, Qiong Wu, Fengxia Wu, Satoshi Takahashi, Ejima Yoshimichi, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The current studies indicated that sound can improve the visual perception. However, whether the gain is influenced by temporal disparity between visual and auditory stimuli, and whether the gain is the same for older and younger adults remains unclear. To clarify this mechanism, ten older adults and 10 younger adults were invited to confirm and visual/auditory discrimination task. The visual target task, visual irrelevant task, auditory target task, and auditory irrelevant task randomly presented on the right or left hemi-space of the central fixation point and the subjects were instructed to respond to target stimuli rapidly and accurately. The results showed that in the younger adults, the gain was greatest in the simultaneous audiovisual condition. With the enlargement of temporal disparity between visual stimulus and auditory stimulus, the gain decreased significantly, and the alterative slope was different between auditory proceeded visual stimulus and visual proceeded auditory stimulus. In the older adults, the variation tendency was similar to younger adults, but in all conditions, the response of older adults was significantly slower than that of younger adults. Our results suggested that the visual gains were influenced by temporal disparity between auditory and visual stimuli, and further suggested that the gain mechanism between auditory proceeded visual stimuli and visual proceeded auditory stimuli was different, which indicated that the development of intelligent robot should consider the condition of the target subject to switch to the adapt procedure.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2320-2325
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - Sep 1 2016
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: Aug 7 2016Aug 10 2016

Other

Other13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
CountryChina
CityHarbin, Heilongjiang
Period8/7/168/10/16

Keywords

  • Audiovisual Synchrony
  • Immersive Perception
  • Older Adults
  • Response Enhancement
  • Visual Perception

ASJC Scopus subject areas

  • Mechanical Engineering
  • Artificial Intelligence
  • Computer Science Applications
  • Software

Fingerprint Dive into the research topics of 'Study of audiovisual asynchrony signal processing: Robot recognition system of different ages'. Together they form a unique fingerprint.

  • Cite this

    Ren, Y., Yang, W., Wu, Q., Wu, F., Takahashi, S., Yoshimichi, E., & Wu, J. (2016). Study of audiovisual asynchrony signal processing: Robot recognition system of different ages. In 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 (pp. 2320-2325). [7558927] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2016.7558927