Study of audiovisual asynchrony signal processing

Robot recognition system of different ages

Yanna Ren, Weiping Yang, Qiong Wu, Fengxia Wu, Satoshi Takahashi, Ejima Yoshimichi, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The current studies indicated that sound can improve the visual perception. However, whether the gain is influenced by temporal disparity between visual and auditory stimuli, and whether the gain is the same for older and younger adults remains unclear. To clarify this mechanism, ten older adults and 10 younger adults were invited to confirm and visual/auditory discrimination task. The visual target task, visual irrelevant task, auditory target task, and auditory irrelevant task randomly presented on the right or left hemi-space of the central fixation point and the subjects were instructed to respond to target stimuli rapidly and accurately. The results showed that in the younger adults, the gain was greatest in the simultaneous audiovisual condition. With the enlargement of temporal disparity between visual stimulus and auditory stimulus, the gain decreased significantly, and the alterative slope was different between auditory proceeded visual stimulus and visual proceeded auditory stimulus. In the older adults, the variation tendency was similar to younger adults, but in all conditions, the response of older adults was significantly slower than that of younger adults. Our results suggested that the visual gains were influenced by temporal disparity between auditory and visual stimuli, and further suggested that the gain mechanism between auditory proceeded visual stimuli and visual proceeded auditory stimuli was different, which indicated that the development of intelligent robot should consider the condition of the target subject to switch to the adapt procedure.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2320-2325
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - Sep 1 2016
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: Aug 7 2016Aug 10 2016

Other

Other13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
CountryChina
CityHarbin, Heilongjiang
Period8/7/168/10/16

Fingerprint

Intelligent robots
Signal processing
Switches
Acoustic waves
Robots

Keywords

  • Audiovisual Synchrony
  • Immersive Perception
  • Older Adults
  • Response Enhancement
  • Visual Perception

ASJC Scopus subject areas

  • Mechanical Engineering
  • Artificial Intelligence
  • Computer Science Applications
  • Software

Cite this

Ren, Y., Yang, W., Wu, Q., Wu, F., Takahashi, S., Yoshimichi, E., & Wu, J. (2016). Study of audiovisual asynchrony signal processing: Robot recognition system of different ages. In 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 (pp. 2320-2325). [7558927] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2016.7558927

Study of audiovisual asynchrony signal processing : Robot recognition system of different ages. / Ren, Yanna; Yang, Weiping; Wu, Qiong; Wu, Fengxia; Takahashi, Satoshi; Yoshimichi, Ejima; Wu, Jinglong.

2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 2320-2325 7558927.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ren, Y, Yang, W, Wu, Q, Wu, F, Takahashi, S, Yoshimichi, E & Wu, J 2016, Study of audiovisual asynchrony signal processing: Robot recognition system of different ages. in 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016., 7558927, Institute of Electrical and Electronics Engineers Inc., pp. 2320-2325, 13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016, Harbin, Heilongjiang, China, 8/7/16. https://doi.org/10.1109/ICMA.2016.7558927
Ren Y, Yang W, Wu Q, Wu F, Takahashi S, Yoshimichi E et al. Study of audiovisual asynchrony signal processing: Robot recognition system of different ages. In 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 2320-2325. 7558927 https://doi.org/10.1109/ICMA.2016.7558927
Ren, Yanna ; Yang, Weiping ; Wu, Qiong ; Wu, Fengxia ; Takahashi, Satoshi ; Yoshimichi, Ejima ; Wu, Jinglong. / Study of audiovisual asynchrony signal processing : Robot recognition system of different ages. 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 2320-2325
@inproceedings{b3b1415744484dc9a4c0bfccef60f413,
title = "Study of audiovisual asynchrony signal processing: Robot recognition system of different ages",
abstract = "The current studies indicated that sound can improve the visual perception. However, whether the gain is influenced by temporal disparity between visual and auditory stimuli, and whether the gain is the same for older and younger adults remains unclear. To clarify this mechanism, ten older adults and 10 younger adults were invited to confirm and visual/auditory discrimination task. The visual target task, visual irrelevant task, auditory target task, and auditory irrelevant task randomly presented on the right or left hemi-space of the central fixation point and the subjects were instructed to respond to target stimuli rapidly and accurately. The results showed that in the younger adults, the gain was greatest in the simultaneous audiovisual condition. With the enlargement of temporal disparity between visual stimulus and auditory stimulus, the gain decreased significantly, and the alterative slope was different between auditory proceeded visual stimulus and visual proceeded auditory stimulus. In the older adults, the variation tendency was similar to younger adults, but in all conditions, the response of older adults was significantly slower than that of younger adults. Our results suggested that the visual gains were influenced by temporal disparity between auditory and visual stimuli, and further suggested that the gain mechanism between auditory proceeded visual stimuli and visual proceeded auditory stimuli was different, which indicated that the development of intelligent robot should consider the condition of the target subject to switch to the adapt procedure.",
keywords = "Audiovisual Synchrony, Immersive Perception, Older Adults, Response Enhancement, Visual Perception",
author = "Yanna Ren and Weiping Yang and Qiong Wu and Fengxia Wu and Satoshi Takahashi and Ejima Yoshimichi and Jinglong Wu",
year = "2016",
month = "9",
day = "1",
doi = "10.1109/ICMA.2016.7558927",
language = "English",
pages = "2320--2325",
booktitle = "2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Study of audiovisual asynchrony signal processing

T2 - Robot recognition system of different ages

AU - Ren, Yanna

AU - Yang, Weiping

AU - Wu, Qiong

AU - Wu, Fengxia

AU - Takahashi, Satoshi

AU - Yoshimichi, Ejima

AU - Wu, Jinglong

PY - 2016/9/1

Y1 - 2016/9/1

N2 - The current studies indicated that sound can improve the visual perception. However, whether the gain is influenced by temporal disparity between visual and auditory stimuli, and whether the gain is the same for older and younger adults remains unclear. To clarify this mechanism, ten older adults and 10 younger adults were invited to confirm and visual/auditory discrimination task. The visual target task, visual irrelevant task, auditory target task, and auditory irrelevant task randomly presented on the right or left hemi-space of the central fixation point and the subjects were instructed to respond to target stimuli rapidly and accurately. The results showed that in the younger adults, the gain was greatest in the simultaneous audiovisual condition. With the enlargement of temporal disparity between visual stimulus and auditory stimulus, the gain decreased significantly, and the alterative slope was different between auditory proceeded visual stimulus and visual proceeded auditory stimulus. In the older adults, the variation tendency was similar to younger adults, but in all conditions, the response of older adults was significantly slower than that of younger adults. Our results suggested that the visual gains were influenced by temporal disparity between auditory and visual stimuli, and further suggested that the gain mechanism between auditory proceeded visual stimuli and visual proceeded auditory stimuli was different, which indicated that the development of intelligent robot should consider the condition of the target subject to switch to the adapt procedure.

AB - The current studies indicated that sound can improve the visual perception. However, whether the gain is influenced by temporal disparity between visual and auditory stimuli, and whether the gain is the same for older and younger adults remains unclear. To clarify this mechanism, ten older adults and 10 younger adults were invited to confirm and visual/auditory discrimination task. The visual target task, visual irrelevant task, auditory target task, and auditory irrelevant task randomly presented on the right or left hemi-space of the central fixation point and the subjects were instructed to respond to target stimuli rapidly and accurately. The results showed that in the younger adults, the gain was greatest in the simultaneous audiovisual condition. With the enlargement of temporal disparity between visual stimulus and auditory stimulus, the gain decreased significantly, and the alterative slope was different between auditory proceeded visual stimulus and visual proceeded auditory stimulus. In the older adults, the variation tendency was similar to younger adults, but in all conditions, the response of older adults was significantly slower than that of younger adults. Our results suggested that the visual gains were influenced by temporal disparity between auditory and visual stimuli, and further suggested that the gain mechanism between auditory proceeded visual stimuli and visual proceeded auditory stimuli was different, which indicated that the development of intelligent robot should consider the condition of the target subject to switch to the adapt procedure.

KW - Audiovisual Synchrony

KW - Immersive Perception

KW - Older Adults

KW - Response Enhancement

KW - Visual Perception

UR - http://www.scopus.com/inward/record.url?scp=84991248600&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84991248600&partnerID=8YFLogxK

U2 - 10.1109/ICMA.2016.7558927

DO - 10.1109/ICMA.2016.7558927

M3 - Conference contribution

SP - 2320

EP - 2325

BT - 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -