Effects of spatial frequency on audiovisual integration for communication between human and robot

Fengxia Wu, Xiaoyu Tang, Weiping Yang, Ejima Yoshimichi, Qiong Wu, Yanna Ren, Takanori Ohara, Satoshi Takahashi, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1995-2000
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - Sep 1 2016
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: Aug 7 2016Aug 10 2016

Other

Other13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
CountryChina
CityHarbin, Heilongjiang
Period8/7/168/10/16

Keywords

  • audiovisual integration
  • low intensity visual
  • robot communication system
  • spatial frequency

ASJC Scopus subject areas

  • Mechanical Engineering
  • Artificial Intelligence
  • Computer Science Applications
  • Software

Fingerprint Dive into the research topics of 'Effects of spatial frequency on audiovisual integration for communication between human and robot'. Together they form a unique fingerprint.

Cite this