Effects of spatial frequency on audiovisual integration for communication between human and robot

Fengxia Wu, Xiaoyu Tang, Weiping Yang, Ejima Yoshimichi, Qiong Wu, Yanna Ren, Takanori Ohara, Satoshi Takahashi, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1995-2000
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - Sep 1 2016
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: Aug 7 2016Aug 10 2016

Other

Other13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
CountryChina
CityHarbin, Heilongjiang
Period8/7/168/10/16

Fingerprint

Robots
Communication
Brain
Experiments

Keywords

  • audiovisual integration
  • low intensity visual
  • robot communication system
  • spatial frequency

ASJC Scopus subject areas

  • Mechanical Engineering
  • Artificial Intelligence
  • Computer Science Applications
  • Software

Cite this

Wu, F., Tang, X., Yang, W., Yoshimichi, E., Wu, Q., Ren, Y., ... Wu, J. (2016). Effects of spatial frequency on audiovisual integration for communication between human and robot. In 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 (pp. 1995-2000). [7558872] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMA.2016.7558872

Effects of spatial frequency on audiovisual integration for communication between human and robot. / Wu, Fengxia; Tang, Xiaoyu; Yang, Weiping; Yoshimichi, Ejima; Wu, Qiong; Ren, Yanna; Ohara, Takanori; Takahashi, Satoshi; Wu, Jinglong.

2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 1995-2000 7558872.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wu, F, Tang, X, Yang, W, Yoshimichi, E, Wu, Q, Ren, Y, Ohara, T, Takahashi, S & Wu, J 2016, Effects of spatial frequency on audiovisual integration for communication between human and robot. in 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016., 7558872, Institute of Electrical and Electronics Engineers Inc., pp. 1995-2000, 13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016, Harbin, Heilongjiang, China, 8/7/16. https://doi.org/10.1109/ICMA.2016.7558872
Wu F, Tang X, Yang W, Yoshimichi E, Wu Q, Ren Y et al. Effects of spatial frequency on audiovisual integration for communication between human and robot. In 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 1995-2000. 7558872 https://doi.org/10.1109/ICMA.2016.7558872
Wu, Fengxia ; Tang, Xiaoyu ; Yang, Weiping ; Yoshimichi, Ejima ; Wu, Qiong ; Ren, Yanna ; Ohara, Takanori ; Takahashi, Satoshi ; Wu, Jinglong. / Effects of spatial frequency on audiovisual integration for communication between human and robot. 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 1995-2000
@inproceedings{6e55ce1a8e38413596783933d0f8675c,
title = "Effects of spatial frequency on audiovisual integration for communication between human and robot",
abstract = "Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.",
keywords = "audiovisual integration, low intensity visual, robot communication system, spatial frequency",
author = "Fengxia Wu and Xiaoyu Tang and Weiping Yang and Ejima Yoshimichi and Qiong Wu and Yanna Ren and Takanori Ohara and Satoshi Takahashi and Jinglong Wu",
year = "2016",
month = "9",
day = "1",
doi = "10.1109/ICMA.2016.7558872",
language = "English",
pages = "1995--2000",
booktitle = "2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Effects of spatial frequency on audiovisual integration for communication between human and robot

AU - Wu, Fengxia

AU - Tang, Xiaoyu

AU - Yang, Weiping

AU - Yoshimichi, Ejima

AU - Wu, Qiong

AU - Ren, Yanna

AU - Ohara, Takanori

AU - Takahashi, Satoshi

AU - Wu, Jinglong

PY - 2016/9/1

Y1 - 2016/9/1

N2 - Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.

AB - Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.

KW - audiovisual integration

KW - low intensity visual

KW - robot communication system

KW - spatial frequency

UR - http://www.scopus.com/inward/record.url?scp=84991206253&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84991206253&partnerID=8YFLogxK

U2 - 10.1109/ICMA.2016.7558872

DO - 10.1109/ICMA.2016.7558872

M3 - Conference contribution

SP - 1995

EP - 2000

BT - 2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -