TY - GEN
T1 - A Basic Psychophysics Study of Sound Reliability Effects on Audiovisual Integration for Developing New Virtual Reality Device
AU - Yu, Hongtao
AU - Wu, Qiong
AU - Zhou, Mengni
AU - Li, Qi
AU - Yang, Jiajia
AU - Takahashi, Satoshi
AU - Ejima, Yoshimichi
AU - Wu, Jinglong
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/8/8
Y1 - 2021/8/8
N2 - Although visual virtual reality performance was widely investigated by researchers, it remains unclear that whether semantic reliability of sound can also facilitate the visual virtual reality performance. We investigated the behavioral category performance of living and non-living outlined drawings accompany with a semantic reliable or unreliable sound. We evaluate the living and non-living picture category performance under three multisensory semantic conditions: semantic reliable, semantic unreliable and semantic control (mix with semantic reliable and semantic unreliable stimuli). The reaction time results showed that faster category speed for semantic reliable multisensory presentation condition compared with semantic unreliable multisensory presentation condition whatever the outlined drawing was living or non-living. Such result indicated the multisensory integration facilitate the visual category performance. Additionally, non-living category has a significant advantage than living picture category under semantic unreliable multisensory condition, indicated nonliving objects had robust multisensory representation compared with living objects. This study provided potential theory support for developing new audiovisual virtual reality device or application.
AB - Although visual virtual reality performance was widely investigated by researchers, it remains unclear that whether semantic reliability of sound can also facilitate the visual virtual reality performance. We investigated the behavioral category performance of living and non-living outlined drawings accompany with a semantic reliable or unreliable sound. We evaluate the living and non-living picture category performance under three multisensory semantic conditions: semantic reliable, semantic unreliable and semantic control (mix with semantic reliable and semantic unreliable stimuli). The reaction time results showed that faster category speed for semantic reliable multisensory presentation condition compared with semantic unreliable multisensory presentation condition whatever the outlined drawing was living or non-living. Such result indicated the multisensory integration facilitate the visual category performance. Additionally, non-living category has a significant advantage than living picture category under semantic unreliable multisensory condition, indicated nonliving objects had robust multisensory representation compared with living objects. This study provided potential theory support for developing new audiovisual virtual reality device or application.
KW - multisensory integration
KW - selective attention
KW - semantic category
KW - semantic reliability
UR - http://www.scopus.com/inward/record.url?scp=85115185760&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85115185760&partnerID=8YFLogxK
U2 - 10.1109/ICMA52036.2021.9512687
DO - 10.1109/ICMA52036.2021.9512687
M3 - Conference contribution
AN - SCOPUS:85115185760
T3 - 2021 IEEE International Conference on Mechatronics and Automation, ICMA 2021
SP - 1298
EP - 1303
BT - 2021 IEEE International Conference on Mechatronics and Automation, ICMA 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 18th IEEE International Conference on Mechatronics and Automation, ICMA 2021
Y2 - 8 August 2021 through 11 August 2021
ER -