Effects of modality-specific attention on audiovisual early integration

Li Qi, Kochiyama Takanori, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Audiovisual early integration was investigated in humans using behavioral and electrophysiological measures in the attending one-modality (visual/auditory) condition to determine whether audiovisual early integration occurs when one modality is attended. Visual, auditory, and audiovisual stimuli were presented randomly with equal probability. The subjects were instructed to press a button in response to an infrequent target stimulus (20%) in the attend-designated modality. Reaction times (RTs) and accuracy were recorded and were compared using paired t-tests. The event-related potentials (ERPs) to bimodal stimuli (AV) were compared with the sum of the ERPs to unimodal auditory (A) and visual (V) stimuli. The early integration process was expressed as the difference waveform between AV and (A+V). Audiovisual early integration (P100) of the bimodal audiovisual stimuli was found in the scalp topographies in the attending auditory condition; moreover, the RTs to the bimodal audiovisual target stimuli were faster than the RTs to the unimodal auditory target stimuli. By contrast, in the attending visual condition, audiovisual early integration (P100) of the bimodal audiovisual stimuli was not found in the scalp topographies, and no significant RT difference was observed between the unimodal visual and bimodal audiovisual target stimuli.

Original languageEnglish
Title of host publication2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007
Pages1467-1470
Number of pages4
DOIs
Publication statusPublished - 2007
Externally publishedYes
Event2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007 - Beijing, China
Duration: May 23 2007May 27 2007

Other

Other2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007
CountryChina
CityBeijing
Period5/23/075/27/07

Fingerprint

Reaction Time
Scalp
Evoked Potentials
Topography

ASJC Scopus subject areas

  • Biomedical Engineering
  • Medicine(all)

Cite this

Qi, L., Takanori, K., & Wu, J. (2007). Effects of modality-specific attention on audiovisual early integration. In 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007 (pp. 1467-1470). [4381989] https://doi.org/10.1109/ICCME.2007.4381989

Effects of modality-specific attention on audiovisual early integration. / Qi, Li; Takanori, Kochiyama; Wu, Jinglong.

2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007. 2007. p. 1467-1470 4381989.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Qi, L, Takanori, K & Wu, J 2007, Effects of modality-specific attention on audiovisual early integration. in 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007., 4381989, pp. 1467-1470, 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007, Beijing, China, 5/23/07. https://doi.org/10.1109/ICCME.2007.4381989
Qi L, Takanori K, Wu J. Effects of modality-specific attention on audiovisual early integration. In 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007. 2007. p. 1467-1470. 4381989 https://doi.org/10.1109/ICCME.2007.4381989
Qi, Li ; Takanori, Kochiyama ; Wu, Jinglong. / Effects of modality-specific attention on audiovisual early integration. 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007. 2007. pp. 1467-1470
@inproceedings{e7d271050f9442af8b927bc5f5c3ff33,
title = "Effects of modality-specific attention on audiovisual early integration",
abstract = "Audiovisual early integration was investigated in humans using behavioral and electrophysiological measures in the attending one-modality (visual/auditory) condition to determine whether audiovisual early integration occurs when one modality is attended. Visual, auditory, and audiovisual stimuli were presented randomly with equal probability. The subjects were instructed to press a button in response to an infrequent target stimulus (20{\%}) in the attend-designated modality. Reaction times (RTs) and accuracy were recorded and were compared using paired t-tests. The event-related potentials (ERPs) to bimodal stimuli (AV) were compared with the sum of the ERPs to unimodal auditory (A) and visual (V) stimuli. The early integration process was expressed as the difference waveform between AV and (A+V). Audiovisual early integration (P100) of the bimodal audiovisual stimuli was found in the scalp topographies in the attending auditory condition; moreover, the RTs to the bimodal audiovisual target stimuli were faster than the RTs to the unimodal auditory target stimuli. By contrast, in the attending visual condition, audiovisual early integration (P100) of the bimodal audiovisual stimuli was not found in the scalp topographies, and no significant RT difference was observed between the unimodal visual and bimodal audiovisual target stimuli.",
author = "Li Qi and Kochiyama Takanori and Jinglong Wu",
year = "2007",
doi = "10.1109/ICCME.2007.4381989",
language = "English",
isbn = "1424410789",
pages = "1467--1470",
booktitle = "2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007",

}

TY - GEN

T1 - Effects of modality-specific attention on audiovisual early integration

AU - Qi, Li

AU - Takanori, Kochiyama

AU - Wu, Jinglong

PY - 2007

Y1 - 2007

N2 - Audiovisual early integration was investigated in humans using behavioral and electrophysiological measures in the attending one-modality (visual/auditory) condition to determine whether audiovisual early integration occurs when one modality is attended. Visual, auditory, and audiovisual stimuli were presented randomly with equal probability. The subjects were instructed to press a button in response to an infrequent target stimulus (20%) in the attend-designated modality. Reaction times (RTs) and accuracy were recorded and were compared using paired t-tests. The event-related potentials (ERPs) to bimodal stimuli (AV) were compared with the sum of the ERPs to unimodal auditory (A) and visual (V) stimuli. The early integration process was expressed as the difference waveform between AV and (A+V). Audiovisual early integration (P100) of the bimodal audiovisual stimuli was found in the scalp topographies in the attending auditory condition; moreover, the RTs to the bimodal audiovisual target stimuli were faster than the RTs to the unimodal auditory target stimuli. By contrast, in the attending visual condition, audiovisual early integration (P100) of the bimodal audiovisual stimuli was not found in the scalp topographies, and no significant RT difference was observed between the unimodal visual and bimodal audiovisual target stimuli.

AB - Audiovisual early integration was investigated in humans using behavioral and electrophysiological measures in the attending one-modality (visual/auditory) condition to determine whether audiovisual early integration occurs when one modality is attended. Visual, auditory, and audiovisual stimuli were presented randomly with equal probability. The subjects were instructed to press a button in response to an infrequent target stimulus (20%) in the attend-designated modality. Reaction times (RTs) and accuracy were recorded and were compared using paired t-tests. The event-related potentials (ERPs) to bimodal stimuli (AV) were compared with the sum of the ERPs to unimodal auditory (A) and visual (V) stimuli. The early integration process was expressed as the difference waveform between AV and (A+V). Audiovisual early integration (P100) of the bimodal audiovisual stimuli was found in the scalp topographies in the attending auditory condition; moreover, the RTs to the bimodal audiovisual target stimuli were faster than the RTs to the unimodal auditory target stimuli. By contrast, in the attending visual condition, audiovisual early integration (P100) of the bimodal audiovisual stimuli was not found in the scalp topographies, and no significant RT difference was observed between the unimodal visual and bimodal audiovisual target stimuli.

UR - http://www.scopus.com/inward/record.url?scp=48149099375&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=48149099375&partnerID=8YFLogxK

U2 - 10.1109/ICCME.2007.4381989

DO - 10.1109/ICCME.2007.4381989

M3 - Conference contribution

AN - SCOPUS:48149099375

SN - 1424410789

SN - 9781424410781

SP - 1467

EP - 1470

BT - 2007 IEEE/ICME International Conference on Complex Medical Engineering, CME 2007

ER -