Spatiotemporal relationships among audiovisual stimuli modulate auditory facilitation of visual target discrimination

Qi Li, Huamin Yang, Fang Sun, Jinglong Wu

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Sensory information is multimodal; through audiovisual interaction, task-irrelevant auditory stimuli tend to speed response times and increase visual perception accuracy. However, mechanisms underlying these performance enhancements have remained unclear. We hypothesize that task-irrelevant auditory stimuli might provide reliable temporal and spatial cues for visual target discrimination and behavioral response enhancement. Using signal detection theory, the present study investigated the effects of spatiotemporal relationships on auditory facilitation of visual target discrimination. Three experiments were conducted where an auditory stimulus maintained reliable temporal and/or spatial relationships with visual target stimuli. Results showed that perception sensitivity (d′) to visual target stimuli was enhanced only when a task-irrelevant auditory stimulus maintained reliable spatiotemporal relationships with a visual target stimulus. When only reliable spatial or temporal information was contained, perception sensitivity was not enhanced. These results suggest that reliable spatiotemporal relationships between visual and auditory signals are required for audiovisual integration during a visual discrimination task, most likely due to a spread of attention. These results also indicate that auditory facilitation of visual target discrimination follows from late-stage cognitive processes rather than early stage sensory processes.

Original languageEnglish
Pages (from-to)232-242
Number of pages11
JournalPerception
Volume44
Issue number3
DOIs
Publication statusPublished - 2015

Fingerprint

Signal detection
Experiments
Visual Perception
Reaction Time
Cues
Discrimination (Psychology)

Keywords

  • Audiovisual integration
  • Signal detection theory
  • Temporal and spatial reliability
  • Visual detection

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Artificial Intelligence
  • Sensory Systems

Cite this

Spatiotemporal relationships among audiovisual stimuli modulate auditory facilitation of visual target discrimination. / Li, Qi; Yang, Huamin; Sun, Fang; Wu, Jinglong.

In: Perception, Vol. 44, No. 3, 2015, p. 232-242.

Research output: Contribution to journalArticle

@article{059249d2681b4064a08239391c639229,
title = "Spatiotemporal relationships among audiovisual stimuli modulate auditory facilitation of visual target discrimination",
abstract = "Sensory information is multimodal; through audiovisual interaction, task-irrelevant auditory stimuli tend to speed response times and increase visual perception accuracy. However, mechanisms underlying these performance enhancements have remained unclear. We hypothesize that task-irrelevant auditory stimuli might provide reliable temporal and spatial cues for visual target discrimination and behavioral response enhancement. Using signal detection theory, the present study investigated the effects of spatiotemporal relationships on auditory facilitation of visual target discrimination. Three experiments were conducted where an auditory stimulus maintained reliable temporal and/or spatial relationships with visual target stimuli. Results showed that perception sensitivity (d′) to visual target stimuli was enhanced only when a task-irrelevant auditory stimulus maintained reliable spatiotemporal relationships with a visual target stimulus. When only reliable spatial or temporal information was contained, perception sensitivity was not enhanced. These results suggest that reliable spatiotemporal relationships between visual and auditory signals are required for audiovisual integration during a visual discrimination task, most likely due to a spread of attention. These results also indicate that auditory facilitation of visual target discrimination follows from late-stage cognitive processes rather than early stage sensory processes.",
keywords = "Audiovisual integration, Signal detection theory, Temporal and spatial reliability, Visual detection",
author = "Qi Li and Huamin Yang and Fang Sun and Jinglong Wu",
year = "2015",
doi = "10.1068/p7846",
language = "English",
volume = "44",
pages = "232--242",
journal = "Perception",
issn = "0301-0066",
publisher = "Pion Ltd.",
number = "3",

}

TY - JOUR

T1 - Spatiotemporal relationships among audiovisual stimuli modulate auditory facilitation of visual target discrimination

AU - Li, Qi

AU - Yang, Huamin

AU - Sun, Fang

AU - Wu, Jinglong

PY - 2015

Y1 - 2015

N2 - Sensory information is multimodal; through audiovisual interaction, task-irrelevant auditory stimuli tend to speed response times and increase visual perception accuracy. However, mechanisms underlying these performance enhancements have remained unclear. We hypothesize that task-irrelevant auditory stimuli might provide reliable temporal and spatial cues for visual target discrimination and behavioral response enhancement. Using signal detection theory, the present study investigated the effects of spatiotemporal relationships on auditory facilitation of visual target discrimination. Three experiments were conducted where an auditory stimulus maintained reliable temporal and/or spatial relationships with visual target stimuli. Results showed that perception sensitivity (d′) to visual target stimuli was enhanced only when a task-irrelevant auditory stimulus maintained reliable spatiotemporal relationships with a visual target stimulus. When only reliable spatial or temporal information was contained, perception sensitivity was not enhanced. These results suggest that reliable spatiotemporal relationships between visual and auditory signals are required for audiovisual integration during a visual discrimination task, most likely due to a spread of attention. These results also indicate that auditory facilitation of visual target discrimination follows from late-stage cognitive processes rather than early stage sensory processes.

AB - Sensory information is multimodal; through audiovisual interaction, task-irrelevant auditory stimuli tend to speed response times and increase visual perception accuracy. However, mechanisms underlying these performance enhancements have remained unclear. We hypothesize that task-irrelevant auditory stimuli might provide reliable temporal and spatial cues for visual target discrimination and behavioral response enhancement. Using signal detection theory, the present study investigated the effects of spatiotemporal relationships on auditory facilitation of visual target discrimination. Three experiments were conducted where an auditory stimulus maintained reliable temporal and/or spatial relationships with visual target stimuli. Results showed that perception sensitivity (d′) to visual target stimuli was enhanced only when a task-irrelevant auditory stimulus maintained reliable spatiotemporal relationships with a visual target stimulus. When only reliable spatial or temporal information was contained, perception sensitivity was not enhanced. These results suggest that reliable spatiotemporal relationships between visual and auditory signals are required for audiovisual integration during a visual discrimination task, most likely due to a spread of attention. These results also indicate that auditory facilitation of visual target discrimination follows from late-stage cognitive processes rather than early stage sensory processes.

KW - Audiovisual integration

KW - Signal detection theory

KW - Temporal and spatial reliability

KW - Visual detection

UR - http://www.scopus.com/inward/record.url?scp=84926160566&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926160566&partnerID=8YFLogxK

U2 - 10.1068/p7846

DO - 10.1068/p7846

M3 - Article

C2 - 26562250

AN - SCOPUS:84926160566

VL - 44

SP - 232

EP - 242

JO - Perception

JF - Perception

SN - 0301-0066

IS - 3

ER -