Semantically Congruent Bimodal Presentation with Divided-Modality Attention Accelerates Unisensory Working Memory Retrieval

Hongtao Yu, Aijun Wang, Qingqing Li, Yulong Liu, Jiajia Yang, Satoshi Takahashi, Yoshimichi Ejima, Ming Zhang, Jinglong Wu

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Although previous studies have shown that semantic multisensory integration can be differentially modulated by attention focus, it remains unclear whether attentionally mediated multisensory perceptual facilitation could impact further cognitive performance. Using a delayed matching-to-sample paradigm, the present study investigated the effect of semantically congruent bimodal presentation on subsequent unisensory working memory (WM) performance by manipulating attention focus. The results showed that unisensory WM retrieval was faster in the semantically congruent condition than in the incongruent multisensory encoding condition. However, such a result was only found in the divided-modality attention condition. This result indicates that a robust multisensory representation was constructed during semantically congruent multisensory encoding with divided-modality attention; this representation then accelerated unisensory WM performance, especially auditory WM retrieval. Additionally, an overall faster unisensory WM retrieval was observed under the modality-specific selective attention condition compared with the divided-modality condition, indicating that the division of attention to address two modalities demanded more central executive resources to encode and integrate crossmodal information and to maintain a constructed multisensory representation, leaving few resources for WM retrieval. Additionally, the present finding may support the amodal view that WM has an amodal central storage component that is used to maintain modal-based attention-optimized multisensory representations.

Original languageEnglish
Pages (from-to)917-932
Number of pages16
JournalPerception
Volume50
Issue number11
DOIs
Publication statusPublished - Nov 2021

Keywords

  • audiovisual integration
  • divided-modality attention
  • modality-specific selective attention
  • semantic congruency
  • working memory

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Ophthalmology
  • Sensory Systems
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Semantically Congruent Bimodal Presentation with Divided-Modality Attention Accelerates Unisensory Working Memory Retrieval'. Together they form a unique fingerprint.

Cite this