Episodic memory multimodal learning for robot sensorimotor map building and navigation

Wei Hong Chin, Yuichiro Toda, Naoyuki Kubota, Chu Kiong Loo, Manjeevan Seera

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


In this paper, an unsupervised learning model of episodic memory is proposed. The proposed model, Enhanced Episodic Memory Adaptive Resonance Theory (EEM-ART), categorizes and encodes experiences of a robot to the environment and generates a cognitive map. EEM-ART consists of multi-layer ART networks to extract novel events and encode spatio-temporal connection as episodes by incrementally generating cognitive neurons. The model connects episodes to construct a sensorimotor map for the robot to continuously perform path planning and goal navigation. Experimental results for a mobile robot indicate that EEM-ART can process multiple sensory sources for learning events and encoding episodes simultaneously. The model overcomes perceptual aliasing and robot localization by recalling the encoded episodes with a new anticipation function and generates sensorimotor map to connect episodes together to execute tasks continuously with little to no human intervention.

Original languageEnglish
JournalIEEE Transactions on Cognitive and Developmental Systems
Publication statusAccepted/In press - Jan 1 2018
Externally publishedYes


  • Adaptive Resonance Theory
  • Episodic Memory
  • Navigation
  • Neurons
  • Path planning
  • Robot Navigation.
  • Robot sensing systems
  • Subspace constraints
  • Task analysis

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Episodic memory multimodal learning for robot sensorimotor map building and navigation'. Together they form a unique fingerprint.

Cite this