Extended QDSEGA for controlling real robots acquisition of locomotion patterns for snake-like robot

Kazuyuki Ito, Tetsushi Kamegawa, Fumitoshi Matsuno

Research output: Contribution to journalConference article

12 Citations (Scopus)

Abstract

Reinforcement learning is very effective for robot learning. Because it does not need prior knowledge and has higher capability of reactive and adaptive behaviors. In our previous works, we proposed new reinforce learning algorithm: "Q-learning with Dynamic Structuring of Exploration Space Based on Genetic Algorithm (QDSEGA)". It is designed for complicated systems with large action-state space like a robot with many redundant degrees of freedom. However the application of QDSEGA is restricted to static systems. A snake-like robot has many redundant degrees of freedom and the dynamics of the system are very important to complete the locomotion task. So application of usual reinforcement learning is very difficult. In this paper, we extend layered structure of QDSEGA so that it becomes possible to apply it to real robots that have complexities and dynamics. We apply it to acquisition of locomotion pattern of the snake-like robot and demonstrate the effectiveness and the validity of QDSEGA with the extended layered structure by simulation and experiment.

Original languageEnglish
Pages (from-to)791-796
Number of pages6
JournalProceedings - IEEE International Conference on Robotics and Automation
Volume1
Publication statusPublished - Dec 9 2003
Externally publishedYes
Event2003 IEEE International Conference on Robotics and Automation - Taipei, Taiwan, Province of China
Duration: Sep 14 2003Sep 19 2003

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Extended QDSEGA for controlling real robots acquisition of locomotion patterns for snake-like robot'. Together they form a unique fingerprint.

  • Cite this