Comparison between reinforcement learning methods with different goal selections in multi-agent cooperation

Fumito Uwano, Keiki Takadama

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

This study discusses important factors for zero communication, multi-agent cooperation by comparing different modified reinforcement learning methods. The two learning methods used for comparison were assigned different goal selections for multi-agent cooperation tasks. The first method is called Profit Minimizing Reinforcement Learning (PMRL); it forces agents to learn how to reach the farthest goal, and then the agent closest to the goal is directed to the goal. The second method is called Yielding Action Reinforcement Learning (YARL); it forces agents to learn through a Q-learning process, and if the agents have a conflict, the agent that is closest to the goal learns to reach the next closest goal. To compare the two methods, we designed experiments by adjusting the following maze factors: (1) the location of the start point and goal; (2) the number of agents; and (3) the size of maze. The intensive simulations performed on the maze problem for the agent cooperation task revealed that the two methods successfully enabled the agents to exhibit cooperative behavior, even if the size of the maze and the number of agents change. The PMRL mechanism always enables the agents to learn cooperative behavior, whereas the YARL mechanism makes the agents learn cooperative behavior over a small number of learning iterations. In zero communication, multi-agent cooperation, it is important that only agents that have a conflict cooperate with each other.

Original languageEnglish
Pages (from-to)917-929
Number of pages13
JournalJournal of Advanced Computational Intelligence and Intelligent Informatics
Volume21
Issue number5
DOIs
Publication statusPublished - Sep 2017
Externally publishedYes

Keywords

  • Coooperation
  • Internal reward
  • Multi-agent system
  • Reinforcement learning

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Comparison between reinforcement learning methods with different goal selections in multi-agent cooperation'. Together they form a unique fingerprint.

Cite this