NDLI: Multi-robot Cooperation Based on Continuous Reinforcement Learning with Two State Space Representations

Content Provider	IEEE Xplore Digital Library
Author	Yasuda, T. Ohkura, K. Yamada, K.
Copyright Year	2013
Description	Author affiliation: Inst. of Eng., Hiroshima Univ., Higashi-Hiroshima, Japan (Yasuda, T.; Ohkura, K.) \|\| Dept. of Mech. Eng., Toyo Univ., Kawagoe, Japan (Yamada, K.)
Abstract	The field of multi-robot systems (MRS) deals with groups of autonomous robots and is attracting much research interest from robotics researchers. MRSs are expected to achieve tasks that are difficult to perform by an individual robot. In MRS, reinforcement learning (RL) is a promising approach for the distributed control of each robot. RL allows robots to learn mappings from their states to their actions through rewards or payoffs obtained through interactions with their environment. Theoretically, the environment of an MRS is nonstationary, and therefore rewards or payoffs received by learning robots depend not only on their own actions but also on the actions of other robots. From this perspective, our research group has been developing a technique that segments state and action spaces simultaneously and autonomously to extend the adaptability of an MRS to dynamic environments. To improve learning performance, we introduce a mechanism of selecting either of the two state spaces: one is represented by a parametric model for exploration, while the other is represented by a nonparametric model for exploitation. The proposed technique is expected to show better learning performance and robustness against an unpredicted environmental change. We investigate our proposed technique by conducting computer simulations of a cooperative box-pushing task with six autonomous mobile robots.
Sponsorship	IEEE Syst., Man, Cybern. Soc.
Starting Page	4470
Ending Page	4475
File Size	704062
Page Count	6
File Format	PDF
ISBN	9781479906529
DOI	10.1109/SMC.2013.760
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-10-13
Publisher Place	UK
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Support vector machines Robot sensing systems Mobile robots Standards Robustness Production robustness Multi-robot systems reinforcement learning continuous space parametric model nonparametric model
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Robust reinforcement learning technique with bigeminal representation of continuous state space for multi-robot systems

Reinforcement learning method based on semi-parametric regression model

An analysis of feature-based and state-based representations for module-based learning in mobile robots

Vision-based self-localization in non-stationary environments by using support vector machines

Model-Free reinforcement learning with continuous action in practice

Robot navigation framework based on reinforcement learning for intelligent space

Motion sequence scheme for detecting mobile robots in an office environment

Application of direct-vision-based reinforcement learning to a real mobile robot

Two-Stage Reinforcement Learning based on Genetic Network Programming for mobile robot

Multi-robot Cooperation Based on Continuous Reinforcement Learning with Two State Space Representations

Similar Documents

Robust reinforcement learning technique with bigeminal representation of continuous state space for multi-robot systems

Reinforcement learning method based on semi-parametric regression model

An analysis of feature-based and state-based representations for module-based learning in mobile robots

Vision-based self-localization in non-stationary environments by using support vector machines

Model-Free reinforcement learning with continuous action in practice

Robot navigation framework based on reinforcement learning for intelligent space

Motion sequence scheme for detecting mobile robots in an office environment

Application of direct-vision-based reinforcement learning to a real mobile robot

Two-Stage Reinforcement Learning based on Genetic Network Programming for mobile robot

Multi-robot Cooperation Based on Continuous Reinforcement Learning with Two State Space Representations