NDLI: Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment

Content Provider	IEEE Xplore Digital Library
Author	Dahlem, Dominik Harrison, William
Copyright Year	2009
Abstract	Large-scale simulation studies are necessary to study the learning behaviour of individual agents and the overall system dynamics. One reason is that planning algorithms to find optimal solutions to fully observable general decentralised Markov decision problems do not admit to polynomial-time worst-case complexity bounds. Additionally, agent interaction often implies a non-stationary environment which does not lend itself to asymptotically greedy policies. Therefore, policies with a constant level of exploration are required to be able to adapt continuously. This paper casts the application domain of distributed task assignment into the formalisms of queueing theory, complex networks and decentralised Markov decision problems to analyse the impact of the momentum of a standard back-propagation neural network function approximator and the discount factor of $SARSA(0)$ reinforcement learning and the $\epsilon$ parameter of the $\epsilon$-greedy policy. For this purpose large queueing networks of one thousand interacting agents are evolved. A Kriging metamodel is fitted and in combination with simulated annealing optimal operating conditions with respect to the total average response time are found. The insights gained from this study are significant in that they provide guidance in deploying large-scale distributed task assignment systems modelled as multi-agent queueing networks.
Starting Page	28
Ending Page	35
File Size	362970
Page Count	8
File Format	PDF
ISBN	9780769538013
DOI	10.1109/WI-IAT.2009.122
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-09-15
Publisher Place	Italy
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Conferences Computational modeling Computer simulation Educational institutions Multi-agent Reinforcement Learning Markov Decision Problem Intelligent agent Delay Kriging Learning Computer science Network servers Statistical distributions Queueing Networks
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment

Collaborative Function Approximation in Social Multiagent Systems

Collaborative Function Approximation in Social Multiagent Systems

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

An Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems (2000)

Agent Based Arabic Language Understanding

Agent Based Arabic Language Understanding

A multi-agent cooperative reinforcement learning model using a hierarchy of consultants, tutors and workers

Distributed Reinforcement Learning in Multi Agent Decision Systems (1998)

Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment

Similar Documents

Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment

Collaborative Function Approximation in Social Multiagent Systems

Collaborative Function Approximation in Social Multiagent Systems

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

An Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems (2000)

Agent Based Arabic Language Understanding

Agent Based Arabic Language Understanding

A multi-agent cooperative reinforcement learning model using a hierarchy of consultants, tutors and workers

Distributed Reinforcement Learning in Multi Agent Decision Systems (1998)

Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment