Loading...
Please wait, while we are loading the content...
Similar Documents
Context-sensitive reward shaping for sparse interaction multi-agent systems
| Content Provider | Scilit |
|---|---|
| Author | de Hauwere, Yann-Michaël Devlin, Sam Kudenko, Daniel Nowé, Ann |
| Copyright Year | 2016 |
| Description | Potential-based reward shaping is a commonly used approach in reinforcement learning to direct exploration based on prior knowledge. Both in single and multi-agent settings this technique speeds up learning without losing any theoretical convergence guarantees. However, if speed ups through reward shaping are to be achieved in multi-agent environments, a different shaping signal should be used for each context in which agents have a different subgoal or when agents are involved in a different interaction situation.This paper describes the use of context-aware potential functions in a multi-agent system in which the interactions between agents are sparse. This means that, unknown to the agentsa priori, the interactions between the agents only occur sporadically in certain regions of the state space. During these interactions, agents need to coordinate in order to reach the global optimal solution.We demonstrate how different reward shaping functions can be used on top of Future Coordinating Q-learning (FCQ-learning); an algorithm capable of automatically detecting when agents should take each other into consideration. Using FCQ-learning, coordination problems can even be anticipated before the actual problems occur, allowing the problems to be solved timely. We evaluate our approach on a range of gridworld problems, as well as a simulation of air traffic control. |
| Related Links | https://www.cambridge.org/core/services/aop-cambridge-core/content/view/CE0E9F37EC005125F293220DCF76A2B7/S0269888915000193a.pdf/div-class-title-context-sensitive-reward-shaping-for-sparse-interaction-multi-agent-systems-div.pdf |
| Ending Page | 76 |
| Page Count | 18 |
| Starting Page | 59 |
| ISSN | 02698889 |
| e-ISSN | 14698005 |
| DOI | 10.1017/s0269888915000193 |
| Journal | The Knowledge Engineering Review |
| Issue Number | 1 |
| Volume Number | 31 |
| Language | English |
| Publisher | Cambridge University Press (CUP) |
| Publisher Date | 2016-01-01 |
| Access Restriction | Open |
| Subject Keyword | The Knowledge Engineering Review Reward Shaping Multi Agent |
| Content Type | Text |
| Resource Type | Article |
| Subject | Artificial Intelligence Software |
