NDLI: Using plan-based reward shaping to learn strategies in StarCraft: Broodwar

Content Provider	IEEE Xplore Digital Library
Author	Efthymiadis, K. Kudenko, D.
Copyright Year	2013
Description	Author affiliation: Dept. of Comput. Sci., Univ. of York, York, UK (Efthymiadis, K.; Kudenko, D.)
Abstract	StarCraft: Broodwar (SC:BW) is a very popular commercial real strategy game (RTS) which has been extensively used in AI research. Despite being a popular test-bed reinforcement learning (RL) has not been evaluated extensively. A successful attempt was made to show the use of RL in a small-scale combat scenario involving an overpowered agent battling against multiple enemy units [1]. However, the chosen scenario was very small and not representative of the complexity of the game in its entirety. In order to build an RL agent that can manage the complexity of the full game, more efficient approaches must be used to tackle the state-space explosion. In this paper, we demonstrate how plan-based reward shaping can help an agent scale up to larger, more complex scenarios and significantly speed up the learning process as well as how high level planning can be combined with learning focusing on learning the Starcraft strategy, Battlecruiser Rush. We empirically show that the agent with plan-based reward shaping is significantly better both in terms of the learnt policy, as well as convergence speed when compared to baseline approaches which fail at reaching a good enough policy within a practical amount of time.
Starting Page	1
Ending Page	8
File Size	416079
Page Count	8
File Format	PDF
ISSN	23254289
e-ISBN	9781467353113
DOI	10.1109/CIG.2013.6633622
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-08-11
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Strips Buildings Games Learning (artificial intelligence) Minerals Complexity theory Planning
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using plan-based reward shaping to learn strategies in starcraft: broodwar.

Using plan-based reward shaping to learn strategies in starcraft (2013)

Plan-based reward shaping for reinforcement learning

Dynamic agent-based reward shaping for multi-agent systems

Imitation learning for combat system in RTS games with application to starcraft

Towards automatic StarCraft strategy generation using genetic programming

Overcoming incorrect knowledge in plan-based reward shaping

A Bayesian Model for Opening Prediction in RTS Games with Application to StarCraft

Replay-based strategy prediction and build order adaptation for StarCraft AI bots

Using plan-based reward shaping to learn strategies in StarCraft: Broodwar

Similar Documents

Using plan-based reward shaping to learn strategies in starcraft: broodwar.

Using plan-based reward shaping to learn strategies in starcraft (2013)

Plan-based reward shaping for reinforcement learning

Dynamic agent-based reward shaping for multi-agent systems

Imitation learning for combat system in RTS games with application to starcraft

Towards automatic StarCraft strategy generation using genetic programming

Overcoming incorrect knowledge in plan-based reward shaping

A Bayesian Model for Opening Prediction in RTS Games with Application to StarCraft

Replay-based strategy prediction and build order adaptation for StarCraft AI bots

Using plan-based reward shaping to learn strategies in StarCraft: Broodwar