NDLI: Enhancements for Monte-Carlo Tree Search in Ms Pac-Man

Content Provider	IEEE Xplore Digital Library
Author	Pepels, T. Winands, M.H.M.
Copyright Year	2012
Description	Author affiliation: Games and AI Group, Department of Knowledge Engineering, Faculty of Humanities (Pepels, T.) \|\| Games and AI Group, Department of Knowledge Engineering, Faculty of Humanities and Sciences, Maastricht University, Maastricht, The Netherlands (Winands, M.H.M.)
Abstract	In this paper enhancements for the Monte-Carlo Tree Search (MCTS) framework are investigated to play Ms Pac-Man. MCTS is used to find an optimal path for an agent at each turn, determining the move to make based on randomised simulations. Ms Pac-Man is a real-time arcade game, in which the protagonist has several independent goals but no conclusive terminal state. Unlike games such as Chess or Go there is no state in which the player wins the game. Furthermore, the Pac-Man agent has to compete with a range of different ghost agents, hence limited assumptions can be made about the opponent's behaviour. In order to expand the capabilities of existing MCTS agents, five enhancements are discussed: 1) a variable depth tree, 2) playout strategies for the ghost-team and Pac-Man, 3) including long-term goals in scoring, 4) endgame tactics, and 5) a Last-Good-Reply policy for memorising rewarding moves during playouts. An average performance gain of 40,962 points, compared to the average score of the top scoring Pac-Man agent during the CIG'11, is achieved by employing these methods.
Starting Page	265
Ending Page	272
File Size	335501
Page Count	8
File Format	PDF
ISBN	9781467311939
e-ISBN	9781467311946
e-ISBN	9781467311922
DOI	10.1109/CIG.2012.6374165
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-09-11
Publisher Place	Spain
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Backpropagation Monte Carlo methods Conferences Games Safety Junctions Computational intelligence
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Monte-Carlo tree search in Ms. Pac-Man

Real-Time Monte Carlo Tree Search in Ms Pac-Man

A Monte-Carlo approach for the endgame of Ms. Pac-Man

A Monte-Carlo approach for ghost avoidance in the Ms. Pac-Man game

Using genetic programming to evolve heuristics for a Monte Carlo Tree Search Ms Pac-Man agent

Fast Approximate Max-n Monte Carlo Tree Search for Ms Pac-Man

Applying Monte-Carlo Tree Search to collaboratively controlling of a Ghost Team in Ms Pac-Man

αβ-based play-outs in Monte-Carlo Tree Search

Monte Carlo Tree Search for Collaboration Control of Ghosts in Ms. Pac-Man

Enhancements for Monte-Carlo Tree Search in Ms Pac-Man

Similar Documents

Monte-Carlo tree search in Ms. Pac-Man

Real-Time Monte Carlo Tree Search in Ms Pac-Man

A Monte-Carlo approach for the endgame of Ms. Pac-Man

A Monte-Carlo approach for ghost avoidance in the Ms. Pac-Man game

Using genetic programming to evolve heuristics for a Monte Carlo Tree Search Ms Pac-Man agent

Fast Approximate Max-n Monte Carlo Tree Search for Ms Pac-Man

Applying Monte-Carlo Tree Search to collaboratively controlling of a Ghost Team in Ms Pac-Man

αβ-based play-outs in Monte-Carlo Tree Search

Monte Carlo Tree Search for Collaboration Control of Ghosts in Ms. Pac-Man

Enhancements for Monte-Carlo Tree Search in Ms Pac-Man