NDLI: Human and Machine Learning in Non-Markovian Decision Making

Content Provider	PubMed Central
Author	Clarke, Aaron Michael Friedrich, Johannes Tartaglia, Elisa M. Silvia, Marchesotti Senn, Walter Herzog, Michael H.
Editor	Eleni, Vasilaki
Copyright Year	2015
Abstract	Humans can learn under a wide variety of feedback conditions. Reinforcement learning (RL), where a series of rewarded decisions must be made, is a particularly important type of learning. Computational and behavioral studies of RL have focused mainly on Markovian decision processes, where the next state depends on only the current state and action. Little is known about non-Markovian decision making, where the next state depends on more than the current state and action. Learning is non-Markovian, for example, when there is no unique mapping between actions and feedback. We have produced a model based on spiking neurons that can handle these non-Markovian conditions by performing policy gradient descent [1]. Here, we examine the model’s performance and compare it with human learning and a Bayes optimal reference, which provides an upper-bound on performance. We find that in all cases, our population of spiking neurons model well-describes human performance.
Related Links	http://dx.doi.org/10.1371/journal.pone.0123105
Starting Page	123105
File Format	PDF
ISSN	19326203
e-ISSN	19326203
Journal	PLoS ONE
Issue Number	4
Volume Number	10
Language	English
Publisher	Public Library of Science
Publisher Date	2015-04-01
Access Restriction	Open
Rights Holder	Public Library of Science
Subject Keyword	Biochemistry, Genetics and Molecular Biology(all) Agricultural and Biological Sciences(all) Medicine(all) Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Multidisciplinary

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Symbiotic Brain-Machine Interface through Value-Based Decision Making

Bayesian Decision Making in Human Collectives with Binary Choices

Selective Attention Increases Choice Certainty in Human Decision Making

Humans Optimize Decision-Making by Delaying Decision Onset

Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making

Cultural Differences in Donation Decision-Making

Social Influences in Sequential Decision Making

Human Decision Making Based on Variations in Internal Noise: An EEG Study

A Simple Artificial Life Model Explains Irrational Behavior in Human Decision-Making

Human and Machine Learning in Non-Markovian Decision Making

Similar Documents

A Symbiotic Brain-Machine Interface through Value-Based Decision Making

Bayesian Decision Making in Human Collectives with Binary Choices

Selective Attention Increases Choice Certainty in Human Decision Making

Humans Optimize Decision-Making by Delaying Decision Onset

Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making

Cultural Differences in Donation Decision-Making

Social Influences in Sequential Decision Making

Human Decision Making Based on Variations in Internal Noise: An EEG Study

A Simple Artificial Life Model Explains Irrational Behavior in Human Decision-Making

Human and Machine Learning in Non-Markovian Decision Making