NDLI: Reward hierarchical temporal memory

Content Provider	IEEE Xplore Digital Library
Author	Hansol Choi Jun-Cheol Park Jae Hyun Lim Jae Young Jun Dae-Shik Kim
Copyright Year	2012
Description	Author affiliation: Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea (Hansol Choi; Jun-Cheol Park; Jae Hyun Lim; Jae Young Jun; Dae-Shik Kim)
Abstract	In humans and animals, reward prediction error encoded by dopamine systems is thought to be important in the temporal difference learning class of reinforcement learning (RL). With RL algorithms, many brain models have described the function of dopamine and related areas, including the basal ganglia and frontal cortex. In spite of this importance, how the reward prediction error itself is computed is not understood well, including the problem of how the current states are assigned to a memorized states and how the values of the states are memorized. In this paper, we describe a neocortical model for memorizing state space and computing reward prediction error, known as ‘reward hierarchical temporal memory’ (rHTM). In this model, the temporal relationships among events are hierarchically stored. Using this memory, rHTM computes reward prediction errors by associating the memorized sequences to rewards and inhibits the predicted reward. In a simulation, our model behaved similarly to dopaminergic neurons. We suggest that our model can provide a hypothetical framework of interaction between cortex and dopamine neurons.
Starting Page	1
Ending Page	7
File Size	1295659
Page Count	7
File Format	PDF
ISBN	9781467314886
ISSN	21614393
e-ISBN	9781467314909
e-ISBN	9781467314893
DOI	10.1109/IJCNN.2012.6252433
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-06-10
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Computational modeling Predictive models Instruments Neurons Brain modeling Animals Prediction algorithms reward-HTM reward reinforcement learning reward prediction error temporal difference HTM rHTM
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Reward hierarchical temporal memory model for memorizing and computing reward prediction error by neocortex.

A robust implementation of the spatial pooler within the theory of Hierarchical Temporal Memory (HTM)

Td models of reward predictive responses in dopamine neurons.

Reward-predictive value in learning-related hippocampal neural activity

TD models of reward predictive responses in dopamine neurons

Temporal difference models and reward-related learning in the human brain (2003)

Temporal difference models and reward-related learning in the human brain (2003)

Synapses, predictions, and prediction errors: A neocortical computational study of MDD using the temporal memory algorithm of HTM

A predictive reinforcement learning framework for modeling human decision making behavior

Reward hierarchical temporal memory

Similar Documents

Reward hierarchical temporal memory model for memorizing and computing reward prediction error by neocortex.

A robust implementation of the spatial pooler within the theory of Hierarchical Temporal Memory (HTM)

Td models of reward predictive responses in dopamine neurons.

Reward-predictive value in learning-related hippocampal neural activity

TD models of reward predictive responses in dopamine neurons

Temporal difference models and reward-related learning in the human brain (2003)

Temporal difference models and reward-related learning in the human brain (2003)

Synapses, predictions, and prediction errors: A neocortical computational study of MDD using the temporal memory algorithm of HTM

A predictive reinforcement learning framework for modeling human decision making behavior

Reward hierarchical temporal memory