NDLI: Serotonin and dopamine systems: Internal areas and sequential tasks

Content Provider	IEEE Xplore Digital Library
Author	Dongshu Wang Yihai Duan Juyang Weng
Copyright Year	2014
Description	Author affiliation: Sch. of Electr. Eng., Zhengzhou Univ., Zhengzhou, China (Dongshu Wang; Yihai Duan) \|\| Comput. Sci. & Eng., Michigan State Univ., East Lansing, MI, USA (Juyang Weng)
Abstract	Serotonin and dopamine transmitters are synthesized in the lower brain but are transmitted widely to many areas of the brain. Emergent representations are critical in understanding their effects. In our prior work [26], their effects on internal, non-motor neurons are studied for pattern recognition tasks only. In this paper, we study their effects on sequential tasks - robot navigation with different settings. They are sequential tasks because the outcome of behavior depends on not only the current behavior as in pattern recognition but also the previous behaviors (e.g., previous navigational trajectories). Analytically, we show that the serotonin and dopamine systems affect the performance of sequential tasks in a compounded way. Experimentally, we show that the effect on the learning rate of feature neurons (in the Y area) allows the agent to approach the friend and avoid the enemy faster as compounding effects of sequential states. Further, we tested the effect of punishment and reward schedule with the same initial locations. We also experimented the effect of punishment and reward schedule with random initial locations. These experiments all indicated that the reinforcement learning via the serotonin and the dopamine systems is beneficial for developing desirable behaviors in this set of sequential tasks - staying close to its friend and away from its enemy. As far as we know, this is the first work that investigates the effects of reinforcer (via serotonin and dopamine) on internal neurons for sequential tasks.
Starting Page	3379
Ending Page	3386
File Size	2909156
Page Count	8
File Format	PDF
ISSN	21614407
e-ISBN	9781479914845
DOI	10.1109/IJCNN.2014.6889957
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-07-06
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Neurons Vectors Neurotransmitters Robot sensing systems Pain
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in