NDLI: A Hebbian feedback covariance learning paradigm for self-tuning optimal control

Content Provider	IEEE Xplore Digital Library
Author	Young, D.L. Poon, C.-S.
Copyright Year	1996
Abstract	We propose a novel adaptive optimal control paradigm inspired by Hebbian covariance synaptic adaptation, a preeminent model of learning and memory as well as other malleable functions in the brain. The adaptation is driven by the spontaneous fluctuations in the system input and output, the covariance of which provides useful information about the changes in the system behavior. The control structure represents a novel form of associative reinforcement learning in which the reinforcement signal is implicitly given by the covariance of the input-output (I/O) signals. Theoretical foundations for the paradigm are derived using Lyapunov theory and are verified by means of computer simulations. The learning algorithm is applicable to a general class of nonlinear adaptive control problems. This on-line direct adaptive control method benefits from a computationally straightforward design, proof of convergence, no need for complete system identification, robustness to noise and uncertainties, and the ability to optimize a general performance criterion in terms of system states and control signals. These attractive properties of Hebbian feedback covariance learning control lend themselves to future investigations into the computational functions of synaptic plasticity in biological neurons.
Starting Page	173
Ending Page	186
Page Count	14
File Size	490849
File Format	PDF
ISSN	10834419
Volume Number	31
Issue Number	2
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2001-04-01
Publisher Place	U.S.A.
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Feedback Adaptive control Programmable control Optimal control Brain modeling Adaptation model Fluctuations Learning Computer simulation Signal design
Content Type	Text
Resource Type	Article
Subject	Control and Systems Engineering Information Systems Electrical and Electronic Engineering Human-Computer Interaction Computer Science Applications Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Hebbian covariance synapse: a self-tuning neural device for reinforcement learning

Hebbian Covariance Learning and Self-Tuning Optimal Control

Iterative feedback tuning: theory and applications

Reinforcement learning and adaptive dynamic programming for feedback control

Stabilizing distributed queuing systems using feedback based on diversity

Hebbian learning algorithms for neural adaptive optimal control

Dynamic output feedback controller design for fuzzy systems

Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

Connectionism, Controllers, and a Brain Theory

A Hebbian feedback covariance learning paradigm for self-tuning optimal control

Similar Documents

Hebbian covariance synapse: a self-tuning neural device for reinforcement learning

Hebbian Covariance Learning and Self-Tuning Optimal Control

Iterative feedback tuning: theory and applications

Reinforcement learning and adaptive dynamic programming for feedback control

Stabilizing distributed queuing systems using feedback based on diversity

Hebbian learning algorithms for neural adaptive optimal control

Dynamic output feedback controller design for fuzzy systems

Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

Connectionism, Controllers, and a Brain Theory

A Hebbian feedback covariance learning paradigm for self-tuning optimal control