NDLI: Online learning and adaptation over networks: More information is not necessarily better

Content Provider	IEEE Xplore Digital Library
Author	Sayed, A.H. Sheng-Yuan Tu Jianshu Chen
Copyright Year	2013
Description	Author affiliation: Dept. of Electr. Eng., Univ. of California, Los Angeles, Los Angeles, CA, USA (Sayed, A.H.; Sheng-Yuan Tu; Jianshu Chen)
Abstract	We examine the performance of stochastic-gradient learners over connected networks for global optimization problems involving risk functions that are not necessarily quadratic. We consider two well-studied classes of distributed schemes including consensus strategies and diffusion strategies. We quantify how the mean-square-error and the convergence rate of the network vary with the combination policy and with the fraction of informed agents. Several combination policies are considered including doubly-stochastic rules, the averaging rule, Metropolis rule, and the Hastings rule. It will be seen that the performance of the network does not necessarily improve with a larger proportion of informed agents. A strategy to counter the degradation in performance is presented.
Starting Page	1
Ending Page	8
File Size	361815
Page Count	8
File Format	PDF
ISBN	9781467346481
e-ISBN	9781467346474
DOI	10.1109/ITA.2013.6502975
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-02-10
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Noise Cost function Vectors Nickel Approximation methods Erbium Convergence
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Online learning and adaptation over networks: more information is not necessarily better.

On the generalization ability of distributed online learners

Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks

Distributed optimization via diffusion adaptation

Optimal combination rules for adaptation and learning over networks

Distributed pareto-optimal solutions via diffusion adaptation

Convergence of a neural network for sparse approximation using the nonsmooth Łojasiewicz inequality

With Oxy gen, More is Not Necessarily Better

Asynchronous diffusion adaptation over networks

Online learning and adaptation over networks: More information is not necessarily better

Similar Documents

Online learning and adaptation over networks: more information is not necessarily better.

On the generalization ability of distributed online learners

Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks

Distributed optimization via diffusion adaptation

Optimal combination rules for adaptation and learning over networks

Distributed pareto-optimal solutions via diffusion adaptation

Convergence of a neural network for sparse approximation using the nonsmooth Łojasiewicz inequality

With Oxy gen, More is Not Necessarily Better

Asynchronous diffusion adaptation over networks

Online learning and adaptation over networks: More information is not necessarily better