NDLI: Distributed Online Learning via Cooperative Contextual Bandits

Content Provider	IEEE Xplore Digital Library
Author	Tekin, C. van der Schaar, M.
Copyright Year	1991
Abstract	In this paper, we propose a novel framework for decentralized, online learning by many learners. At each moment of time, an instance characterized by a certain context may arrive to each learner; based on the context, the learner can select one of its own actions (which gives a reward and provides information) or request assistance from another learner. In the latter case, the requester pays a cost and receives the reward but the provider learns the information. In our framework, learners are modeled as cooperative contextual bandits. Each learner seeks to maximize the expected reward from its arrivals, which involves trading off the reward received from its own actions, the information learned from its own actions, the reward received from the actions requested of others and the cost paid for these actions-taking into account what it has learned about the value of assistance from each other learner. We develop distributed online learning algorithms and provide analytic bounds to compare the efficiency of these with algorithms with the complete knowledge (oracle) benchmark (in which the expected reward of every action in every context is known by every learner). Our estimates show that regret-the loss incurred by the algorithm-is sublinear in time. Our theoretical framework can be used in many practical applications including Big Data mining, event detection in surveillance sensor networks and distributed online recommendation systems.
Sponsorship	IEEE Signal Processing Society
Starting Page	3700
Ending Page	3714
Page Count	15
File Size	3548235
File Format	PDF
ISSN	1053587X
Volume Number	63
Issue Number	14
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Context Partitioning algorithms Signal processing algorithms Algorithm design and analysis Security Benchmark testing Training online learning Contextual bandits cooperative learning distributed learning multi-user bandits multi-user learning
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Distributed Online Learning in Social Recommender Systems

RELEAF: An Algorithm for Learning and Exploiting Relevance

Attribute-Distributed Learning: Models, Limits, and Algorithms

Predicting Grades

Mining the Situation: Spatiotemporal Traffic Prediction With Big Data

Context-adaptive big data stream mining

Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games

1Distributed Online Learning via Cooperative Contextual Bandits

Multi-Agent Distributed Optimization via Inexact Consensus ADMM

Distributed Online Learning via Cooperative Contextual Bandits

Similar Documents

Distributed Online Learning in Social Recommender Systems

RELEAF: An Algorithm for Learning and Exploiting Relevance

Attribute-Distributed Learning: Models, Limits, and Algorithms

Predicting Grades

Mining the Situation: Spatiotemporal Traffic Prediction With Big Data

Context-adaptive big data stream mining

Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games

1Distributed Online Learning via Cooperative Contextual Bandits

Multi-Agent Distributed Optimization via Inexact Consensus ADMM

Distributed Online Learning via Cooperative Contextual Bandits