NDLI: Autonomic multi-policy optimization in pervasive systems: Overview and evaluation

Please wait, while we are loading the content...

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 11

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 10

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 9

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 8

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 7

Issue 4(Special Section: Extended Version of SASO 2011 Best Paper), December 2012

Issue 3, September 2012

Issue 2, July 2012

Issue 1(Special section on formal methods in pervasive computing, pervasive adaptation, and self-adaptive systems: Models and algorithms), April 2012

Introduction to special section on formal methods in pervasive computing

A formalized, taxonomy-driven approach to cross-layer application adaptation

FORMS: Unifying reference model for formal specification of distributed self-adaptive systems

Introduction to the special section on pervasive adaptation

3PC: System support for adaptive peer-to-peer pervasive computing

Autonomic multi-policy optimization in pervasive systems: Overview and evaluation

Reflective pervasive systems

Introduction to the special section on self-adaptive systems: Models and algorithms

Decentralized and optimal control of shared resource pools

A morphogenetic framework for self-organized multirobot pattern formation and boundary coverage

Techniques for knowledge acquisition in dynamically changing environments

Decentralized approaches for self-adaptation in agent organizations

Self-organizing virtual macro sensors

Efficiency of optimistic fair exchange using trusted devices

Host selection through collective decision

Efficient load balancing in partitioned queries under random perturbations

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 6

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 5

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 4

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 3

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 2

ACM Transactions on Autonomous and Adaptive Systems (TAAS) : Volume 1

Autonomic multi-policy optimization in pervasive systems: Overview and evaluation

Content Provider	ACM Digital Library
Author	Cahill, Vinny Dusparic, Ivana
Copyright Year	2013
Abstract	This article describes Distributed W-Learning (DWL), a reinforcement learning-based algorithm for collaborative agent-based optimization of pervasive systems. DWL supports optimization towards multiple heterogeneous policies and addresses the challenges arising from the heterogeneity of the agents that are charged with implementing them. DWL learns and exploits the dependencies between agents and between policies to improve overall system performance. Instead of always executing the locally-best action, agents learn how their actions affect their immediate neighbors and execute actions suggested by neighboring agents if their importance exceeds the local action's importance when scaled using a predefined or learned collaboration coefficient. We have evaluated DWL in a simulation of an Urban Traffic Control (UTC) system, a canonical example of the large-scale pervasive systems that we are addressing. We show that DWL outperforms widely deployed fixed-time and simple adaptive UTC controllers under a variety of traffic loads and patterns. Our results also confirm that enabling collaboration between agents is beneficial as is the ability for agents to learn the degree to which it is appropriate for them to collaborate. These results suggest that DWL is a suitable basis for optimization in other large-scale systems with similar characteristics.
Starting Page	1
Ending Page	25
Page Count	25
File Format	PDF
ISSN	15564665
e-ISSN	15564703
DOI	10.1145/2168260.2168271
Volume Number	7
Issue Number	1
Journal	ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-05-04
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Autonomic computing Decentralized systems Reinforcement learning
Content Type	Text
Resource Type	Article
Subject	Control and Systems Engineering Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using distributed w-learning for multi-policy optimization in decentralized autonomic systems

Design and evaluation of decentralized online clustering

AutoHome: An Autonomic Management Framework for Pervasive Home Applications

Timesharing-tracking framework for decentralized reinforcement learning in fully cooperative multi-agent system

Using reinforcement learning for multi-policy optimization in decentralized autonomic systems- an experimental evaluation.

Reinforcement Learning in Autonomic Computing: A Manifesto and Case Studies

Reinforcement Learning of Informed Initial Policies for Decentralized Planning

Using distributed w-learning for multi-policy optimization in decentralized autonomic systems.

A Decentralized Self-Organizing Service Composition for Autonomic Entities

Autonomic multi-policy optimization in pervasive systems: Overview and evaluation

Similar Documents

Using distributed w-learning for multi-policy optimization in decentralized autonomic systems

Design and evaluation of decentralized online clustering

AutoHome: An Autonomic Management Framework for Pervasive Home Applications

Timesharing-tracking framework for decentralized reinforcement learning in fully cooperative multi-agent system

Using reinforcement learning for multi-policy optimization in decentralized autonomic systems- an experimental evaluation.

Reinforcement Learning in Autonomic Computing: A Manifesto and Case Studies

Reinforcement Learning of Informed Initial Policies for Decentralized Planning

Using distributed w-learning for multi-policy optimization in decentralized autonomic systems.

A Decentralized Self-Organizing Service Composition for Autonomic Entities

Autonomic multi-policy optimization in pervasive systems: Overview and evaluation