NDLI: Resilient Self-Compressive Monitoring for Large-Scale Hosting Infrastructures

Content Provider	IEEE Xplore Digital Library
Author	Yongmin Tan Venkatesh, V. Xiaohui Gu
Copyright Year	1990
Abstract	Large-scale hosting infrastructures have become the fundamental platforms for many real-world systems such as cloud computing infrastructures, enterprise data centers, and massive data processing systems. However, it is a challenging task to achieve both scalability and high precision while monitoring a large number of intranode and internode attributes (e.g., CPU usage, free memory, free disk, internode network delay). In this paper, we present the design and implementation of a Resilient self-Compressive Monitoring (RCM) system for large-scale hosting infrastructures. RCM achieves scalable distributed monitoring by performing online data compression to reduce remote data collection cost. RCM provides failure resilience to achieve robust monitoring for dynamic distributed systems where host and network failures are common. We have conducted extensive experiments using a set of real monitoring data from NCSU's virtual computing lab (VCL), PlanetLab, a Google cluster, and real Internet traffic matrices. The experimental results show that RCM can achieve up to 200 percent higher compression ratio and several orders of magnitude less overhead than the existing approaches.
Sponsorship	IEEE Computer Society
Starting Page	576
Ending Page	586
Page Count	11
File Size	1384336
File Format	PDF
ISSN	10459219
Volume Number	24
Issue Number	3
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Monitoring Training Image coding Peer to peer computing Data compression Distributed databases Measurement distributed system monitoring Online data compression
Content Type	Text
Resource Type	Article
Subject	Signal Processing Computational Theory and Mathematics Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

FS2You: Peer-Assisted Semipersistent Online Hosting at a Large Scale

Distributed Data Replenishment

Using Data Accessibility for Resource Selection in Large-Scale Distributed Systems

Churn-Resilient Protocol for Massive Data Dissemination in P2P Networks

Passive Network Performance Estimation for Large-Scale, Data-Intensive Computing

Dynamic Load Balancing for the Distributed Mining of Molecular Structures

NetView: integrating large scale distributed visual databases

CompuP2P: An Architecture for Internet Computing Using Peer-to-Peer Networks

Adaptive Reputation-Based Scheduling on Unreliable Distributed Infrastructures

Resilient Self-Compressive Monitoring for Large-Scale Hosting Infrastructures

Similar Documents

FS2You: Peer-Assisted Semipersistent Online Hosting at a Large Scale

Distributed Data Replenishment

Using Data Accessibility for Resource Selection in Large-Scale Distributed Systems

Churn-Resilient Protocol for Massive Data Dissemination in P2P Networks

Passive Network Performance Estimation for Large-Scale, Data-Intensive Computing

Dynamic Load Balancing for the Distributed Mining of Molecular Structures

NetView: integrating large scale distributed visual databases

CompuP2P: An Architecture for Internet Computing Using Peer-to-Peer Networks

Adaptive Reputation-Based Scheduling on Unreliable Distributed Infrastructures

Resilient Self-Compressive Monitoring for Large-Scale Hosting Infrastructures