NDLI: Identification, Modelling and Prediction of Non-periodic Bursts in Workloads

Content Provider	IEEE Xplore Digital Library
Author	Lassnig, M. Fahringer, T. Garonne, V. Molfetas, A. Branco, M.
Copyright Year	2010
Abstract	Non-periodic bursts are prevalent in workloads of large scale applications. Existing workload models do not predict such non-periodic bursts very well because they mainly focus on repeatable base functions. We begin by showing the necessity to include bursts in workload models by investigating their detrimental effects in a petabyte-scale distributed data management system. This work then makes three contributions. First, we analyse the accuracy of five existing prediction models on workloads of data and computational grids, as well as derived synthetic workloads. Second, we introduce a novel averages-based model to predict bursts in arbitrary workloads. Third, we present a novel metric, mean absolute estimated distance, to assess the prediction accuracy of the model. Using our model and metric, we show that burst behaviour in workloads can be identified, quantified and predicted independently of the underlying base functions. Furthermore, our model and metric are applicable to arbitrary kinds of burst prediction for time series.
Starting Page	485
Ending Page	494
File Size	601256
Page Count	10
File Format	PDF
ISBN	9781424469871
e-ISBN	9781424469888
DOI	10.1109/CCGRID.2010.118
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-05-17
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Predictive models Bandwidth Clouds Grid computing Accuracy Throughput Biomedical measurements Environmental management Large Hadron Collider Conference management burst prediction data management distributed system workload modeling
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

DIRAC: a scalable lightweight architecture for high throughput computing

Grid-Enabled Standards-based Data Management

Dynamic Virtual Resource Management in Clouds Coping with Traffic Burst

A Polymorphic Model for Event Associated Workload Bursts

Modeling and taming parallel TCP on the wide area network

Predicting sporadic grid data transfers

Distributed Database Management Systems and the Data Grid

Grid-based Distributed Computing for the Large Hadron Collider

Evaluating high-throughput reliable multicast for grid applications in production networks

Identification, Modelling and Prediction of Non-periodic Bursts in Workloads

Similar Documents

DIRAC: a scalable lightweight architecture for high throughput computing

Grid-Enabled Standards-based Data Management

Dynamic Virtual Resource Management in Clouds Coping with Traffic Burst

A Polymorphic Model for Event Associated Workload Bursts

Modeling and taming parallel TCP on the wide area network

Predicting sporadic grid data transfers

Distributed Database Management Systems and the Data Grid

Grid-based Distributed Computing for the Large Hadron Collider

Evaluating high-throughput reliable multicast for grid applications in production networks

Identification, Modelling and Prediction of Non-periodic Bursts in Workloads