NDLI: AROMA: automated resource allocation and configuration of mapreduce environment in the cloud

Please wait, while we are loading the content...

Symbiosis in scale out networking and data management

Net-cohort: detecting and managing VM ensembles in virtualized data centers

When average is not average: large response time fluctuations in n-tier systems

Locomotion@location: when the rubber hits the road

Automated machine learning for autonomic computing

Budget-based control for interactive services with adaptive execution

Adaptive green hosting

VESPA: multi-layered self-protection for cloud resources

High efficiency at web scale

3-Dimensional root cause diagnosis via co-analysis

Application-aware cross-layer virtual machine resource management

Provisioning multi-tier cloud applications using statistical bounds on sojourn time

An autonomic resource provisioning framework for mobile computing grids

On the design of decentralized control architectures for workload consolidation in large-scale server clusters

Dynamic energy-aware capacity provisioning for cloud computing environments

Usage patterns in multi-tenant data centers: a temporal perspective

UBL: unsupervised behavior learning for predicting performance anomalies in virtualized cloud systems

Shifting GEARS to enable guest-context virtual services

Automated profiling and resource management of pig programs for meeting service level objectives

A self-tuning self-optimizing approach for automated network anomaly detection systems

Transactional auto scaler: elastic scaling of in-memory transactional data grids

Toward fast eventual consistency with performance guarantees

Evaluating compressive sampling strategies for performance monitoring of data centers

AROMA: automated resource allocation and configuration of mapreduce environment in the cloud

Event correlation for operations management of largescale IT systems

Optimal autoscaling in a IaaS cloud

PowerTracer: tracing requests in multi-tier services to diagnose energy inefficiency

AROMA: automated resource allocation and configuration of mapreduce environment in the cloud

Content Provider	ACM Digital Library
Author	Lama, Palden Zhou, Xiaobo
Abstract	Distributed data processing framework MapReduce is increasingly deployed in Clouds to leverage the pay-per-usage cloud computing model. Popular Hadoop MapReduce environment expects that end users determine the type and amount of Cloud resources for reservation as well as the configuration of Hadoop parameters. However, such resource reservation and job provisioning decisions require in-depth knowledge of system internals and laborious but often ineffective parameter tuning. We propose and develop AROMA, a system that automates the allocation of heterogeneous Cloud resources and configuration of Hadoop parameters for achieving quality of service goals while minimizing the incurred cost. It addresses the significant challenge of provisioning ad-hoc jobs that have performance deadlines in Clouds through a novel two-phase machine learning and optimization framework. Its technical core is a support vector machine based performance model that enables the integration of various aspects of resource provisioning and auto-configuration of Hadoop jobs. It adapts to ad-hoc jobs by robustly matching their resource utilization signature with previously executed jobs and making provisioning decisions accordingly. We implement AROMA as an automated job provisioning system for Hadoop MapReduce hosted in virtualized HP ProLiant blade servers. Experimental results show AROMA's effectiveness in providing performance guarantee of diverse Hadoop benchmark jobs while minimizing the cost of Cloud resource usage.
Starting Page	63
Ending Page	72
Page Count	10
File Format	PDF
ISBN	9781450315203
DOI	10.1145/2371536.2371547
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-09-18
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Auto-configuration Resource allocation Mapreduce
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automated frameworks for performance improvement of mapreduce and resource auto scaling services in cloud environment

Resource allocation and scheduling in cloud computing

Improving utilization through dynamic VM resource allocation in hybrid cloud environment

Purlieus: locality-aware resource allocation for MapReduce in a cloud

Survey on improved Autoscaling in Hadoop into cloud environments

1Cost-effective Resource Provisioning for MapReduce in a

NORA: Network Oriented Resource Allocation for Data Intensive Applications in the Cloud Environment

An Adaptive Task Allocation Approach for MapReduce in a Heterogeneous Cloud

Minimizing Cost of Virtual Machines for Deadline-Constrained MapReduce Applications in the Cloud

AROMA: automated resource allocation and configuration of mapreduce environment in the cloud

Similar Documents

Automated frameworks for performance improvement of mapreduce and resource auto scaling services in cloud environment

Resource allocation and scheduling in cloud computing

Improving utilization through dynamic VM resource allocation in hybrid cloud environment

Purlieus: locality-aware resource allocation for MapReduce in a cloud

Survey on improved Autoscaling in Hadoop into cloud environments

1Cost-effective Resource Provisioning for MapReduce in a

NORA: Network Oriented Resource Allocation for Data Intensive Applications in the Cloud Environment

An Adaptive Task Allocation Approach for MapReduce in a Heterogeneous Cloud

Minimizing Cost of Virtual Machines for Deadline-Constrained MapReduce Applications in the Cloud

AROMA: automated resource allocation and configuration of mapreduce environment in the cloud