NDLI: Optimal Service Elasticity in Large-Scale Distributed Systems

Please wait, while we are loading the content...

Delay Scalings and Mean-Field Limits in Networked Systems

A Low-Complexity Approach to Distributed Cooperative Caching with Geographic Constraints

Hieroglyph: Locally-Sufficient Graph Processing via Compute-Sync-Merge

Investigation of the 2016 Linux TCP Stack Vulnerability at Scale

Fluid-Model-Based Car Routing for Modern Ridesharing Systems

Online Optimization for Markets and the Cloud: Theory and Practice

Stein's Method for Mean-Field Approximations in Light and Heavy Traffic Regimes

Understanding Reduced-Voltage Operation in Modern DRAM Devices: Experimental Characterization, Analysis, and Mechanisms

Hadoop on Named Data Networking: Experience and Results

On Gradient-Based Optimization: Accelerated, Distributed, Asynchronous and Stochastic

Portfolio-driven Resource Management for Transient Cloud Servers

Matrix Factorization at the Frontier of Non-convex Optimizations: Abstract for SIGMETRICS 2017 Rising Star Award Talk

Outward Influence and Cascade Size Estimation in Billion-scale Networks

A Case Study in Power Substation Network Dynamics

Routing Money, Not Packets: A Tutorial on Internet Economics

Optimal Service Elasticity in Large-Scale Distributed Systems

A Simple Yet Effective Balanced Edge Partition Model for Parallel Computing

Characterizing and Modeling Patching Practices of Industrial Control Systems

Pseudo-Separation for Assessment of Structural Vulnerability of a Network

Expected Values Estimated via Mean-Field Approximation are 1/N-Accurate: Extended Abstract

Exploiting Data Longevity for Enhancing the Lifetime of Flash-based Storage Class Memory

Using Burstable Instances in the Public Cloud: Why, When and How?

Optimal Posted Prices for Online Cloud Resource Allocation

Accelerating Performance Inference over Closed Systems by Asymptotic Methods

Persistent Spread Measurement for Big Network Data Based on Register Intersection

Queue-Proportional Sampling: A Better Approach to Crossbar Scheduling for Input-Queued Switches

Overcommitment in Cloud Services Bin packing with Chance Constraints

Security Game with Non-additive Utilities and Multiple Attacker Resources

On the Capacity Requirement for Arbitrary End-to-End Deadline and Reliability Guarantees in Multi-hop Networks

Analysis of a Stochastic Model of Replication in Large Distributed Storage Systems: A Mean-Field Approach

Design-Induced Latency Variation in Modern DRAM Chips: Characterization, Analysis, and Latency Reduction Mechanisms

Dandelion: Redesigning the Bitcoin Network for Anonymity

On Optimal Two-Sided Pricing of Congested Networks

Quality and Cost of Deterministic Network Calculus: Design and Evaluation of an Accurate and Fast Analysis

Deconstructing the Energy Consumption of the Mobile Page Load

Optimizing Speculative Execution of Deadline-Sensitive Jobs in Cloud

A Spot Capacity Market to Increase Power Infrastructure Utilization in Multi-Tenant Data Centers

Hour-Ahead Offering Strategies in Electricity Market for Power Producers with Storage and Intermittent Supply

Why "Some" Like It Hot Too: Thermal Attack on Data Centers

Incentivizing Reliable Demand Response with Customers' Uncertainties and Capacity Planning

A Study on Performance and Power Efficiency of Dense Non-Volatile Caches in Multi-Core Systems

Scheduling Coflows in Datacenter Networks: Improved Bound for Total Weighted Completion Time

Characterizing 3D Floating Gate NAND Flash

ECF: An MPTCP Path Scheduler to Manage Heterogeneous Paths

Simplex Queues for Hot-Data Download

An Empirical Analysis of Facebook's Free Basics

Multipath TCP on a VANET: A Performance Study

A Fast, Small, and Dynamic Forwarding Information Base

HFTraC: High-Frequency Traffic Control

Adaptive TTL-Based Caching for Content Delivery

Optimal Service Elasticity in Large-Scale Distributed Systems

Content Provider	ACM Digital Library
Author	Mukherjee, Debankur Borst, Sem C. van Leeuwaarden, Johan S.H. Dhara, Souvik
Abstract	A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and time-varying demand patterns. Auto-scaling provides a popular paradigm for automatically adjusting service capacity in response to demand while meeting performance targets, and queue-driven auto-scaling techniques have been widely investigated in the literature. In typical data center architectures and cloud environments however, no centralized queue is maintained, and load balancing algorithms immediately distribute incoming tasks among parallel queues. In these distributed settings with vast numbers of servers, centralized queue-driven auto-scaling techniques involve a substantial communication overhead and major implementation burden, or may not even be viable at all. Motivated by the above issues, we propose a joint auto-scaling and load balancing scheme which does not require any global queue length information or explicit knowledge of system parameters, and yet provides provably near-optimal service elasticity. We establish the fluid-level dynamics for the proposed scheme in a regime where the total traffic volume and nominal service capacity grow large in proportion. The fluid-limit results show that the proposed scheme achieves asymptotic optimality in terms of user-perceived delay performance as well as energy consumption. Specifically, we prove that both the waiting time of tasks and the relative energy portion consumed by idle servers vanish in the limit. At the same time, the proposed scheme operates in a distributed fashion and involves only constant communication overhead per task, thus ensuring scalability in massive data center operations. Extensive simulation experiments corroborate the fluid-limit results, and demonstrate that the proposed scheme can match the user performance and energy consumption of state-of-the-art approaches that do take full advantage of a centralized queue.
Starting Page	3
Ending Page	3
Page Count	1
File Format	PDF
ISBN	9781450350327
DOI	10.1145/3078505.3078532
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2017-06-05
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Data centers Auto-scaling Delay performance Cloud networking Energy saving Load balancing Fluid limits Join-the-idle queue
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Delay Scalings and Mean-Field Limits in Networked Systems

A Two Level Load Balancing Approach for Cloud Environment

Ananta: cloud scale load balancing

Cloud services brokering for elastic workloads

Load Balancing in Distributed Cloud Data Center Configurations: Performance and Energy-Efficiency

Profit Aware Load Balancing for Distributed Cloud Data Centers

Join-Idle-Queue with Service Elasticity: Large-Scale Asymptotics of a Non-monotone System

Join-idle-queue: a novel load balancing algorithm for dynamically scalable web services.

Energy effciency and performance of cloud data centers: which role can modeling play?

Optimal Service Elasticity in Large-Scale Distributed Systems

Similar Documents

Delay Scalings and Mean-Field Limits in Networked Systems

A Two Level Load Balancing Approach for Cloud Environment

Ananta: cloud scale load balancing

Cloud services brokering for elastic workloads

Load Balancing in Distributed Cloud Data Center Configurations: Performance and Energy-Efficiency

Profit Aware Load Balancing for Distributed Cloud Data Centers

Join-Idle-Queue with Service Elasticity: Large-Scale Asymptotics of a Non-monotone System

Join-idle-queue: a novel load balancing algorithm for dynamically scalable web services.

Energy effciency and performance of cloud data centers: which role can modeling play?

Optimal Service Elasticity in Large-Scale Distributed Systems