NDLI: Ubik:efficient cache sharing with strict qos for latency-critical workloads (SIGP, Vol. 49, Issue. 4)

Content Provider	ACM Digital Library
Author	Sanchez, Daniel Kasture, Harshad
Abstract	Chip-multiprocessors (CMPs) must often execute workload mixes with different performance requirements. On one hand, user-facing, latency-critical applications (e.g., web search) need low tail (i.e., worst-case) latencies, often in the millisecond range, and have inherently low utilization. On the other hand, compute-intensive batch applications (e.g., MapReduce) only need high long-term average performance. In current CMPs, latency-critical and batch applications cannot run concurrently due to interference on shared resources. Unfortunately, prior work on quality of service (QoS) in CMPs has focused on guaranteeing average performance, not tail latency. In this work, we analyze several latency-critical workloads, and show that guaranteeing average performance is insufficient to maintain low tail latency, because microarchitectural resources with state, such as caches or cores, exert inertia on instantaneous workload performance. Last-level caches impart the highest inertia, as workloads take tens of milliseconds to warm them up. When left unmanaged, or when managed with conventional QoS frameworks, shared last-level caches degrade tail latency significantly. Instead, we propose Ubik, a dynamic partitioning technique that predicts and exploits the transient behavior of latency-critical workloads to maintain their tail latency while maximizing the cache space available to batch applications. Using extensive simulations, we show that, while conventional QoS frameworks degrade tail latency by up to 2.3x, Ubik simultaneously maintains the tail latency of latency-critical workloads and significantly improves the performance of batch applications.
Starting Page	729
Ending Page	742
Page Count	14
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/2644865.2541944
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	49
Issue Number	4
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Multicore Tail latency Interference Quality of service Isolation Cache partitioning Resource management
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Ubik:efficient cache sharing with strict qos for latency-critical workloads (CARN, Vol. 42, Issue. 1)

Ubik: efficient cache sharing with strict qos for latency-critical workloads

Dirigent:Enforcing QoS for Latency-Critical Tasks on Shared Multicore Systems (SIGP, Vol. 51, Issue. 4)

High-performance fractal coherence (SIGP, Vol. 49, Issue. 4)

Quasar:resource-efficient and QoS-aware cluster management (SIGP, Vol. 49, Issue. 4)

Dirigent:Enforcing QoS for Latency-Critical Tasks on Shared Multicore Systems (CARN, Vol. 44, Issue. 2)

The sharing architecture:sub-core configurability for IaaS clouds (SIGP, Vol. 49, Issue. 4)

Improving Datacenter Efficiency (SIGP, Vol. 52, Issue. 4)

Rhythm:harnessing data parallel hardware for server workloads (SIGP, Vol. 49, Issue. 4)

Ubik:efficient cache sharing with strict qos for latency-critical workloads (SIGP, Vol. 49, Issue. 4)

Similar Documents

Ubik:efficient cache sharing with strict qos for latency-critical workloads (CARN, Vol. 42, Issue. 1)

Ubik: efficient cache sharing with strict qos for latency-critical workloads

Dirigent:Enforcing QoS for Latency-Critical Tasks on Shared Multicore Systems (SIGP, Vol. 51, Issue. 4)

High-performance fractal coherence (SIGP, Vol. 49, Issue. 4)

Quasar:resource-efficient and QoS-aware cluster management (SIGP, Vol. 49, Issue. 4)

Dirigent:Enforcing QoS for Latency-Critical Tasks on Shared Multicore Systems (CARN, Vol. 44, Issue. 2)

The sharing architecture:sub-core configurability for IaaS clouds (SIGP, Vol. 49, Issue. 4)

Improving Datacenter Efficiency (SIGP, Vol. 52, Issue. 4)

Rhythm:harnessing data parallel hardware for server workloads (SIGP, Vol. 49, Issue. 4)

Ubik:efficient cache sharing with strict qos for latency-critical workloads (SIGP, Vol. 49, Issue. 4)