NDLI: Implementing linearizability at large scale and low latency

Please wait, while we are loading the content...

IronFleet: proving practical distributed systems correct

No compromises: distributed transactions with consistency, availability, and performance

Paxos made transparent

Parallelizing user-defined aggregations using symbolic execution

JouleGuard: energy guarantees for approximate applications

Yesquel: scalable sql storage for web applications

Existential consistency: measuring and understanding consistency at Facebook

Failure sketching: a technique for automated root cause diagnosis of in-production failures

Interruptible tasks: treating memory pressure as interrupts for highly scalable data-parallel programs

How to get more value from your file system directory cache

Using Crash Hoare logic for certifying the FSCQ file system

Implementing linearizability at large scale and low latency

E2: a framework for NFV applications

Read-log-update: a lightweight synchronization mechanism for concurrent programming

Software defined batteries

Building consistent transactions with inconsistent replication

Virtual CPU validation

Cross-checking semantic correctness: the case of finding file system bugs

Chaos: scale-out graph processing from secondary storage

Opportunistic storage maintenance

SibylFS: formal specification and oracle-based testing for POSIX and real-world file systems

Fast in-memory transaction processing using RDMA and HTM

Vuvuzela: scalable private messaging resistant to traffic analysis

Coz: finding code that counts with causal profiling

Drowsy power management

High-performance ACID via modular concurrency control

Holistic configuration management at Facebook

Pivot tracing: dynamic causal monitoring for distributed systems

Arabesque: a system for distributed graph mining

Split-level I/O scheduling

Implementing linearizability at large scale and low latency

Content Provider	ACM Digital Library
Author	Kejriwal, Ankita Lee, Collin Matsushita, Satoshi Park, Seo Jin Ousterhout, John
Abstract	Linearizability is the strongest form of consistency for concurrent systems, but most large-scale storage systems settle for weaker forms of consistency. RIFL provides a general-purpose mechanism for converting at-least-once RPC semantics to exactly-once semantics, thereby making it easy to turn non-linearizable operations into linearizable ones. RIFL is designed for large-scale systems and is lightweight enough to be used in low-latency environments. RIFL handles data migration by associating linearizability metadata with objects in the underlying store and migrating metadata with the corresponding objects. It uses a lease mechanism to implement garbage collection for metadata. We have implemented RIFL in the RAMCloud storage system and used it to make basic operations such as writes and atomic increments linearizable; RIFL adds only 530 ns to the 13.5 μs base latency for durable writes. We also used RIFL to construct a new multi-object transaction mechanism in RAMCloud; RIFL's facilities significantly simplified the transaction implementation. The transaction mechanism can commit simple distributed transactions in about 20 μs and it outperforms the H-Store main-memory database system for the TPC-C benchmark.
Starting Page	71
Ending Page	86
Page Count	16
File Format	PDF MP4
ISBN	9781450338349
DOI	10.1145/2815400.2815416
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-10-04
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Audio Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Large-Scale Real-Time Product Recommendation at Criteo

Large-Scale Machine Learning at Verizon: Theory and Applications

Large-scale cluster management at Google with Borg

Sparrow: distributed, low latency scheduling

Realizing a low-latency virtual reality environment for motor learning

Low Latency Geo-distributed Data Analytics

Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis

Low-latency scheduling in large switches

Efficient Gigabit Ethernet Switch Models for Large-Scale Simulation

Implementing linearizability at large scale and low latency

Similar Documents

Large-Scale Real-Time Product Recommendation at Criteo

Large-Scale Machine Learning at Verizon: Theory and Applications

Large-scale cluster management at Google with Borg

Sparrow: distributed, low latency scheduling

Realizing a low-latency virtual reality environment for motor learning

Low Latency Geo-distributed Data Analytics

Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis

Low-latency scheduling in large switches

Efficient Gigabit Ethernet Switch Models for Large-Scale Simulation

Implementing linearizability at large scale and low latency