NDLI: Using Storage Class Memory Efficiently for an In-memory Database

Please wait, while we are loading the content...

The DragonBeam Framework: Hardware-Protected Security Modules for In-Place Intrusion Detection

Health-Binning: Maximizing the Performance and the Endurance of Consumer-Level NAND Flash

Enabling Space Elasticity in Storage Systems

Black box replication: Breaking the latency limits

Exploiting Parallelism of Distributed Nested Transactions

Proper Timed I/O: High-Accuracy Real-Time Control for Conventional Operating Systems

A study on the errors and uncertainties of file system trace capture methods

Enterprise Resource Management in Mesos Clusters

SeMiNAS: A Secure Middleware for Wide-Area Network-Attached Storage

Elastic Queue: A Universal SSD Lifetime Extension Plug-in for Cache Replacement Algorithms

SSD Failures in Datacenters: What? When? and Why?

Versioned Programming: A Simple Technique for Implementing Efficient, Lock-Free, and Composable Data Structures

Reducing Journaling Harm on Virtualized I/O Systems

Utilizing Optical Circuits in Hybrid Packet/Circuit Data-Center Networks

Helping Protect Software Distribution with PSWD

S-RAC: SSD Friendly Caching for Data Center Workloads

Supporting data-driven I/O on GPUs using GPUfs

File System Usage in Android Mobile Phones

Coded Network Switches for Improved Throughput

A Robotic Mobile Hot Spot Relay (MHSR) for Disaster Areas

Using Storage Class Memory Efficiently for an In-memory Database

Software-Defined Emulation Infrastructure for High Speed Storage

IO Core Manager for Virtual Environments

Cross-ISA Container Migration

Memory-Aware Management for Multi-Level Main Memory Complex using an Optimization of the Aging Paging Algorithm

Flexible Download Time Analysis of Coded Storage Systems

Fast and Scalable Security Support for Directory-Based Distributed Shared Memory

Optics in Data Centers: Adapting to Diverse Modern Workloads

Semi-Open Trace Based Simulation for Reliable Evaluation of Job Throughput and User Productivity

Using Storage Class Memory Efficiently for an In-memory Database

Content Provider	ACM Digital Library
Author	Nider, Joel Weinsberg, Yaron Gottesman, Yonatan Kat, Ronen Factor, Michael
Abstract	Storage class memory (SCM) is an emerging class of memory devices that are both byte addressable, and persistent. There are many different technologies that can be considered SCM, at different stages of maturity. Examples of such technologies include NVDIMM-N, PCM, SttRAM, Racetrack, FeRAM, and others. Currently, applications rely on storage technologies such as Flash memory and hard disks as the physical media for persistency. SCM behaves differently and has significantly different characteristics than these existing technologies. That means there is a need for a fundamental change in the way we program data persistency in applications to fully realize the potential of this new class of device. Previous work such as [1] focuses on designing a filesystem optimized to run over SCM memory. Other projects such as Mnemosyne [4] provide a general purpose API for applications to use SCM memory. Mnemosyne however, does not provide a transaction mechanism flexible enough to allow different SCM updates spanning different parts of the code to be considered one transaction. Our work is focused on employing minimal changes needed to retrofit an existing key-value store to take advantage of SCM technology. We demonstrate these changes on Redis (REmote DIctionary Server) [3], which is a popular key-value store. We show how Redis can be modified to take advantage of these new abilities by allowing the application to manage its own storage in a unique way. Our approach is to use two types of memory technologies (DRAM and SCM) for different purposes in a single application. To optimize the system data capacity, we keep a minimal dataset in persistent memory, while keeping metadata (such as indexing) in DRAM, which can be rebuilt upon failures. Persistency in Redis is currently performed by logging all transactions to an append-only log file (AOF). These transactions can then be replayed to recover from a failure. The transactions are not made persistent until the AOF file is flushed to disk, which is very slow. Flushing after every transaction has a performance impact, but flushing periodically creates a risk of lost data. By using SCM instead of a disk, we can effectively flush every transaction without impacting performance. In order to change Redis to store data objects on the SCM, we must ensure consistency of persistent data even after an unexpected shutdown. To ensure consistency, a modified version of dlmalloc [2] is used for all allocations done on the SCM, and mfence commands are used to overcome unexpected reordering. We model the SCM using a memory mapped file backed on a ramdisk. We compared our changes to Redis using an AOF backed on a ramdisk. Although we don't take into account the latency overheads of accessing the SCM, this comparison gives us a good upper bound of performance benefits of using SCM memory. Our results demonstrate an average latency reduction of 43% and average throughput increase of 75%.
Starting Page	1
Ending Page	1
Page Count	1
File Format	PDF
ISBN	9781450343817
DOI	10.1145/2928275.2933273
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-06-06
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Key-value store Database Redis Pcm Scm
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in