NDLI: Nswap2L: Transparently Managing Heterogeneous Cluster Storage Resources for Fast Swapping

Please wait, while we are loading the content...

Large-Memory Nodes for Energy Efficient High-Performance Computing

Write Locality and Optimization for Persistent Memory

Adaptive Row Addressing for Cost-Efficient Parallel Memory Protocols in Large-Capacity Memories

Dense Footprint Cache: Capacity-Efficient Die-Stacked DRAM Last Level Cache

Languages Must Expose Memory Heterogeneity

HAPPY: Hybrid Address-based Page Policy in DRAMs

Photonic Interconnects for Interposer-based 2.5D/3D Integrated Systems on a Chip

Characterizing the Performance of Hybrid Memory Cube Using ApexMAP Application Probes

A New Metric to Measure Cache Utilization for HPC Workloads

Multi-Level Memory Policies: What You Add Is More Important Than What You Take Out

Co-DIMM: Inter-Socket Data Sharing via a Common DIMM Channel

Analyzing allocation behavior for multi-level memory

ConGen: An Application Specific DRAM Memory Controller Generator

AWARD: Approximation-aWAre Restore in Further Scaling DRAM

Understanding the Impact of Air and Microfluidics Cooling on Performance of 3D Stacked Memory Systems

Evaluating the feasibility of storage class memory as main memory

Checkpointing Exascale Memory Systems with Existing Memory Technologies

DRAMPersist: Making DRAM Systems Persistent

Exploring Time and Energy for Complex Accesses to a Hybrid Memory Cube

Processing Acceleration with Resistive Memory-based Computation

Applying Software-based Memory Error Correction for In-Memory Key-Value Store: Case Studies on Memcached and RAMCloud

DRAMScale: Mechanisms to Increase DRAM Capacity

Reliability and Performance Trade-off Study of Heterogeneous Memories

Using Memristor Technology for Multi-value Registers in Signed-digit Arithmetic Circuits

Exposing the Locality of Heterogeneous Memory Architectures to HPC Applications

Fast full system memory checkpointing with SSD-aware memory controller

Analyzing Consistency Issues in HMC Atomics

The Case for Associative DRAM Caches

Software Assisted Hardware Cache Coherence for Heterogeneous Processors

On the Use of DRAM with Unrepaired Weak Cells in Computing Systems

Integrated Thermal Analysis for Processing In Die-Stacking Memory

A Validation of DRAM RAPL Power Measurements

Performance Impact of a Slower Main Memory: A case study of STT-MRAM in HPC

Challenges of Programming a System with Heterogeneous Memories and Heterogeneous Processors: A Programmer's View

Exploring Tag-Bit Memory Operations in Hybrid Memory Cubes

Prefetching as a Potentially Effective Technique for Hybrid Memory Optimization

Improving DRAM Bandwidth Utilization with MLP-Aware OS Paging

CLARA: Circular Linked-List Auto and Self Refresh Architecture

TAPAS: Temperature-aware Adaptive Placement for 3D Stacked Hybrid Caches

Reverse Engineering of DRAMs: Row Hammer with Crosshair

Nswap2L: Transparently Managing Heterogeneous Cluster Storage Resources for Fast Swapping

Analytical Study on Bandwidth Efficiency of Heterogeneous Memory Systems

Twin-Load: Bridging the Gap between Conventional Direct-Attached and Buffer-on-Board Memory Systems

Replacement Policies for Heterogeneous Memories

Data-Centric Computing Frontiers: A Survey On Processing-In-Memory

MicroRefresh: Minimizing Refresh Overhead in DRAM Caches

Low Latency, High Bisection-Bandwidth Networks for Exascale Memory Systems

Concurrent Dynamic Memory Coalescing on GoblinCore-64 Architecture

How Many MLCs Should Impersonate SLCs to Optimize SSD Performance?

DReAM: Dynamic Re-arrangement of Address Mapping to Improve the Performance of DRAMs

Nswap2L: Transparently Managing Heterogeneous Cluster Storage Resources for Fast Swapping

Content Provider	ACM Digital Library
Author	Lehman-Borer, E. Ryerson Newhall, Tia Marks, Benjamin
Abstract	To support data intensive cluster computing, it is increasingly important that node virtual memory (VM) systems make effective use of available fast storage devices for swap or temporary file space. Nswap2L is a novel system that transparently manages a heterogeneous set of storage options commonly found in clusters, including node RAM, disk, flash SSD, PCM, or network storage devices. Nswap2L implements a two-level device driver interface. At the top level, it appears to node operating systems (OSs) as a single, fast, random access device that can be added as a swap partition on cluster nodes. It transparently manages the underlying heterogeneous storage devices, including its own implementation of Network RAM, to which swapped out data are stored. It implements data placement, migration, and prefetching policies that choose which underlying physical devices store swapped-out page data. Its policies incorporate information about device capacity, system load, and the strengths of different physical storage media. By moving device-specific knowledge into Nswap2L, VM policies in the OS can be based solely on typical application access patterns and not on characteristics of underlying physical storage media. Nswap2L's policy decisions are abstracted from the OS, freeing the OS from having to implement specialized policies for different combinations of cluster storage---Nswap2L requires no changes to the OS's VM system. Results of our benchmark tests show that data-intensive applications perform up to 6 times faster on Nswap2L-enabled clusters, and show that our two-level device driver design adds minimal I/O latency to the underlying devices that Nswap2L manages. In addition, we found that even though Nswap2L's Network RAM is faster than any other backing store, its prefetching policy that distributes data over multiple devices results in increased I/O parallelism and can lead to better performance than swapping only to a single underlying device.
Starting Page	50
Ending Page	61
Page Count	12
File Format	PDF
ISBN	9781450343053
DOI	10.1145/2989081.2989107
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-10-03
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Backing storage Cluster systems Network ram Flash
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Incorporating Network RAM and Flash into Fast Backing Store for Clusters

Nswap: A Network Swapping Module for Linux Clusters (2003)

Treeftl: efficient ram management for high performance of nand flash-based storage systems.

TreeFTL: efficient RAM management for high performance of NAND flash-based storage systems

NANDFS: a flexible flash file system for RAM-constrained systems

Research and design of a self-managing storage cluster

Gordon: using flash memory to build fast, power-efficient clusters for data-intensive applications

Performance Analysis of NAND Flash Based Cache for Network Storage System

Vojisto: a linux distribution for flash party networks (2006).

Nswap2L: Transparently Managing Heterogeneous Cluster Storage Resources for Fast Swapping

Similar Documents

Incorporating Network RAM and Flash into Fast Backing Store for Clusters

Nswap: A Network Swapping Module for Linux Clusters (2003)

Treeftl: efficient ram management for high performance of nand flash-based storage systems.

TreeFTL: efficient RAM management for high performance of NAND flash-based storage systems

NANDFS: a flexible flash file system for RAM-constrained systems

Research and design of a self-managing storage cluster

Gordon: using flash memory to build fast, power-efficient clusters for data-intensive applications

Performance Analysis of NAND Flash Based Cache for Network Storage System

Vojisto: a linux distribution for flash party networks (2006).

Nswap2L: Transparently Managing Heterogeneous Cluster Storage Resources for Fast Swapping