NDLI: A Large-Scale Study of Flash Memory Failures in the Field

Please wait, while we are loading the content...

Bounds Implied by Drift with Applications

Online Auctions in IaaS Clouds: Welfare and Profit Maximization with Server Costs

Whittle Index Approach to Size-aware Scheduling with Time-varying Channels

Transient and Steady-state Regime of a Family of List-based Cache Replacement Algorithms

Online Convex Optimization Using Predictions

Bandits with Budgets: Regret Lower Bounds and Optimal Algorithms

DiskAccel: Accelerating Disk-Based Experiments by Representative Sampling

Power of d Choices for Large-Scale Bin Packing: A Loss Model

Impact of Fairness and Heterogeneity on Delays in Large-scale Content Delivery Networks

Investigating the Potential of the Inter-IXP Multigraph for the Provisioning of Guaranteed End-to-End Services

Distributed Proportional Fair Load Balancing in Heterogenous Systems

60 GHz Indoor Networking through Flexible Beams: A Link-Level Profiling

Memory Row Reuse Distance and its Role in Optimizing Application Performance

Reliable Multiple-choice Iterative Algorithm for Crowdsourcing Systems

Social Network Monetization via Sponsored Viral Marketing

Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation

Computable Bounds in Fork-Join Queueing Systems

Fisher Information-based Experiment Design for Network Tomography

MaxWeight Scheduling: Asymptotic Behavior of Unscaled Queue-Differentials in Heavy Traffic

Multi-Resource Fairness: Objectives, Algorithms and Performance

Sponsored Data Plan: A Two-Class Service Model in Wireless Data Networks

Smartphone Energy Drain in the Wild: Analysis and Implications

An Online Learning Approach to Improving the Quality of Crowd-Sourcing

Spy vs. Spy: Rumor Source Obfuscation

Reducing Latency via Redundant Requests: Exact Analysis

When Virtual Meets Physical at the Edge: A Field Study on Datacenters' Virtual Traffic

Kraken: Towards Elastic Performance Guarantees in Multi-tenant Data Centers

Exchange of Services in Networks: Competition, Cooperation, and Fairness

Queue-Proportional Rate Allocation with Per-Link Information in Multihop Networks

Newer Is Sometimes Better: An Evaluation of NFSv4.1

Learning to Rank: Regret Lower Bounds and Efficient Algorithms

Greedy-Bayes for Targeted News Dissemination

Joint Cyber and Physical Attacks on Power Grids: Graph Theoretical Approaches for Information Recovery

Hyper-Compact Virtual Estimators for Big Network Data Based on Register Sharing

Latency in Software Defined Networks: Measurements and Mitigation Techniques

Resource Allocation and Rate Gains in Practical Full-Duplex Systems

A Large-Scale Study of Flash Memory Failures in the Field

Tree-structured Bloom Filters for Joint Optimization of False Positive Probability and Transmission Bandwidth

Scheduling Storms and Streams in the Cloud

Localized Epidemic Detection in Networks with Overwhelming Noise

Pricing Bilateral Electricity Trade between Smart Grids and Hybrid Green Datacenters

Detecting Sponsored Recommendations

Understanding Parallel Performance Under Interferences in Multi-tenant Clouds

Clustering and Inference From Pairwise Comparisons

Deterministic Near-Optimal P2P Streaming

Flexible Transformations For Learning Big Data

Energy Coupon: A Mean Field Game Perspective on Demand Response in Smart Grids

DeltaTree: A Locality-aware Concurrent Search Tree

Detecting and Localizing End-to-End Performance Degradation for Cellular Data Services

Speeding up Glauber Dynamics for Random Generation of Independent Sets

Online Electricity Cost Saving Algorithms for Co-Location Data Centers

Web Transparency for Complex Targeting: Algorithms, Limits, and Tradeoffs

Lagrangian-based Online Stochastic Bin Packing

Towards Cooling Internet-Scale Distributed Networks on the Cheap

A Simple Model to Quantify the Impact of Memory Latency and Bandwidth on Performance

Performance Characterization of Hyperscale Applicationson on NVMe SSDs

A Large-Scale Study of Flash Memory Failures in the Field

Content Provider	ACM Digital Library
Author	Meza, Justin Wu, Qiang Kumar, Sanjev Mutlu, Onur
Abstract	Servers use flash memory based solid state drives (SSDs) as a high-performance alternative to hard disk drives to store persistent data. Unfortunately, recent increases in flash density have also brought about decreases in chip-level reliability. In a data center environment, flash-based SSD failures can lead to downtime and, in the worst case, data loss. As a result, it is important to understand flash memory reliability characteristics over flash lifetime in a realistic production data center environment running modern applications and system software. This paper presents the first large-scale study of flash-based SSD reliability in the field. We analyze data collected across a majority of flash-based solid state drives at Facebook data centers over nearly four years and many millions of operational hours in order to understand failure properties and trends of flash-based SSDs. Our study considers a variety of SSD characteristics, including: the amount of data written to and read from flash chips; how data is mapped within the SSD address space; the amount of data copied, erased, and discarded by the flash controller; and flash board temperature and bus power. Based on our field analysis of how flash memory errors manifest when running modern workloads on modern SSDs, this paper is the first to make several major observations: (1) SSD failure rates do not increase monotonically with flash chip wear; instead they go through several distinct periods corresponding to how failures emerge and are subsequently detected, (2) the effects of read disturbance errors are not prevalent in the field, (3) sparse logical data layout across an SSD's physical address space (e.g., non-contiguous data), as measured by the amount of metadata required to track logical address translations stored in an SSD-internal DRAM buffer, can greatly affect SSD failure rate, (4) higher temperatures lead to higher failure rates, but techniques that throttle SSD operation appear to greatly reduce the negative reliability impact of higher temperatures, and (5) data written by the operating system to flash-based SSDs does not always accurately indicate the amount of wear induced on flash cells due to optimizations in the SSD controller and buffering employed in the system software. We hope that the findings of this first large-scale flash memory reliability study can inspire others to develop other publicly-available analyses and novel flash reliability solutions.
Starting Page	177
Ending Page	190
Page Count	14
File Format	PDF
ISBN	9781450334860
DOI	10.1145/2745844.2745848
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-06-15
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Warehouse-scale data centers Flash memory Reliability
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Large-Scale Study of Flash Memory Failures in the Field

Revisiting Memory Errors in Large-Scale Production Data Centers: Analysis and Modeling of New Trends from the Field

Failures in Large-Scale Systems: Insights from the Field

DRAM errors in the wild: a large-scale field study

Reliability Design for Large Scale Data Warehouses

Roadmap of the Flash Memory

Reliability design for large scale data warehouses.

Scaling trend of the Flash memory for file storage

A study of DRAM failures in the field

A Large-Scale Study of Flash Memory Failures in the Field

Similar Documents

A Large-Scale Study of Flash Memory Failures in the Field

Revisiting Memory Errors in Large-Scale Production Data Centers: Analysis and Modeling of New Trends from the Field

Failures in Large-Scale Systems: Insights from the Field

DRAM errors in the wild: a large-scale field study

Reliability Design for Large Scale Data Warehouses

Roadmap of the Flash Memory

Reliability design for large scale data warehouses.

Scaling trend of the Flash memory for file storage

A study of DRAM failures in the field

A Large-Scale Study of Flash Memory Failures in the Field