NDLI: Reducing Disk I/O Performance Sensitivity for Large Numbers of Sequential Streams

Content Provider	IEEE Xplore Digital Library
Author	Panagiotakis, G. Flouris, M.D. Bilas, A.
Copyright Year	2009
Abstract	Retrieving sequential rich media content from modern commodity disks is a challenging task. As disk capacity increases, there is a need to increase the number of streams that are allocated to each disk. However, when multiple streams are accessing a single disk, throughput is dramatically reduced because of disk head seek overhead, resulting in requirements for more disks. Thus, there is a tradeoff between how many streams should be allowed to access a disk and the total throughput that can be achieved. In this work we examine this tradeoff and provide an understanding of issues along with a practical solution. We use Disksim, a detailed architectural simulator, to examine several aspects of a modern I/O subsystem and we show the effect of various disk parameters on system performance under multiple sequential streams. Then, we propose a solution that dynamically adjusts I/O request streams, based on host and I/O subsystem parameters. We implement our approach in a real system and perform experiments with a small and a large disk configuration. Our approach improves disk throughput up to a factor of 4 with a workload of 100 sequential streams, without requiring large amounts of memory on the storage node. Moreover, it is able to adjust (statically) to different storage node configurations, essentially making the I/O subsystem insensitive to the number of I/O streams used.
Starting Page	22
Ending Page	31
File Size	214396
Page Count	10
File Format	PDF
ISBN	9780769536590
ISSN	10636927
DOI	10.1109/ICDCS.2009.31
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-06-22
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Throughput Streaming media Computer science Content based retrieval Application software Distributed computing System performance Information retrieval Degradation Operating systems Disksim I/O streaming I/O Performance Block-level Storage Disk performance
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Reducing disk i/o performance sensitivity for large numbers of sequential streams, Distributed Computing Systems

Virtualizing Disk Performance

Improving the I/O performance of intermediate multimedia storage nodes

On Store Placement for Response Time Minimization in Parallel Disks

Towards Transparent Throughput Elasticity for IaaS Cloud Storage: Exploring the Benefits of Adaptive Block-Level Caching

A Distributed Multi-Storage Resource Architecture and I/O Performance Prediction for Scientific Computing

Toward Improving Scheduling Strategies in Pull-Based Live P2P Streaming Systems

Structured I/O streams in Clive: a toolbox approach for wide area network computing

nCUBE parallel I/O software

Reducing Disk I/O Performance Sensitivity for Large Numbers of Sequential Streams

Similar Documents

Reducing disk i/o performance sensitivity for large numbers of sequential streams, Distributed Computing Systems

Virtualizing Disk Performance

Improving the I/O performance of intermediate multimedia storage nodes

On Store Placement for Response Time Minimization in Parallel Disks

Towards Transparent Throughput Elasticity for IaaS Cloud Storage: Exploring the Benefits of Adaptive Block-Level Caching

A Distributed Multi-Storage Resource Architecture and I/O Performance Prediction for Scientific Computing

Toward Improving Scheduling Strategies in Pull-Based Live P2P Streaming Systems

Structured I/O streams in Clive: a toolbox approach for wide area network computing

nCUBE parallel I/O software

Reducing Disk I/O Performance Sensitivity for Large Numbers of Sequential Streams