NDLI: I/O Feature-based File Prefetching for Multi-Applications

Content Provider	IEEE Xplore Digital Library
Author	Haiyan Hu Yi Liu Depei Qian
Copyright Year	2010
Abstract	Applications such as multimedia, date mining- and scientific computing may exhibit sophisticated data access patterns that are different from one application to another. I/O prefetching is considered to be effective in improving I/O performance. However, the efficiency depends on identification of patterns for future I/O accesses, which is difficult to achieve in multi-application environment. This paper presents the design, implementation, and evaluation of an I/O feature-based prefetching strategy (FFP) for multiple application systems. The key idea of FFP is to extract I/O features from the collected file access information to guide prefetching. We first analyzed the I/O access patterns and designed a simple and effective feature notation to represent patterns. Then we developed a toolkit to generate and update I/O features automatically. Finally, we designed and implemented an I/O feature-based file prefetching thread library for the multi-application environment. Experimental results show that the proposed prefetching mechanism (FFP) improves I/O performance significantly for applications with complex I/O data access patterns.
Starting Page	213
Ending Page	217
File Size	244172
Page Count	5
File Format	PDF
ISBN	9781424493340
DOI	10.1109/GCC.2010.51
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-11-01
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	File systems Prefetching I/O access patterns I/O prefetching I/O feature Benchmark testing Feature extraction I/O performance Libraries Synchronization
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Boosting Application-Specific Parallel I/O Optimization Using IOSIG

I/O characterization on a parallel file system

Exploring Parallel I/O Concurrency with Speculative Prefetching

Dynamic I/O Reconfiguration for a NFS-Based Parallel File System

AGIOS: Application-Guided I/O Scheduling for Parallel File Systems

Collective prefetching for parallel I/O systems

Interval Based I/O: A New Approach to Providing High Performance Parallel I/O

Server-side I/O coordination for parallel file systems

Iteration Based Collective I/O Strategy for Parallel I/O Systems

I/O Feature-based File Prefetching for Multi-Applications

Similar Documents

Boosting Application-Specific Parallel I/O Optimization Using IOSIG

I/O characterization on a parallel file system

Exploring Parallel I/O Concurrency with Speculative Prefetching

Dynamic I/O Reconfiguration for a NFS-Based Parallel File System

AGIOS: Application-Guided I/O Scheduling for Parallel File Systems

Collective prefetching for parallel I/O systems

Interval Based I/O: A New Approach to Providing High Performance Parallel I/O

Server-side I/O coordination for parallel file systems

Iteration Based Collective I/O Strategy for Parallel I/O Systems

I/O Feature-based File Prefetching for Multi-Applications