NDLI: Rethinking FTP: Aggressive block reordering for large file transfers

Please wait, while we are loading the content...

Rethinking FTP: Aggressive block reordering for large file transfers

Content Provider	ACM Digital Library
Author	Anastasiadis, Stergios V. Chase, Jeffrey S. Wickremesinghe, Rajiv G.
Copyright Year	2009
Abstract	Whole-file transfer is a basic primitive for Internet content dissemination. Content servers are increasingly limited by disk arm movement, given the rapid growth in disk density, disk transfer rates, server network bandwidth, and content size. Individual file transfers are sequential, but the block access sequence on a content server is effectively random when many slow clients access large files concurrently. Although larger blocks can help improve disk throughput, buffering requirements increase linearly with block size. This article explores a novel block reordering technique that can reduce server disk traffic significantly when large content files are shared. The idea is to transfer blocks to each client in any order that is convenient for the server. The server sends blocks to each client opportunistically in order to maximize the advantage from the disk reads it issues to serve other clients accessing the same file. We first illustrate the motivation and potential impact of aggressive block reordering using simple analytical models. Then we describe a file transfer system using a simple block reordering algorithm, called Circus. Experimental results with the Circus prototype show that it can improve server throughput by a factor of two or more in workloads with strong file access locality.
Starting Page	1
Ending Page	27
Page Count	27
File Format	PDF
ISSN	15533077
e-ISSN	15533093
DOI	10.1145/1480439.1480442
Volume Number	4
Issue Number	4
Journal	ACM Transactions on Storage (TOS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2009-02-09
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Disk access File transfer protocols Scheduling
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Circus: Opportunistic Block Reordering for Scalable Content Servers (2004)

Circus: Opportunistic Block Reordering for Scalable Content Servers (2004)

File access patterns in public FTP archives and an index for locality of reference

FTP access as a user-defined file system

UPDATE: User-Profile-Driven Adaptive TransfEr for Mobile Devices

In-advance path reservation for file transfers in e-science applications

FTP-file transfer program

An analytic model of a file server for bulk file transfers

Systems support for preemptive disk scheduling

Rethinking FTP: Aggressive block reordering for large file transfers

Similar Documents

Circus: Opportunistic Block Reordering for Scalable Content Servers (2004)

Circus: Opportunistic Block Reordering for Scalable Content Servers (2004)

File access patterns in public FTP archives and an index for locality of reference

FTP access as a user-defined file system

UPDATE: User-Profile-Driven Adaptive TransfEr for Mobile Devices

In-advance path reservation for file transfers in e-science applications

FTP-file transfer program

An analytic model of a file server for bulk file transfers

Systems support for preemptive disk scheduling

Rethinking FTP: Aggressive block reordering for large file transfers