NDLI: Fast large file distribution in data grid

Content Provider	IEEE Xplore Digital Library
Author	Tao Li Binghang Yan Zhongzhi Luan
Copyright Year	2010
Description	Author affiliation: School of Computer Science and Engineering, Beihang University, Beijing, China (Tao Li; Binghang Yan; Zhongzhi Luan)
Abstract	With more and more data created by grid computing, large file distribution is a key issue in data grid. Current file distribution in data grid is usually a style site-to-site and this mechanism is not efficient and wastes bandwidth. In this paper, we propose a novel algorithm to distribute large file efficiently in data grid. We split the file into n subfiles and transfer each subfile to a different node. And then the node which receives a subfile transfers the subfile to other nodes. The size of each subfile is different in different network environment. We must compute the size of the subfile using our simple but efficient algorithm before file splitting. To verify the performance of our algorithm, we build a simulation system and compare with Multiunicast and FastReplica [1]. The result shows our algorithm significantly reduce the file distribution time.
Starting Page	577
Ending Page	582
File Size	954592
Page Count	6
File Format	PDF
ISBN	9781424468348
e-ISBN	9781424468379
DOI	10.1109/ICISS.2010.5655344
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-10-22
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	File Distribution File Split Reliability Component
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Fast Parallel File Replication in Data Grid (2004)

The IGOR File System for Efficient Data Distribution in the GRID

Models for replica synchronisation and consistency in a data grid (0).

Specialized File Transfer Service for Large Oil and Gas Datasets

Efficient distributed file i/o for visualization in grid environments (2000).

Models for Replica Synchronisation and Consistency in a Data Grid

Cfs: a new dynamic replication strategy for data grids (2010).

A File Transfer Component for Grids (2003)

File Clustering Based Replication Algorithm in a Grid Environment

Fast large file distribution in data grid

Similar Documents

Fast Parallel File Replication in Data Grid (2004)

The IGOR File System for Efficient Data Distribution in the GRID

Models for replica synchronisation and consistency in a data grid (0).

Specialized File Transfer Service for Large Oil and Gas Datasets

Efficient distributed file i/o for visualization in grid environments (2000).

Models for Replica Synchronisation and Consistency in a Data Grid

Cfs: a new dynamic replication strategy for data grids (2010).

A File Transfer Component for Grids (2003)

File Clustering Based Replication Algorithm in a Grid Environment

Fast large file distribution in data grid