NDLI: Xen-Based HPC: A Parallel I/O Perspective

Content Provider	IEEE Xplore Digital Library
Author	Weikuan Yu Vetter, J.S.
Copyright Year	2008
Description	Author affiliation: Comput. Sci. & Math., Oak Ridge Nat. Lab., Oak Ridge, TN (Weikuan Yu; Vetter, J.S.)
Abstract	Virtualization using Xen-based virtual machine environment has yet to permeate the field of high performance computing (HPC). One major requirement for HPC is the availability of scalable and high performance I/O. Conventional wisdom suggests that virtualization of system services must lead to degraded performance. In this presentation, we take on a parallel I/O perspective to study the viability of Xen-based HPC for data-intensive programs. We have analyzed the overheads and migration costs for parallel I/O programs in a Xen-based virtual machine cluster. Our analysis covers PVFS-based parallel I/O over two different networking protocols: TCP-based Gigabit Ethernet and VMM-bypass InfiniBand. Our experimental results suggest that network processing in Xen-based virtualization can significantly impact the performance of Parallel I/O. By carefully tuning the networking layers, we have demonstrated the following for Xen-based HPC I/O: (I) TCP offloading can help achieve low overhead parallel I/O; (2) parallel reads and writes require different network tuning to achieve good I/O bandwidth; and (3) Xen-based HPC environment can support high performance parallel I/O with both negligible overhead and little migration cost.
Starting Page	154
Ending Page	161
File Size	429727
Page Count	8
File Format	PDF
ISBN	9780769531564
DOI	10.1109/CCGRID.2008.119
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-05-19
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	File systems Application software Costs Virtual machining Degradation Application virtualization High performance computing Ethernet networks Concurrent computing Grid computing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Xen-based HPC: A parallel I/O perspective

A Comparison of Virtualization Technologies for HPC

Using Object Based Files for High Performance Parallel I/O

A Performance Study of Virtual Machine Migration vs. Thread Migration for Grid Systems

SunTM MPI I/O: Efficient I/O for Parallel Applications

Deadline Aware Virtual Machine Scheduler for Grid and Cloud Computing

Virtual Cluster Development Environment for grids

Parallel I/O performance of fine grained data distributions

Enabling and Optimizing Pilot Jobs using Xen based Virtual Machines for the HPC Grid Applications

Xen-Based HPC: A Parallel I/O Perspective

Similar Documents

Xen-based HPC: A parallel I/O perspective

A Comparison of Virtualization Technologies for HPC

Using Object Based Files for High Performance Parallel I/O

A Performance Study of Virtual Machine Migration vs. Thread Migration for Grid Systems

SunTM MPI I/O: Efficient I/O for Parallel Applications

Deadline Aware Virtual Machine Scheduler for Grid and Cloud Computing

Virtual Cluster Development Environment for grids

Parallel I/O performance of fine grained data distributions

Enabling and Optimizing Pilot Jobs using Xen based Virtual Machines for the HPC Grid Applications

Xen-Based HPC: A Parallel I/O Perspective