NDLI: NOHAA: A NOvel Framework for HPC Analytics over Windows Azure

Content Provider	IEEE Xplore Digital Library
Author	Qiangju Xiao Jun Wang Yan Ma Lizhe Wang
Copyright Year	2012
Abstract	HPC analytics has become increasingly vital to analyze the large volumes of data produced by sophisticated computing instruments. Meanwhile, with the successful development of cloud computing, more and more scientists are devoted to deploy HPC analytics in the ever-popular clouds, which poses new challenges mainly caused by different storage architectures, resource management mechanisms and programming APIs. Firstly, there exists a ``data semantics" gap between the way data are stored by Cloud platform and the way data will be accessed by the HPC Analytics. Secondly, data are mostly distributed across data nodes for in-house data-intensive clusters to achieve co-located computation and storage, however, it is challenging for the public clouds to mimic because their data are stored centrally. In this paper, we develop a new HPC analytics framework called NOHAA, to provide 1) a semantics-aware intelligent data upload interface and 2) a locality-aware hierarchical storage system in support of co-located computation and storage on Windows Azure. Our extensive real world experiments show that NOHAA significantly reduces the average data access time by up to 85% and accelerates the HPC analytics execution time by a factor of 2 to 7.
Starting Page	448
Ending Page	455
File Size	791636
Page Count	8
File Format	PDF
ISBN	9781467345651
ISSN	15219097
e-ISBN	9780769549033
DOI	10.1109/ICPADS.2012.68
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-12-17
Publisher Place	Singapore
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data transfer Distributed databases Semantics Cloud computing Computational modeling Data models Data preprocessing Azure HPC analytics Hadoop Data-intensive MapReduce HDFS Co-located Computation and Storage
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Co-located Compute and Binary File Storage in Data-Intensive Computing

Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics

Research on Hadoop Cloud Computing Model and its Applications

Supporting HPC Analytics Applications with Access Patterns Using Data Restructuring and Data-Centric Scheduling Techniques in MapReduce

On the duality of data-intensive file system design: Reconciling HDFS and PVFS

Mass data storage system for campus network based on cloud computing

Automating the Hadoop configuration for easy setup in resilient cloud systems

K Means of Cloud Computing: MapReduce, DVM, and Windows Azure

Implementation of MapReduce-based image conversion module in cloud computing environment

NOHAA: A NOvel Framework for HPC Analytics over Windows Azure

Similar Documents

Co-located Compute and Binary File Storage in Data-Intensive Computing

Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics

Research on Hadoop Cloud Computing Model and its Applications

Supporting HPC Analytics Applications with Access Patterns Using Data Restructuring and Data-Centric Scheduling Techniques in MapReduce

On the duality of data-intensive file system design: Reconciling HDFS and PVFS

Mass data storage system for campus network based on cloud computing

Automating the Hadoop configuration for easy setup in resilient cloud systems

K Means of Cloud Computing: MapReduce, DVM, and Windows Azure

Implementation of MapReduce-based image conversion module in cloud computing environment

NOHAA: A NOvel Framework for HPC Analytics over Windows Azure