NDLI: Multicore-Enabled Smart Storage for Clusters

Content Provider	IEEE Xplore Digital Library
Author	Zhiyang Ding Xunfei Jiang Shu Yin Xiao Qin Kai-Hsiung Chang Xiaojun Ruan Alghamdi, M.I. Meikang Qiu
Copyright Year	2012
Abstract	We present a multicore-enabled smart storage for clusters in general and MapReduce clusters in particular. The goal of this research is to improve performance of data-intensive parallel applications on clusters by offloading data processing to multicore processors in storage nodes. Compared with traditional storage devices, next-generation disks will have computing capability to reduce computational load of host processors or CPUs. With the advance of processor and memory technologies, smart storage systems are promising devices to perform complex on-disk operations. The proposed smart storage system can avoid moving a huge amount of data back and forth between storage nodes and computing nodes in a cluster. To enhance the performance of data-intensive applications, we have designed a smart storage system called Multicore-enabled Smart Storage (McSD), in which a multicore processor is integrated in storage nodes. We have implemented a programming framework for data-intensive applications running on a computing system coupled with McSD. The programming framework aims at balancing load between computing nodes and multicore-enabled smart storage nodes. To fully utilize multicore processors in smart storage nodes, we have implemented the MapReduce model for McSDs to handle parallel computing on a cluster. A prototype of McSD has been implemented in a cluster connected by Gigabit Ethernet. Experimental results show that McSD can significantly reduce the execution times of three real-world applications - word count, string matching, and matrix multiplication. We demonstrate that the integration of multicore-enabled smart storage with MapReduce clusters is a promising approach to improving overall performance of data-intensive applications on clusters.
Starting Page	108
Ending Page	116
File Size	395935
Page Count	9
File Format	PDF
ISBN	9781467324229
e-ISBN	9780769548074
DOI	10.1109/CLUSTER.2012.70
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-09-24
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Multicore processing Program processors Prototypes Programming Disk drives Computers Performance evaluation
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Performance evaluation of MPI and hybrid MPI+OpenMP programming paradigms on multi-core processors cluster

Managing performance-reliability tradeoffs in multicore processors

Scalable RNA Sequencing on Clusters of Multicore Processors

∗al-baha university, kingdom of saudi arabia.

Multicore programming techniques for high-performance ATE

Parallelism detection for multicore processors

Building a Personal High Performance Computer with Heterogeneous Processors

Work in progress — Course development of programming for general-purpose multicore processors

Introducing A-Cell for Scalable and Portable SIMD Programming

Multicore-Enabled Smart Storage for Clusters

Similar Documents

Performance evaluation of MPI and hybrid MPI+OpenMP programming paradigms on multi-core processors cluster

Managing performance-reliability tradeoffs in multicore processors

Scalable RNA Sequencing on Clusters of Multicore Processors

∗al-baha university, kingdom of saudi arabia.

Multicore programming techniques for high-performance ATE

Parallelism detection for multicore processors

Building a Personal High Performance Computer with Heterogeneous Processors

Work in progress — Course development of programming for general-purpose multicore processors

Introducing A-Cell for Scalable and Portable SIMD Programming

Multicore-Enabled Smart Storage for Clusters