NDLI: High-Performance Design of Hadoop RPC with RDMA over InfiniBand

Content Provider	IEEE Xplore Digital Library
Author	Xiaoyi Lu Islam, N.S. Wasi-Ur-Rahman, M. Jose, J. Subramoni, H. Hao Wang Panda, D.K.
Copyright Year	2013
Abstract	Hadoop RPC is the basic communication mechanism in the Hadoop ecosystem. It is used with other Hadoop components like MapReduce, HDFS, and HBase in real world data-centers, e.g. Facebook and Yahoo!. However, the current Hadoop RPC design is built on Java sockets interface, which limits its potential performance. The High Performance Computing community has exploited high throughput and low latency networks such as InfiniBand for many years. In this paper, we first analyze the performance of current Hadoop RPC design by unearthing buffer management and communication bottlenecks, that are not apparent on the slower speed networks. Then we propose a novel design (RPCoIB) of Hadoop RPC with RDMA over InfiniBand networks. RPCoIB provides a JVM-bypassed buffer management scheme and utilizes message size locality to avoid multiple memory allocations and copies in data serialization and deserialization. Our performance evaluations reveal that the basic ping-pong latencies for varied data sizes are reduced by 42%-49% and 46%-50% compared with 10GigE and IPoIB QDR (32Gbps), respectively, while the RPCoIB design also improves the peak throughput by 82% and 64% compared with 10GigE and IPoIB. As compared to default Hadoop over IPoIB QDR, our RPCoIB design improves the performance of the Sort benchmark on 64 compute nodes by 15%, while it improves the performance of CloudBurst application by 10%. We also present thorough, integrated evaluations of our RPCoIB design with other research directions, which optimize HDFS and HBase using RDMA over InfiniBand. Compared with their best performance, we observe 10% improvement for HDFS-IB, and 24% improvement for HBase-IB. To the best of our knowledge, this is the first such design of the Hadoop RPC system over high performance networks such as InfiniBand.
Starting Page	641
Ending Page	650
File Size	1011797
Page Count	10
File Format	PDF
ISBN	9780769551173
ISSN	01903918
DOI	10.1109/ICPP.2013.78
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-10-01
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Java Resource management Servers Protocols Benchmark testing History Throughput Message Size Locality Hadoop RPC InfiniBand
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

High-Performance Design of HBase with RDMA over InfiniBand

High-Performance RDMA-based Design of Hadoop MapReduce over InfiniBand

Early Experiences with Write-Write Design of NFS over RDMA

High performance RDMA-based design of HDFS over InfiniBand

Performance evaluation of HDD and SSD on 10GigE, IPoIB & RDMA-IB with Hadoop Cluster Performance Benchmarking System

Accelerating Spark with RDMA for Big Data Processing: Early Experiences

Memcached Design on High Performance RDMA Capable Interconnects

High Performance RDMA-Based MPI Implementation over InfiniBand (2003)

A Performance Study to Guide RDMA Programming Decisions

High-Performance Design of Hadoop RPC with RDMA over InfiniBand

Similar Documents

High-Performance Design of HBase with RDMA over InfiniBand

High-Performance RDMA-based Design of Hadoop MapReduce over InfiniBand

Early Experiences with Write-Write Design of NFS over RDMA

High performance RDMA-based design of HDFS over InfiniBand

Performance evaluation of HDD and SSD on 10GigE, IPoIB & RDMA-IB with Hadoop Cluster Performance Benchmarking System

Accelerating Spark with RDMA for Big Data Processing: Early Experiences

Memcached Design on High Performance RDMA Capable Interconnects

High Performance RDMA-Based MPI Implementation over InfiniBand (2003)

A Performance Study to Guide RDMA Programming Decisions

High-Performance Design of Hadoop RPC with RDMA over InfiniBand