NDLI: Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection

Content Provider	IEEE Xplore Digital Library
Author	Curtis, A.R. Wonho Kim Yalagandula, P.
Copyright Year	2011
Description	Author affiliation: Princeton University, NJ, USA (Wonho Kim) \|\| University of Waterloo, Ontario, Canada (Curtis, A.R.) \|\| HP Labs, Palo Alto, CA, USA (Yalagandula, P.)
Abstract	Datacenters need high-bandwidth interconnection fabrics. Several researchers have proposed highly-redundant topologies with multiple paths between pairs of end hosts for datacenter networks. However, traffic management is necessary to effectively utilize the bisection bandwidth provided by these topologies. This requires timely detection of elephant flows—flows that carry large amount of data—and managing those flows. Previously proposed approaches incur high monitoring overheads, consume significant switch resources, and/or have long detection times. We propose, instead, to detect elephant flows at the end hosts. We do this by observing the end hosts's socket buffers, which provide better, more efficient visibility of flow behavior. We present Mahout, a low-overhead yet effective traffic management system that follows OpenFlow-like central controller approach for network management but augments the design with our novel end host mechanism. Once an elephant flow is detected, an end host signals the network controller using in-band signaling with low overheads. Through analytical evaluation and experiments, we demonstrate the benefits of Mahout over previous solutions.
Starting Page	1629
Ending Page	1637
File Size	1166720
Page Count	9
File Format	PDF
ISBN	9781424499199
ISSN	0743166X
e-ISBN	9781424499212
DOI	10.1109/INFCOM.2011.5934956
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2011-04-10
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Switches Heating
Content Type	Text
Resource Type	Article
Subject	Computer Science Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

MiceTrap: Scalable traffic engineering of datacenter mice flows using OpenFlow

Inferring traffic shaping and policy parameters using end host measurements

Analysis of Backward Congestion Notification (BCN) for Ethernet In Datacenter Applications

End-to-end congestion control for infiniband

An Autonomic Intrusion Detection System Based on Behavioral Network Engineering

Improving the Incast Performance of Datacenter TCP by Using Rate-Based Congestion Control

Elemantra: An End-to-End Automated Framework Empowered with AI and IoT for Tackling Human-Elephant Conflict in Elephant-Range Countries

Neural networks applied to traffic management in telephone networks

Scalable, low-overhead network delay estimation

Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection

Similar Documents

MiceTrap: Scalable traffic engineering of datacenter mice flows using OpenFlow

Inferring traffic shaping and policy parameters using end host measurements

Analysis of Backward Congestion Notification (BCN) for Ethernet In Datacenter Applications

End-to-end congestion control for infiniband

An Autonomic Intrusion Detection System Based on Behavioral Network Engineering

Improving the Incast Performance of Datacenter TCP by Using Rate-Based Congestion Control

Elemantra: An End-to-End Automated Framework Empowered with AI and IoT for Tackling Human-Elephant Conflict in Elephant-Range Countries

Neural networks applied to traffic management in telephone networks

Scalable, low-overhead network delay estimation

Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection