NDLI: Introspective end-system modeling to optimize the transfer time of rate based protocols

Please wait, while we are loading the content...

Exascale opportunities and challenges

Juggle: proactive load balancing on multicore computers

Just in time: adding value to the IO pipelines of high performance applications with JITStaging

Algorithm-based recovery for iterative methods without checkpointing

Energy-efficient E-puting everywhere

Towards a profound analysis of bags-of-tasks in parallel systems and their performance impact

Live gang migration of virtual machines

Experiences with self-organizing, decentralized grids using the grid appliance

Supporting GPU sharing in cloud environments with a transparent runtime consolidation framework

Dynamic adaptive scheduling for virtual machines

Adapting MapReduce for HPC environments

Cache injection for parallel applications

A cost-intelligent application-specific data layout scheme for parallel file systems

Vrisha: using scaling properties of parallel programs for bug detection and localization

Incremental placement of interactive perception applications

Going back and forth: efficient multideployment and multisnapshotting on clouds

Experience of parallelizing cryo-EM 3D reconstruction on a CPU-GPU heterogeneous system

Tradeoffs Between Profit and Customer Satisfaction for Service Provisioning in the Cloud

Enhancement of Xen's scheduler for MapReduce workloads

HyFlow: a high performance distributed software transactional memory framework

Six degrees of scientific data: reading patterns for extreme scale science IO

InContext: simple parallelism for distributed applications

VMFlock: virtual machine co-migration for the cloud

Experiences using smaash to manage data-intensive simulations

ClusterSs: a task-based programming model for clusters

Introspective end-system modeling to optimize the transfer time of rate based protocols

Performance and energy modeling for live migration of virtual machines

Design space exploration for aggressive core replication schemes in CMPs

Capping the electricity cost of cloud-scale data centers with impacts on power markets

Interactivity on the grid: limitations and opportunities

Exclusive squashing for thread-level speculation

Wrangler: virtual cluster provisioning for the cloud

A distributed look-up architecture for text mining applications using mapreduce

Software-directed data access scheduling for reducing disk energy consumption

Introspective end-system modeling to optimize the transfer time of rate based protocols

Content Provider	ACM Digital Library
Author	Ghosal, Dipak Ahuja, Vishal Farrens, Matthew Banerjee, Amitabha Serazzi, Giuseppe
Abstract	The transmission capacity of today's high-speed networks is often greater than the capacity of an end-system (such as a server or a remote client) to consume the incoming data. The mismatch between the network and the end-system, which can be exacerbated by high end-system workloads, will result in incoming packets being dropped at different points in the packet receiving process. In particular, a packet may be dropped in the NIC, in the kernel ring buffer, and (for rate based protocols) in the socket buffer. To provide reliable data transfers, these losses require retransmissions, and if the loss rate is high enough result in longer download times. In this paper, we focus on UDP-like rate based transport protocols, and address the question of how best to estimate the rate at which the end-system can consume data which minimizes the overall transfer time of a file. We propose a novel queueing network model of the end-system, which consists of a model of the NIC, a model of the kernel ring buffer and the protocol processing, and a model of the socket buffer from which the application process reads the data. We show that using simple and approximate queueing models, we can accurately predict the effective end-system bottleneck rate that minimizes the file transfer time. We compare our protocol with PA-UDP, an end-system aware rate based transport protocol, and show that our approach performs better, particularly when the packet losses in the NIC and/or the kernel ring buffer are high. We also compare our approach to TCP. Unlike in our rate based scheme, TCP invokes the congestion control algorithm when there are losses in the NIC and the ring buffer. With higher end-to-end delay, this results in significant performance degradation compared to our reliable end-system aware rate based protocol.
Starting Page	61
Ending Page	72
Page Count	12
File Format	PDF
ISBN	9781450305525
DOI	10.1145/1996130.1996140
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2011-06-08
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Queueing model Rate based transport protocol Experimental analysis End-system network i/o bottleneck rate
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in