NDLI: Mining Frequent Flows Based on Adaptive Threshold with a Sliding Window over Online Packet Stream

Content Provider	IEEE Xplore Digital Library
Author	Zhen Zhang Binqiang Wang Shuqiao Chen Ke Zhu
Copyright Year	2009
Abstract	Traffic measurement is an important component of network applications including usage-based charging, anomaly detection and traffic engineering. With high-speed links¿the main problem with traffic measurement is its lack of scalability. Aiming at circumvent this deficiency, we develop a novel and scalable sketch to mine frequent flows over online packet stream. Dividing the sliding window into buckets, the sketch can not only be easily-implemented, but also remove obsolete data to identify recent usage trends. Besides, an unbiased estimator is introduced based on a pruning function to preserve large flows. In particular, we illustrate a mechanism of configuring adaptive thresholds which are bound to the actual data without artificial behavior. The adaptive threshold can be regulated to target the mean number of the reserved flows in order to protect memory resources. Experiments are also conducted based on real network traces. Results demonstrate that the proposed method can achieve adaptability and controllability of resource consumption without sacrificing accuracy.
Starting Page	210
Ending Page	214
File Size	309177
Page Count	5
File Format	PDF
ISBN	9780769535227
DOI	10.1109/ICCSN.2009.43
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-02-27
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Software maintenance Switching systems frequent flows traffic measurement Telecommunication traffic sliding window Statistics adaptive threshold Communication system software Sampling methods Controllability Systems engineering and theory Communication system traffic control Protection
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in