NDLI: High-performance network traffic analysis for continuous batch intrusion detection

Content Provider	Springer Nature Link
Author	Morla, Ricardo Gonçalves, Pedro Barbosa, Jorge G.
Copyright Year	2016
Abstract	Network traffic analysis is applied to detect intrusions and manage application traffic. Continuous batch network traffic analysis is a computationally demanding task. Because of traffic intensity variations due to the natural peaks and crests of network traffic intensity, a network analysis cluster may have to be severely over-dimensioned to support 24/7 continuous packet block capture and processing. In this paper, we characterize the computational requirements of the network traffic packets for several conditions, which constitute a useful tool for generating a network workload in simulated scenarios. Our target MapReduce jobs are map-intensive, including string matching-based virus and malware detection. We present an architecture for a Hadoop-based network analysis solution including a scheduler, report on using this approach in a small cluster, and show scheduling performance results obtained through simulation. The scheduler considers a cloud-based traffic analysis solution that bursts traffic to the cloud to overcome local resource limitations. The results show that we are able to reduce the amount of the traffic to burst out by up to 50 % and still accomplish a continuous batch traffic analysis with single-job comparable run times.
Starting Page	4107
Ending Page	4128
Page Count	22
File Format	PDF
ISSN	09208542
Journal	The Journal of Supercomputing
Volume Number	72
Issue Number	11
e-ISSN	15730484
Language	English
Publisher	Springer US
Publisher Date	2016-05-14
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Packet network traffic analysis Hadoop Cloud bursting On-line scheduling Programming Languages, Compilers, Interpreters Processor Architectures Computer Science
Content Type	Text
Resource Type	Article
Subject	Theoretical Computer Science Information Systems Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modified parallel random forest for intrusion detection systems

CloudRPS: a cloud analysis based enhanced ransomware prevention system

SLA-aware energy-efficient scheduling scheme for Hadoop YARN

An optimized MapReduce workflow scheduling algorithm for heterogeneous computing

User-oriented cloud resource scheduling with feedback integration

Real time intrusion detection system for ultra-high-speed big data environments

Scheduling GEN_BLOCK Array Redistribution

A market-oriented hierarchical scheduling strategy in cloud workflow systems

Accelerating network applications by distributed interfaces on heterogeneous multiprocessor architectures

High-performance network traffic analysis for continuous batch intrusion detection

Similar Documents

Modified parallel random forest for intrusion detection systems

CloudRPS: a cloud analysis based enhanced ransomware prevention system

SLA-aware energy-efficient scheduling scheme for Hadoop YARN

An optimized MapReduce workflow scheduling algorithm for heterogeneous computing

User-oriented cloud resource scheduling with feedback integration

Real time intrusion detection system for ultra-high-speed big data environments

Scheduling GEN_BLOCK Array Redistribution

A market-oriented hierarchical scheduling strategy in cloud workflow systems

Accelerating network applications by distributed interfaces on heterogeneous multiprocessor architectures

High-performance network traffic analysis for continuous batch intrusion detection