NDLI: On Streaming Consistency of Big Data Stream Processing in Heterogenous Clutsers

Content Provider	IEEE Xplore Digital Library
Author	Xhafa, F. Naranjo, V. Barolli, L. Takizawa, M.
Copyright Year	2015
Description	Author affiliation: Hosei Univ., Tokyo, Japan (Takizawa, M.) \|\| Fukuoka Inst. of Technol., Fukuoka, Japan (Barolli, L.) \|\| Univ. Politec. de Catalunya, Barcelona, Spain (Xhafa, F.; Naranjo, V.)
Abstract	There is currently a growing interest on Big Data Stream processing. With the increasing capabilities of Internet-based computing systems to generate, store and process Big Data Streams, various applications are benefiting from the information extracted in real time from data streams. Such families of applications comprise IoT-based monitoring systems, decision making systems, recommendation systems, security, etc. In all of them, the common ingredient is that of using real time data analytics for the purpose at hand. The foremost challenge of processing Big Data Streams is that of throughput performance, i.e., the computing system should be able to compute at high throughput to accommodate the high data stream rate generation in input. Additionally to this challenge, the processing should be such that the consistency of streaming is achieved. The consistency of streaming requires that the order of events in the original stream (in input) is preserved also in the output. In this paper we show that using a heterogeneous cluster for Big Data Stream processing could indeed incur into streaming inconsistency and one would indeed have to carefully tune the system so that streaming consistency is achieved. We exemplify the approach using the Yahoo!S4 for processing the Big Data Stream from FlightRadar24 global flight monitoring system.
Sponsorship	Tamkang University
Starting Page	476
Ending Page	482
File Size	808255
Page Count	7
File Format	PDF
e-ISBN	9781479999422
DOI	10.1109/NBiS.2015.122
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-09-02
Publisher Place	Taiwan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Parallel Data Processing Big Data Stream Airports Real-time Analytics Data mining Yahoo!S4 FlightRadar24 Consistency of Streaming Big data Real-time systems Data models Aircraft Generic Log Adapter Monitoring Global Flight Monitoring System
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Processing and Analytics of Big Data Streams with Yahoo!S4

A Software Chain Approach to Big Data Stream Processing and Analytics

Performance evaluation of yahoo! s4: a first look.

Performance Evaluation of Yahoo! S4: A First Look

Predictive analytics with aviation big data

Beyond Batch Processing: Towards Real-Time and Streaming Big Data

Real-time analytics processing with MapReduce

The Video Monitoring System Based on Big Data Processing

Big-DAMA: Big Data Analytics for Network Traffic Monitoring and Analysis

On Streaming Consistency of Big Data Stream Processing in Heterogenous Clutsers

Similar Documents

Processing and Analytics of Big Data Streams with Yahoo!S4

A Software Chain Approach to Big Data Stream Processing and Analytics

Performance evaluation of yahoo! s4: a first look.

Performance Evaluation of Yahoo! S4: A First Look

Predictive analytics with aviation big data

Beyond Batch Processing: Towards Real-Time and Streaming Big Data

Real-time analytics processing with MapReduce

The Video Monitoring System Based on Big Data Processing

Big-DAMA: Big Data Analytics for Network Traffic Monitoring and Analysis

On Streaming Consistency of Big Data Stream Processing in Heterogenous Clutsers