NDLI: Minimizing Communication Overhead in Window-Based Parallel Complex Event Processing

Please wait, while we are loading the content...

Challenges to Achieving High Availability at Scale

Complex Event Recognition Languages: Tutorial

Considering Human Factors in the Development of Situation-Aware CEP Applications: New Direction Paper

Hardware Accelerated Application Integration Processing: Industry Paper

The DEBS 2017 Grand Challenge

Building Connected Car Applications on Top of the World-Wide Streams Platform: Demo

Visualising complex event hierarchies using relevant domain ontologies: Doctoral Symposium

Blockchain: Distributed Event-based Processing in a Data-Centric World: Extended Abstract

Sliding-Window Aggregation Algorithms: Tutorial

Modeling Aggregate Input Load of Interoperable Smart City Services

Kafka versus RabbitMQ: A comparative study of two industry reference publish/subscribe implementations: Industry Paper

FlinkMan: Anomaly Detection in Manufacturing Equipment with Apache Flink: Grand Challenge

Real-Time Football Analysis with StreamTeam: Demo

Consistent Stream Processing: Doctoral Symposium

The Customer Experience Case: The Needle in the Haystack

Data Streaming and its Application to Stream Processing: Tutorial

The Event Crowd: A Novel Approach for Crowd-Enabled Event Processing

An Autonomous and Dynamic Coordination and Discovery Service for Wide-Area Peer-to-peer Publish/Subscribe: Experience Paper

Anomaly Detection of Manufacturing Equipment via High Performance RDF Data Stream Processing: Grand Challenge

REMI, Reusable Elements for Multi-Level Information Availability: Demo

A New Application Benchmark for Data Stream Processing Architectures in an Enterprise Context: Doctoral Symposium

Human Body Related Event Processing: Tutorial

Minimizing Communication Overhead in Window-Based Parallel Complex Event Processing

A Prototype for Credit Card Fraud Management: Industry Paper

Optimized Stage Processing for Anomaly Detection on Numerical Data Streams: Grand Challenge

Scalable Complex Event Processing on a Notebook: Demo

Raphtory: Decentralised Streaming for Temporal Graphs: Doctoral Symposium

Reflections on Almost Two Decades of Research into Stream Processing: Tutorial

Low-Latency Sliding-Window Aggregation in Worst-Case Constant Time

An Event-based Capture-and-Compare Approach to Support the Evolution of Systems of Systems

Real-time High Performance Anomaly Detection over Data Streams: Grand Challenge

Solution Recommender for System Failure Recovery via Log Event Pattern Matching on a Knowledge Graph: Demo

Property-based routing in clustered message brokers for CPS: Doctoral Symposium

Chronograph: A Distributed Processing Platform for Online and Batch Computations on Event-sourced Graphs

StreamLearner: Distributed Incremental Machine Learning on Event Streams: Grand Challenge

Demonstration of a Prototype for Credit Card Fraud Management: Demo

Loosely Coupled Approach for Web-Based Collaborative 3D Design: Doctoral Symposium

PopSub: Improving Resource Utilization in Distributed Content-based Publish/Subscribe Systems

Runtime Anomaly Detection Method in Smart Factories using Machine Learning on RDF Event Streams: Grand Challenge

Software-defined Adaptive Resource Management for Cloud-hosted Group Communication Applications: Poster

An Embedded DSL Framework for Distributed Embedded Systems: Doctoral Symposium

Addressing TCAM Limitations of Software-Defined Networks for Content-Based Routing

Automatic Anomaly Detection over Sliding Windows: Grand Challenge

Raphtory: Decentralised Streaming for Temporal Graphs: Poster

Large-Scale Stream Graph Processing: Doctoral Symposium

Maximizing Determinism in Stream Processing Under Latency Constraints

Multilateral Context Analysis based on the Novel Visualization of Network Tomography: Poster

SecureStreams: A Reactive Middleware Framework for Secure Data Stream Processing

Cascading Data Corruption: About Dependencies in Cyber-Physical Systems: Poster

FlowDB: Integrating Stream Processing and Consistent State Management

Challenges with Image Event Processing: Poster

Event Forecasting with Pattern Markov Chains

The Requirements Engineering Perspective on Events in Cyber-Physical Systems: Poster

Automatic Learning of Predictive CEP Rules: Bridging the Gap between Data Mining and Complex Event Processing

Using Rank Aggregation in Continuously Answering SPARQL Queries on Streaming and Quasi-static Linked Data

DCEP-Sim: An Open Simulation Framework for Distributed CEP

Performance Modeling of Stream Joins

One for All and All for One: Simultaneous Approximation of Multiple Functions over Distributed Streams

Minimizing Communication Overhead in Window-Based Parallel Complex Event Processing

Content Provider	ACM Digital Library
Author	Mayer, Ruben Rothermel, Kurt Tariq, Muhammad Adnan
Abstract	Distributed Complex Event Processing has emerged as a well-established paradigm to detect situations of interest from basic sensor streams, building an operator graph between sensors and applications. In order to detect event patterns that correspond to situations of interest, each operator correlates events on its incoming streams according to a sliding window mechanism. To increase the throughput of an operator, different windows can be assigned to different operator instances---i.e., identical operator copies---which process them in parallel. This implies that events that are part of multiple overlapping windows are replicated to different operator instances. The communication overhead of replicating the events can be reduced by assigning overlapping windows to the same operator instance. However, this imposes a higher processing load on the single operator instance, possibly overloading it. In this paper, we address the trade-off between processing load and communication overhead when assigning overlapping windows to a single operator instance. Controlling the trade-off is challenging and cannot be solved with traditional reactive methods. To this end, we propose a model-based batch scheduling controller building on prediction. Evaluations show that our approach is able to significantly save bandwidth, while keeping a user-defined latency bound in the operator instances.
Starting Page	54
Ending Page	65
Page Count	12
File Format	PDF
ISBN	9781450350655
DOI	10.1145/3093742.3093914
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2017-06-08
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Communication overhead Complex event processing Data parallelization
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in