NDLI: Data stream analytics and mining in the cloud

Content Provider	IEEE Xplore Digital Library
Author	Ari, I. Olmezogullari, E. Celebi, O.F.
Copyright Year	2012
Description	Author affiliation: Cloud Computing Research Group and Avea Labs Computer Science Department, Özyeäÿin University Istanbul, Turkey (Ari, I.; Olmezogullari, E.; Celebi, O.F.)
Abstract	Due to prevalent use of sensors and network monitoring tools, big volumes of data or “big data” today traverse the enterprise data processing pipelines in a streaming fashion. While some companies prefer to deploy their data processing infrastructures and services as private clouds, others completely outsource these services to public clouds. In either case, attempting to store the data first for subsequent analysis creates additional resource costs and unwanted delays in obtaining actionable information. As a result, enterprises increasingly employ data or event stream processing systems and further want to extend them with complex online analytic and mining capabilities. In this paper, we present implementation details for doing both correlation analysis and association rule mining (ARM) over streams. Specifically, we implement Pearson-Product Moment Correlation for analytics and Apriori & FPGrowth algorithms for stream mining inside a popular event stream processing engine called Esper. As a unique contribution, we conduct experiments and present performance results of these new tools with different tumbling and sliding time-windows over two different stream types: one for moving bus trajectories and another for web logs from a music site. We find that while tumbling windows may be more preferable for performance in certain applications, sliding windows can provide additional benefits with rule mining. We hope that our findings can shed light on the design of other cloud analytics systems.
Starting Page	857
Ending Page	862
File Size	1522536
Page Count	6
File Format	PDF
ISBN	9781467345118
e-ISBN	9781467345101
e-ISBN	9781467345095
DOI	10.1109/CloudCom.2012.6427563
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-12-03
Publisher Place	Taiwan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	FP-growth Association Rule Mining Cloud computing Correlation Itemsets Real-time systems Data streams Apriori Association rules Stream mining Complex Event Processing Engines
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Data stream mining to address big data problems

Online Association Rule Mining over Fast Data

An Adaptive Implementation Case Study of Apriori Algorithm for a Retail Scenario in a Cloud Environment

Rule Modeling Engine for Optimizing Complex Event Processing Patterns

Mining interesting itemsets from transactional database

MR-Apriori: Association Rules algorithm based on MapReduce

A Parallel Apriori Algorithm for Frequent Itemsets Mining

The Strategy of Mining Association Rule Based on Cloud Computing

A New Algorithm for Frequent Itemsets Mining Based on Apriori and FP-Tree

Data stream analytics and mining in the cloud

Similar Documents

Data stream mining to address big data problems

Online Association Rule Mining over Fast Data

An Adaptive Implementation Case Study of Apriori Algorithm for a Retail Scenario in a Cloud Environment

Rule Modeling Engine for Optimizing Complex Event Processing Patterns

Mining interesting itemsets from transactional database

MR-Apriori: Association Rules algorithm based on MapReduce

A Parallel Apriori Algorithm for Frequent Itemsets Mining

The Strategy of Mining Association Rule Based on Cloud Computing

A New Algorithm for Frequent Itemsets Mining Based on Apriori and FP-Tree

Data stream analytics and mining in the cloud