NDLI: Applying big data warehousing and visualization techniques on pingER data

Please wait, while we are loading the content...

Deep kernel: learning kernel function from data using deep neural network

H2F: a hierarchical hadoop framework for big data processing in geo-distributed environments

A visual analytics approach to author name disambiguation

Towards longitudinal analysis of a population's electronic health records using factor graphs

Towards a comprehensive data lifecycle model for big data environments

CoS-HDFS: co-locating geo-distributed spatial data in hadoop distributed file system

An improved incremental training approach for large scaled dataset based on support vector machine

A benchmarking platform for analyzing corpora of traces: the recognition of the users' involvement in fields of competencies

Penalized graph partitioning based allocation strategy for database-as-a-service systems

NVHT: an efficient key-value storage library for non-volatile memory

Neighborhood features help detecting non-technical losses in big data sets

Non-negative multiple matrix factorization with social similarity for recommender systems

Empirical analysis of asymptotic ensemble learning for big data

Performance characterization of hadoop workloads on SR-IOV-enabled virtualized InfiniBand clusters

Visualization of big high dimensional data in a three dimensional space

Disease gene discovery of single-gene disorders based on complex network

A study of factuality, objectivity and relevance: three desiderata in large-scale information retrieval?

Spatial and temporal analysis of urban space utilization with renewable wireless sensor network

SAPAM: a scalable "activities in places" analysis mechanism for informed place design

A big data analytics based approach to anomaly detection

Optimizing the shortest path query on large-scale dynamic directed graph

Node architecture implications for in-memory data analytics on scale-in clusters

Research on semantic orientation classification of chinese online product reviews based on multi-aspect sentiment analysis

A hybrid method of recommending POIs based on context and personal preference confidence

Spatial frequency based video stream analysis for object classification and recognition in clouds

DRESS: a rule engine on spark for event stream processing

Applying big data warehousing and visualization techniques on pingER data

Identifying patient experience from online resources via sentiment analysis and topic modelling

On exploiting data locality for iterative mapreduce applications in hybrid clouds

Spatial big data for designing large scale infrastructure: a case-study of electrical road systems

A real-time big data analysis framework on a CPU/GPU heterogeneous cluster: a meteorological application case study

Not too late to identify potential churners: early churn prediction in telecommunication industry

Clustering spatial data by the neighbors intersection and the density difference

A scalable storage system for structured data based on higher order index array

Survey of data intensive computing technologies application to to security log data management

Synergy and antagonism in online advertising

Efficient service discovery in decentralized online social networks

Social community detection based on node distance and interest

Behavior profiling for mobile advertising

Applying big data warehousing and visualization techniques on pingER data

Content Provider	ACM Digital Library
Author	White, Bebo Ali, Saqib Cottrell, Rodger Les Hameed, Aqsa
Abstract	Nowadays, the Internet has turned into a crucial piece of our cutting edge society. It is a stage of exploration, financial development, democratic participation and speech. The operations of the Internet have prompted a huge development and collection of information known as Big Data. Therefore, it is important to monitor and measure the Quality of Service (QoS) of Internet traffic. The SLAC National Accelerator Laboratory started the PingER project in 1995 to measure the End-to-End Internet performance history of servers and routers worldwide. The project involves measurements of the 700 monitored sites in over 160 countries. PingER Monitoring Agents (MAs) ping a list of monitored sites after every 30 minutes to obtain Round Trip Time (RTT) values revealing interesting information about Internet performance (e.g., RTT, jitter, packet loss and unreachability) major events (e.g., fiber cuts, earthquakes, and social upheavals). Thus, the project has collected a vast amount of historical Internet Performance data worldwide since 1995. Currently, the data is stored in flat text files, making it difficult to analyze collectively. In addition, this simplistic format limits the analytical potential of this data. In this paper, we propose an approach to process, store, analyze and visualize PingER data. A Data warehouse is created which combines Hadoop Big Data techniques. The data are processed by using Sci-cumulus MR workflow, stored in HDFS, analyzed by Impala queries and visualized by using Google API's. This approach makes PingER data more accessible and enhances its potential contribution to ongoing research and application development.
Starting Page	67
Ending Page	72
Page Count	6
File Format	PDF
ISBN	9781450346177
DOI	10.1145/3006299.3006337
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-12-06
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Pinger Visualization Big data Mapreduce Hdfs Data mining
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Applying MapReduce algorithm to performance testing in lexical analysis on HDFS

Efficient Batch Processing of Related Big Data Tasks using Persistent MapReduce Technique

Runoff prediction using Big Data analytics based on ARIMA Model

High Performance and Fault Tolerent Techniques Used to Improve the Data Processing Performance in Big Data

An experimental approach towards big data for analyzing memory utilization on a hadoop cluster using HDFS and MapReduce

Mapreduce Research on Warehousing of Big Data

An iterative methodology for big data management, analysis and visualization

An approach for MapReduce based log analysis using Hadoop

Big R: Large-Scale Analytics on Hadoop Using R

Applying big data warehousing and visualization techniques on pingER data

Similar Documents

Applying MapReduce algorithm to performance testing in lexical analysis on HDFS

Efficient Batch Processing of Related Big Data Tasks using Persistent MapReduce Technique

Runoff prediction using Big Data analytics based on ARIMA Model

High Performance and Fault Tolerent Techniques Used to Improve the Data Processing Performance in Big Data

An experimental approach towards big data for analyzing memory utilization on a hadoop cluster using HDFS and MapReduce

Mapreduce Research on Warehousing of Big Data

An iterative methodology for big data management, analysis and visualization

An approach for MapReduce based log analysis using Hadoop

Big R: Large-Scale Analytics on Hadoop Using R

Applying big data warehousing and visualization techniques on pingER data