NDLI: A MapReduce-based filtering algorithm for vector similarity join

Please wait, while we are loading the content...

Time series analysis of web server logs for an online newspaper

Cloud computing in academic institutions

Applying Hadoop for log analysis toward distributed IDS

SETMES: a scalable and efficient tree-based mechanical scheme for multi-channel wireless data broadcast

Proposal for an optimal job allocation method for data-intensive applications based on multiple costs balancing in a hybrid cloud environment

Genetic swarm based robust image watermarking

Efficient evaluation of human-powered joins with crowdsourced join pre-filters

Knowledge retrieval in lexical ontology-based semantic web search engine

Proposal of automatic reporting system against unauthorized use of smart phone

Features selection approaches for intrusion detection systems based on evolution algorithms

Implementation of relaxed ACID properties for distributed load management in the electrical power industry

Towards realistic sampling: generating dependencies in a relational database

Improving information dissemination and collective data directory for focus group via web based system and SMS

Improving classification accuracy of associative classifiers by using k-conflict-rule preservation

Reducing computational costs of H.264/AVC for video codec in mobile devices

Target modeling for tracking and handoff in a camera network

Towards a high-level trusted computing API for Android software stack

Realization of dynamic behavior using remotely verifiable n-call slides in Unix process execution trace

Real-time Korean traffic sign detection and recognition

Real-time traffic sign detection with vehicle camera images

Multi-label image annotation based on multi-model

'What affects me?': a smart public alert system based on stream reasoning

Hand detection and feature extraction for static Thai Sign Language recognition

More reputable recommenders give more accurate recommendations?

Simplified swarm optimization with differential evolution mutation strategy for parameter search

Multivector e-mail filtering with shape and color impression

Looking at the effects of various multimedia approach in student learning: a case study

Error-resilient packet reordering for compressed video transmission over error-prone networks

New power saving algorithm considering associated STAs and consecutive traffics in WLAN AP

A study of video performance analysis between Flash video and HTML 5 video

Simulation base implementation for placement of security services in real time environment

Secure security model implementation for security services and related attacks base on end-to-end, application layer and data link layer security

A harmonic rejection mixer for cognitive radio application

Flexible dual TCP/UDP streaming for H.264 HD video over WLANs

An analytic approaches for the optimal clustering in multi-hop wireless sensor networks

Detecting flooding based DoS attack in cloud computing environment using covariance matrix approach

Reconstruction of event sequences based on asynchronous observations in sensor networks

Self-stabilizing k-hops clustering algorithm for wireless ad hoc networks

Decomposing graph with 2-node cuts for diameter constrained network reliability calculation

Quality of service of mobile users for longcut routes with congested access points

A power-aware distributed Wi-Fi access point scheduling algorithm

Network latency prediction using high accuracy prediction tree

Load balancing scheme for wireless cellular networks

Efficiency analysis of decentralized grid scheduling with job migration and replication

Exact bounds for average pairwise network reliability

QoS routing for real time traffic in mobile ad hoc network

Wideband and high gain cylindrical dielectric resonator antenna array

A comparison of various vehicular ad hoc routing protocols based on communication environments

Flooding attack in energy harvesting wireless sensor networks

Second order suboptimal power allocation for OFDM-based cognitive radio systems

Routing dual criterion protocol

Network structure optimization: genetic operators: mutation and crossover

BIMAS: a prototype for intrusion detection system using motion sensors and ZigBee

A proposal for the privacy leakage verification tool for Android application developers

Technical lecturers' perception on student evaluation

The effect of integrating social plugins into e-commerce website: a study on online consumer behaviour

Proposal of CAPTCHA using three dimensional objects

4As' effect on TADI in Malaysia hand phone industry

Enhancing and identifying cloning attacks in online social networks

Document page retrieval based on geometric layout features

A study on Chinese consumers' concern about books on online bookstores

iPhone application development using Xcode

Optimized and hygienic touch screen keyboard for large letter set languages

Identifying representative ratings for a new item in recommendation system

Semi-supervised feature selection using co-occurrent frequent subgraphs

Ontology for semantic representation of marine metadata

RAMC: runtime abstract memory context based plagiarism detection in binary code

A cooperative method for privacy preservation in real-time location monitoring services

Web based multi-platform benchmark program construction in smartphone

Enhancing a strategy of virtualized resource assignment in adaptive resource cloud framework

A MapReduce-based filtering algorithm for vector similarity join

A data partitioning approach for hierarchical clustering

Fast protein 3D surface search

Detecting source code similarity using code abstraction

Blog topic analysis using TF smoothing and LDA

Flexible and efficient string similarity search with alignment-space transform

Real-time near-duplicate web video identification by tracking and matching of spatial features

Regularization based super-resolution image processing algorithm using edge-adaptive non-local means filter

Unsupervised color images segmentation using spatial hidden MRF GDPM model

Real-time multiple object centroid tracking for gesture recognition based on FPGA

Global optimization in discretized parameter space for predefined object segmentation

Music segmentation and summarization based on self-similarity matrix

Classifier ensemble optimization for human activity recognition in smart homes

Accurate and fast extraction of planar surface patches from 3D point cloud

Teaching the robot by guidance using an exoskeleton device in assembly lines

An optimized watermarking technique employing SVD in DWT domain

Object segmentation based on location information for level set method

Robust real time face tracking in mobile devices

Automatic clustering for digital photograph collections using time and content information

Reducing overfitting of AdaBoost by clustering-based pruning of hard examples

Visual attention with contextual saliencies of a scene

Image retrieval using wavelet transform and shape decomposition

A hybrid matching algorithm based on contour and motion information for depth estimation

A novel link scheduling method based on CAZAC sequence for device-to-device communication system

Optimizing storage performance of Android smartphone

Cgroups-based scheduling scheme for heterogeneous workloads in smart TV systems

Personal genie: a distributed framework for spontaneous interaction support with smart objects in a place

Performance evaluation of BS cooperative communication in networks-wise

An integer linear programming (ILP)-based optimization for finding the optimal independent sets in wireless ad hoc networks

A framework of N-screen services based on PVR and named data networking in cloud computing

An interferer filtering CMOS LNA for multiband wireless receiver

Neighbor discovery for cognitive radio ad hoc networks

On minimizing the broadcast redundancy in duty-cycled wireless sensor networks

A MAC protocol with dynamic frame size by vehicle estimation for vehicular ad hoc networks

Timing synchronization method for device-to-device communication system

An enhanced mechanism with cryptographic computation cost reduction in AAA-mobile IP architecture

HIAM: hidden node and interference aware routing metric for multi-channel multi-radio mesh networks

Delay-constrained adaptive early drop for real-time video delivery over IEEE 802.11 wireless networks

Empirical analysis of power management schemes for multi-core smartphones

A secure user-friendly authentication scheme with anonymity for wireless communications

Implementation of a MIMO-OFDM system based on the TI C64x+ DSP

A resource allocation scheme for improving user fairness in device-to-device communication based on cellular networks

Multi-level thresholding for reducing cascade yielding of FlahLinQ link scheduling

Cooperative resource allocation scheme for mitigating interference to victim macro UEs in LTE-femtocell networks

3DTV and immersive environment

Robot's joint attention cued by a pointing gesture

Advanced algorithms and their parallel architectures for full-HD TV video display processing

Analysis of QoE guarantee on hybrid remote display protocol for mobile thin client computing

A MapReduce-based filtering algorithm for vector similarity join

Content Provider	ACM Digital Library
Author	Yang, Byoungju Myung, Jaeseok Lee, Dongjoo Lee, Sang-goo
Abstract	Vector Similarity Join is a fundamental operation that is utilized in data cleaning and analysis. Since most objects can be represented as feature vectors, finding similar pairs of objects is quite an important task. However, Vector Similarity Join is a heavy computational job, because its complexity is proportional to the square of the number of vectors. In order to diminish its computational load, many filtering techniques have been proposed so far. In addition to that, algorithms for distributed systems also have been researched to manage large datasets. But, the state-of-the-art studies also suffer from voluminous computations. In this paper, we propose a MapReduce algorithm that efficiently executes Vector Similarity Join. In the first stage of our algorithm, we use prefix filtering to reduce the number of candidate pairs. The second stage calculates similarities from candidate pairs of the first stage. We present candidates quantity prediction formulas to demonstrate the effectiveness of our algorithm. Experimental results show that our algorithm outperforms state-of-the-art MapReduce algorithms.
Starting Page	1
Ending Page	5
Page Count	5
File Format	PDF
ISBN	9781450319584
DOI	10.1145/2448556.2448627
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-01-17
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Prefix filtering Mapreduce algorithm Vector similarity join
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in