NDLI: Video Extruder: a semi-dense point tracker for extracting beams of trajectories in real time

Content Provider	Springer Nature Link
Author	Garrigues, Matthieu Manzanera, Antoine Bernard, Thierry M.
Copyright Year	2014
Abstract	Two crucial aspects of general-purpose embedded visual point tracking are addressed in this paper. First, the algorithm should reliably track as many points as possible. Second, the computation should achieve real-time video processing, which is challenging on low power embedded platforms. We propose a new multi-scale semi-dense point tracker called Video Extruder, whose purpose is to fill the gap between short-term, dense motion estimation (optical flow) and long-term, sparse salient point tracking. This paper presents a new detector, including a new salience function with low computational complexity and a new selection strategy that allows to obtain a large number of keypoints. Its density and reliability in mobile video scenarios are compared with those of the FAST detector. Then, a multi-scale matching strategy is presented, based on hybrid regional coarse-to-fine and temporal prediction, which provides robustness to large camera and object accelerations. Filtering and merging strategies are then used to eliminate most of the wrong or useless trajectories. Thanks to its high degree of parallelism, the proposed algorithm extracts beams of trajectories from the video very efficiently. We compare it with the state-of-the-art pyramidal Lucas–Kanade point tracker and show that, in short range mobile video scenarios, it yields similar quality results, while being up to one order of magnitude faster. Three different parallel implementations of this tracker are presented, on multi-core CPU, GPU and ARM SoCs. On a commodity 2010 CPU, it can track 8,500 points in a 640 × 480 video at 150 Hz.
Starting Page	785
Ending Page	798
Page Count	14
File Format	PDF
ISSN	18618200
Journal	Journal of Real-Time Image Processing
Volume Number	11
Issue Number	4
e-ISSN	18618219
Language	English
Publisher	Springer Berlin Heidelberg
Publisher Date	2014-04-01
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Point tracking Optical flow Beam of trajectories Semi-dense Real time Image Processing and Computer Vision Multimedia Information Systems Computer Graphics Pattern Recognition Signal, Image and Speech Processing
Content Type	Text
Resource Type	Article
Subject	Information Systems

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Video Extruder: a semi-dense point tracker for extracting beam of trajectories in real time

A real-time framework for eye detection and tracking

Real-time vision-based tracking and reconstruction

Special issue on real-time image and video processing for pattern recognition systems and applications

FPGA–DSP co-processing for feature tracking in smart video sensors

Real-time multi-camera video analytics system on GPU

Real-time lane tracking using Rao-Blackwellized particle filter

Real-time view-based pose recognition and interpolation for tracking initialization

Parallel processing for real-time 3D reconstruction from video streams

Video Extruder: a semi-dense point tracker for extracting beams of trajectories in real time

Similar Documents

Video Extruder: a semi-dense point tracker for extracting beam of trajectories in real time

A real-time framework for eye detection and tracking

Real-time vision-based tracking and reconstruction

Special issue on real-time image and video processing for pattern recognition systems and applications

FPGA–DSP co-processing for feature tracking in smart video sensors

Real-time multi-camera video analytics system on GPU

Real-time lane tracking using Rao-Blackwellized particle filter

Real-time view-based pose recognition and interpolation for tracking initialization

Parallel processing for real-time 3D reconstruction from video streams

Video Extruder: a semi-dense point tracker for extracting beams of trajectories in real time