NDLI: Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol

Content Provider	IEEE Xplore Digital Library
Author	Kasturi, R. Goldgof, D. Soundararajan, P. Manohar, V. Garofolo, J. Bowers, R. Boonstra, M. Korzhova, V. Jing Zhang
Copyright Year	1979
Abstract	Common benchmark data sets, standardized performance metrics, and baseline algorithms have demonstrated considerable impact on research and development in a variety of application domains. These resources provide both consumers and developers of technology with a common framework to objectively compare the performance of different algorithms and algorithmic improvements. In this paper, we present such a framework for evaluating object detection and tracking in video: specifically for face, text, and vehicle objects. This framework includes the source video data, ground-truth annotations (along with guidelines for annotation), performance metrics, evaluation protocols, and tools including scoring software and baseline algorithms. For each detection and tracking task and supported domain, we developed a 50-clip training set and a 50-clip test set. Each data clip is approximately 2.5 minutes long and has been completely spatially/temporally annotated at the I-frame level. Each task/domain, therefore, has an associated annotated corpus of approximately 450,000 frames. The scope of such annotation is unprecedented and was designed to begin to support the necessary quantities of data for robust machine learning approaches, as well as a statistically significant comparison of the performance of algorithms. The goal of this work was to systematically address the challenges of object detection and tracking through a common evaluation framework that permits a meaningful objective comparison of techniques, provides the research community with sufficient data for the exploration of automatic modeling techniques, encourages the incorporation of objective evaluation into the development process, and contributes useful lasting resources of a scale and magnitude that will prove to be extremely useful to the computer vision research community for years to come.
Sponsorship	IEEE Computer Society
Page Count	18
File Size	2406564
Starting Page	319
Ending Page	336
File Format	PDF
ISSN	01628828
Volume Number	31
Issue Number	2
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-02-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Face detection Vehicle detection Protocols Measurement Object detection Research and development Vehicles Guidelines Software performance Software tools vehicle. Performance evaluation object detection and tracking baseline algorithms face text Tracking Miscellaneous Video analysis performance evaluation
Content Type	Text
Resource Type	Article
Subject	Applied Mathematics Artificial Intelligence Computational Theory and Mathematics Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles

Learning a Family of Detectors via Multiplicative Kernels

Performance evaluation of object detection algorithms

Evaluation protocol for the DXM2VTS database and performance comparison of face detection and face tracking on video

Kernel-based object tracking

Monotonicity and Error Type Differentiability in Performance Measures for Target Detection and Tracking in Video

Object Tracking Benchmark

An Autonomous Vehicle for Video Surveillance of Indoor Environments

A field model for human detection and tracking

Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol

Similar Documents

Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles

Learning a Family of Detectors via Multiplicative Kernels

Performance evaluation of object detection algorithms

Evaluation protocol for the DXM2VTS database and performance comparison of face detection and face tracking on video

Kernel-based object tracking

Monotonicity and Error Type Differentiability in Performance Measures for Target Detection and Tracking in Video

Object Tracking Benchmark

An Autonomous Vehicle for Video Surveillance of Indoor Environments

A field model for human detection and tracking

Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol