NDLI: CIDEr: Consensus-based image description evaluation

Content Provider	IEEE Xplore Digital Library
Author	Vedantam, R. Zitnick, C.L. Parikh, D.
Copyright Year	2015
Description	Author affiliation: Virginia Tech, Blacksburg, VA, USA (Vedantam, R.) \|\| Virgnia Tech, Blacksburg, VA, USA (Parikh, D.) \|\| Microsoft Res., Redmond, WA, USA (Zitnick, C.L.)
Abstract	Automatically describing an image with a sentence is a long-standing challenge in computer vision and natural language processing. Due to recent progress in object detection, attribute classification, action recognition, etc., there is renewed interest in this area. However, evaluating the quality of descriptions has proven to be challenging. We propose a novel paradigm for evaluating image descriptions that uses human consensus. This paradigm consists of three main parts: a new triplet-based method of collecting human annotations to measure consensus, a new automated metric that captures consensus, and two new datasets: PASCAL-50S and ABSTRACT-50S that contain 50 sentences describing each image. Our simple metric captures human judgment of consensus better than existing metrics across sentences generated by various sources. We also evaluate five state-of-the-art image description approaches using this new protocol and provide a benchmark for future comparisons. A version of CIDEr named CIDEr-D is available as a part of MS COCO evaluation server to enable systematic evaluation and benchmarking.
Starting Page	4566
Ending Page	4575
File Size	498607
Page Count	10
File Format	PDF
ISSN	10636919
e-ISBN	9781467369640
DOI	10.1109/CVPR.2015.7299087
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-06-07
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Measurement Protocols Accuracy Training Testing Silicon Correlation
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

CIDEr-R: Robust Consensus-based Image Description Evaluation

CIDEr: Consensus-based Image Description Evaluation

Web-scale training for face identification

Face alignment by Explicit Shape Regression

Face recognition based on non-corresponding region matching

Transformation Pursuit for Image Classification

Cider: Consensus-based image description evaluation

Evaluation of super-voxel methods for early video processing

Classifier adaptation at prediction time

CIDEr: Consensus-based image description evaluation

Similar Documents

CIDEr-R: Robust Consensus-based Image Description Evaluation

CIDEr: Consensus-based Image Description Evaluation

Web-scale training for face identification

Face alignment by Explicit Shape Regression

Face recognition based on non-corresponding region matching

Transformation Pursuit for Image Classification

Cider: Consensus-based image description evaluation

Evaluation of super-voxel methods for early video processing

Classifier adaptation at prediction time

CIDEr: Consensus-based image description evaluation