NDLI: Semantic Indexing of Wearable Camera Images: Kids'Cam Concepts

Please wait, while we are loading the content...

Exploiting Scene Context for Image Captioning

News Event Understanding by Mining Latent Factors From Multimodal Tensors

Jointly Representing Images and Text: Dependency Graphs, Word Senses, and Multimodal Embeddings

Multimodal and Crossmodal Representation Learning from Textual and Visual Features with Bidirectional Deep Neural Networks for Video Hyperlinking

Beyond Language and Vision, Towards Truly Multimedia Integration

Cross-modal Classification by Completing Unimodal Representations

User Video Summarization Based on Joint Visual and Semantic Affinity Graph

Semantic Indexing of Wearable Camera Images: Kids'Cam Concepts

Disinformation in Multimedia Annotation: Misleading Metadata Detection on YouTube

Semantic Indexing of Wearable Camera Images: Kids'Cam Concepts

Content Provider	ACM Digital Library
Author	O'Connor, Noel E. Wang, Peng Barr, Michelle McGuinness, Kevin Signal, Louise Chambers, Tim Zhou, Jiang Freitas, Andre Azevedo, Lucas Ní Mhurchu, Cliona Stanley, James Gurrin, Cathal Smith, Moira Smeaton, Alan F. Davis, Brian
Abstract	In order to provide content-based search on image media, including images and video, they are typically accessed based on manual or automatically assigned concepts or tags, or sometimes based on image-image similarity depending on the use case. While great progress has been made in very recent years in automatic concept detection using machine learning, we are still left with a mis-match between the semantics of the concepts we can automatically detect, and the semantics of the words used in a user's query, for example. In this paper we report on a large collection of images from wearable cameras gathered as part of the Kids'Cam project, which have been both manually annotated from a vocabulary of 83 concepts, and automatically annotated from a vocabulary of 1,000 concepts. This collection allows us to explore issues around how language, in the form of two distinct concept vocabularies or spaces, one manually assigned and thus forming a ground-truth, is used to represent images, in our case taken using wearable cameras. It also allows us to discuss, in general terms, issues around mis-match of concepts in visual media, which derive from language mis-matches. We report the data processing we have completed on this collection and some of our initial experimentation in mapping across the two language vocabularies.
Starting Page	27
Ending Page	34
Page Count	8
File Format	PDF
ISBN	9781450345194
DOI	10.1145/2983563.2983566
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-10-16
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Lifelogging Wearable cameras Concept vocabularies Image tagging
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in