NDLI: Natural-language retrieval of images based on descriptive captions

Content Provider	ACM Digital Library
Author	Rowe, Neil C. Guglielmo, Eugene J.
Copyright Year	1996
Abstract	We describe a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally require captions to explain their features and significance. Such descriptive captions often rely on long nominal compounds (strings of consecutive nouns) which create problems of disambiguating word sence. In our system, captions and user queries are parsed and interpreted to produce a logical form using a detailed theory of the meaning of nominal compounds. A $\textit{fine-grain}$ match can then compare the logical form of the query to the logical forms for each caption. To improve system efficiency, we first perform a $\textit{coarse-grain}$ match with index files, using nouns and verbs extracted from the query. Our experiments with randomly selected queries and captions from an existing image library show an increase of 30% in precision and 50% in recall over the keyphrase approach currently used. Our processing times have a median of seven seconds as compared to eight minutes for the existing system, and our system is much easier to use.
Starting Page	237
Ending Page	267
Page Count	31
File Format	PDF
ISSN	10468188
e-ISSN	15582868
DOI	10.1145/230538.230539
Volume Number	14
Issue Number	3
Journal	ACM Transactions on Information Systems (TOIS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1996-07-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Captions Multimedia database Type hierarchy
Content Type	Text
Resource Type	Article
Subject	Computer Science Applications Information Systems Business, Management and Accounting

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A survey on content-based retrieval for multimedia databases

A video retrieval and sequencing system

XIRQL: An XML query language based on information retrieval concepts

Problems and some solutions in customization of natural language database front ends

An information-theoretic framework for semantic-multimedia retrieval

Feedback techniques for continuity and synchronization in multimedia information retrieval

Querying multimedia presentations based on content

Information retrieval using a hypertext-based help system

Assessing multivariate Bernoulli models for information retrieval

Natural-language retrieval of images based on descriptive captions

Similar Documents

A survey on content-based retrieval for multimedia databases

A video retrieval and sequencing system

XIRQL: An XML query language based on information retrieval concepts

Problems and some solutions in customization of natural language database front ends

An information-theoretic framework for semantic-multimedia retrieval

Feedback techniques for continuity and synchronization in multimedia information retrieval

Querying multimedia presentations based on content

Information retrieval using a hypertext-based help system

Assessing multivariate Bernoulli models for information retrieval

Natural-language retrieval of images based on descriptive captions