NDLI: Image understanding for converting images into natural language text sentences

Content Provider	IEEE Xplore Digital Library
Author	Bourbakis, N.
Copyright Year	2010
Description	Author affiliation: ATR Center, Wright State University, Dayton O, USA (Bourbakis, N.)
Abstract	The efficient processing, association and understanding of multimedia based events or multi-modal information is a very important research field with a great variety of applications, such as knowledge discovery, document understanding, human computer interaction, etc. A good approach to this important issue is the development of a common platform for converting different modalities (such as images, text, etc) into the same medium and associating them for efficient processing and understanding. Thus, this talk here presents the development of a methodology capable for automatically converting images into natural language (NL) text sentences using image processing-analysis methods and graphs with attributes for object recognition, and image understanding. Then it converts graph representations into NL text sentences. Moreover, it presents a methodology for transforming NL sentences into Graph representations and then into Stochastic Petri-nets (SPN) descriptions in order to offer a common model of representation of multimodal information and at the same time a way of associating “activities or changes” in image frames for events representation and interpretation. The selection of the SPN graph model is due to its capability for efficiently representing structural and functional knowledge where other models cannot. Simple illustrative examples are provided for proving the concept presented here.
Starting Page	1
Ending Page	1
File Size	135813
Page Count	1
File Format	PDF
ISBN	9781424468966
e-ISBN	9781424468997
DOI	10.1109/NLPKE.2010.5587864
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-08-21
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Natural languages
Content Type	Text
Resource Type	Synopsis

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modeling Natural Language Sentences into SPN Graphs

A mapping mechanism of NL sentences onto an SPN state machine for understanding purposes

Knowledge patterns for conversion of sentences in natural language into RDF graph language

Intelligent Voice Prosthesis: Converting Icons into Natural Language Sentences

Design of retrieval system for Web images based on semantic analysis

Converting natural language route instructions into robot executable procedures

A structure based computer grammar to understand simple and compound English sentences

Computer simulation of mental image processing in natural language understanding by human

Fusion approach of formal semantics for the parsing of UDC sentences

Image understanding for converting images into natural language text sentences

Similar Documents

Modeling Natural Language Sentences into SPN Graphs

A mapping mechanism of NL sentences onto an SPN state machine for understanding purposes

Knowledge patterns for conversion of sentences in natural language into RDF graph language

Intelligent Voice Prosthesis: Converting Icons into Natural Language Sentences

Design of retrieval system for Web images based on semantic analysis

Converting natural language route instructions into robot executable procedures

A structure based computer grammar to understand simple and compound English sentences

Computer simulation of mental image processing in natural language understanding by human

Fusion approach of formal semantics for the parsing of UDC sentences

Image understanding for converting images into natural language text sentences