NDLI: Integrating image and text information for biomedical information retrieval

Content Provider	IEEE Xplore Digital Library
Author	Antani, S.
Copyright Year	2010
Description	Author affiliation: U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA (Antani, S.)
Abstract	The search for relevant and actionable information is key to achieving clinical and research goals in biomedicine. Biomedical information exists in different forms: as text and illustrations in journal articles and other documents, in "images" stored in databases, and as patients' cases in electronic health records. In the context of this work an "image" includes not only biomedical images, but also illustrations, charts, graphs, and other visual material appearing in biomedical journals, electronic health records, and other relevant databases. The tutorial will cover methods and techniques to retrieve information from these entities, by moving beyond conventional text-based searching to combining both text and visual features in search queries. The approaches to meeting these objectives use a combination of techniques and tools from the fields of Information Retrieval (IK), Content-Based Image Retrieval (CBIR), and Natural Language Processing (NLP). The tutorial will discuss steps to improve the retrieval of biomedical literature by targeting the text describing the visual content in articles (figures, including illustrations and images), a rich source of information not typically exploited by conventional bibliographic or full-text databases. Taking this a step further we will explore challenges in finding information relevant to a patient's case from the literature and then link it to the patient's health record. The case is first represented in structured form using both text and image features, and then literature and EHR databases can be searched for similar cases. Further, we will discuss steps to automatically find semantically similar images in image databases, which is an important step in differential diagnosis. Automatic image annotation and retrieval steps will be described that use image features and a combination of image and text features. We explore steps toward generating a "visual ontology", i.e., concepts assigned to image patches. Elements from the visual ontology are called "visual keywords" and are used to find images with similar concepts. The tutorial will demonstrate some of these techniques by demonstrating our Image and Text Search Engine (ITSE), a hybrid system combining NLM's Essie text search engine with CEB's image similarity engine.
Starting Page	3
Ending Page	3
File Size	241487
Page Count	1
File Format	PDF
ISBN	9781424491674
ISSN	10637125
e-ISBN	9781424491681
DOI	10.1109/CBMS.2010.6042631
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-10-12
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Visualization Biomedical imaging Tutorials Natural language processing Visual databases Search engines
Content Type	Text
Resource Type	Article
Subject	Radiology, Nuclear Medicine and Imaging Computer Science Applications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using the Grid for Enhancing the Performance of a Medical Image Search Engine

A content-based search engine on medical images for telemedicine

A system for searching uterine cervix images by visual attributes

Review of medical image retrieval systems and future directions

Relevance Feedback Query Refinement for PDF Medical Journal Articles

Integration of intelligent engines for a large scale medical image database

MultiWaveMed: a system for medical image retrieval through wavelets transformations

MM: Modular architecture for multimedia information retrieval

Visualizing the results of multimedia Web search engines

Integrating image and text information for biomedical information retrieval

Similar Documents

Using the Grid for Enhancing the Performance of a Medical Image Search Engine

A content-based search engine on medical images for telemedicine

A system for searching uterine cervix images by visual attributes

Review of medical image retrieval systems and future directions

Relevance Feedback Query Refinement for PDF Medical Journal Articles

Integration of intelligent engines for a large scale medical image database

MultiWaveMed: a system for medical image retrieval through wavelets transformations

MM: Modular architecture for multimedia information retrieval

Visualizing the results of multimedia Web search engines

Integrating image and text information for biomedical information retrieval