NDLI: Biomedical compound figure detection using deep learning and fusion techniques

Content Provider	IET Digital Library
Author	Lee, Sheng Long Zare, Mohammad Reza
Abstract	Images contain significant amounts of information but present different challenges relative to textual information. One such challenge is compound figures or images made up of two or more subfigures. A deep learning model is proposed for compound figure detection (CFD) in the biomedical article domain. First, pre-trained convolutional neural networks (CNNs) are selected for transfer learning to take advantage of the image classification performance of CNNs and to overcome the limited dataset of the CFD problem. Next, the pre-trained CNNs are fine-tuned on the training data with early-stopping to avoid overfitting. Alternatively, layer activations of the pre-trained CNNs are extracted and used as input features to a support vector machine classifier. Finally, individual model outputs are combined with score-based fusion. The proposed combined model obtained a best test accuracy of 90.03 and 96.93% outperforming traditional hand-crafted and other deep learning representations on the ImageCLEF 2015 and 2016 CFD subtask datasets, respectively, by using AlexNet, VGG-16, VGG-19 pre-trained CNNs fine-tuned until best validation accuracy stops increasing combined with the combPROD score-based fusion operator.
Starting Page	1031
Ending Page	1037
Page Count	7
ISSN	17519659
Volume Number	12
e-ISSN	17519667
Issue Number	Issue 6, Jun (2018)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-ipr/12/6
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-ipr.2017.0800
Journal	IET Image Processing
Publisher Date	2018-01-23
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	Biology And Medical Computing Biomedical Compound Figure Detection Biomedical Measurement And Imaging CFD CNN Compound Figure Detection Computer Vision And Image Processing Technique Deep Learning Model Feature Extraction Health Physics Image Classification Image Fusion Image Recognition Knowledge Engineering Technique Learning in AI Medical And Biomedical Uses of Field Medical Image Processing Neural Computing Technique Neural Nets Patient Diagnostic Method And Instrumentation Pre-trained Convolutional Neural Network Radiations Radioactivity Score-based Fusion Support Vector Machine Support Vector Machine Classifier Transfer Learning
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Deep multiple instance learning for automatic detection of diabetic retinopathy in retinal images

Accurate leukocoria predictor based on deep VGG-net CNN technique

Ensemble of fine-tuned convolutional neural networks for urine sediment microscopic image classification

Deep learning algorithm for breast masses classification in mammograms

IDM based on image classification with CNN

System for multimodal biometric recognition based on finger knuckle and finger vein using feature-level fusion and k-support vector machine classifier

Fusion of structural and textural features for melanoma recognition

Chinese vehicle license plate recognition using kernel-based extreme learning machine with deep convolutional features

Smartphone camera-based analysis of ELISA using artificial neural network

Biomedical compound figure detection using deep learning and fusion techniques

Similar Documents

Deep multiple instance learning for automatic detection of diabetic retinopathy in retinal images

Accurate leukocoria predictor based on deep VGG-net CNN technique

Ensemble of fine-tuned convolutional neural networks for urine sediment microscopic image classification

Deep learning algorithm for breast masses classification in mammograms

IDM based on image classification with CNN

System for multimodal biometric recognition based on finger knuckle and finger vein using feature-level fusion and k-support vector machine classifier

Fusion of structural and textural features for melanoma recognition

Chinese vehicle license plate recognition using kernel-based extreme learning machine with deep convolutional features

Smartphone camera-based analysis of ELISA using artificial neural network

Biomedical compound figure detection using deep learning and fusion techniques