NDLI: An Enhanced Framework of Generative Adversarial Networks (EF-GANs) for Environmental Microorganism Image Augmentation With Limited Rotation-Invariant Training Data

Content Provider	Directory of Open Access Journals (DOAJ)
Author	Hao Xu Chen Li Md Mamunur Rahaman Yudong Yao Zihan Li Jinghua Zhang Frank Kulwa Xin Zhao Shouliang Qi Yueyang Teng
Abstract	The main obstacle to image augmentation with Generative Adversarial Networks (GANs) is the need for a large amount of training data, but this is difficult for small datasets like Environmental Microorganisms (EMs). EM image analysis plays a vital role in environmental monitoring and protection, but it is often encountered with small datasets due to the difficulty of EM image collection. To this end, we propose an Enhanced Framework of GANs (EF-GANs) that combines geometric transformation methods and GANs for EM image augmentation. First of all, the color of an EM image has an insignificant impact on its class label, based on this fact, we perform color space augmentation to the original EM images. Secondly, we train EF-GANs with augmented EM images to generate utterly new EM images. Finally, we rotate the generated samples in various directions to obtain a more natural performance. In this study, we use VGG16 and ResNet50 networks to evaluate the proposed EF-GANs on 21 different types of EMs (420 EM images). It is observed that the average precision (AP) of VGG16 increases between 4.5% and 84.1% in 20 EM classes and one class remains unchanged. The AP of Resnet50 rises between 8.7% and 38.7% in 12 EM classes and reaches 100% in two EM classes. Furthermore, to reflect the generalization performance of EF-GANs, we employ an utterly new EM image dataset (630 EM images) to test the previous VGG16 networks. We select the VGG16 networks with original and optimal settings for all the EM classes, and for testing, optimal settings for a single EM class is considered. In the 20 of 21 one-vs-rest EM image classification tasks, the AP of VGG16 increases between 1.66% and 88.1%. The results demonstrate that the proposed EF-GANs can achieve outstanding performance in augmenting single EM images with high quality and resolution, thus, to improve the APs of EM image classification.
e-ISSN	21693536
DOI	10.1109/ACCESS.2020.3031059
Journal	IEEE Access
Volume Number	8
Language	English
Publisher	IEEE
Publisher Date	2020-01-01
Publisher Place	United States
Access Restriction	Open
Subject Keyword	Electrical Engineering. Electronics. Nuclear Engineering Image Augmentation Environmental Microorganism Microscopic Image Small Dataset Generative Adversarial Networks Image Analysis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in