NDLI: Realistic endoscopic image generation method using virtual-to-real image-domain translation

Please wait, while we are loading the content...

Biosurface and Biotribology

CAAI Transactions on Intelligence Technology

CIRED - Open Access Proceedings Journal

Chinese Journal of Electronics

Cognitive Computation and Systems

Electronics Letters

Energy Conversion and Economics

Engineering & Technology

Engineering Biology

Healthcare Technology Letters

Volume 8 (2021)

Volume 7 (2020)

Volume 6 (2019)

Volume 6 (2019) : Issue 6, Dec

Augmented reality mastectomy surgical planning prototype using the HoloLens template for healthcare technology letters

Automatic detection of calcium phosphate deposit plugs at the terminal ends of kidney tubules

Deep learning approach for automatic out-of-plane needle localisation for semi-automatic ultrasound probe calibration

Deep segmentation leverages geometric pose estimation in computer-aided total knee arthroplasty

Details preserved unsupervised depth estimation by fusing traditional stereo knowledge from laparoscopic images

Determining blood flow direction from short neurovascular surgical microscope videos

Development and face validation of ultrasound-guided renal biopsy virtual trainer

Endoscopic video defogging using luminance blending

Guest Editorial: Papers from the 13th Workshop on Augmented Environments for Computer Assisted Interventions

HoloInjection: augmented reality support for CT-guided spinal needle injections

Learning colon centreline from optical colonoscopy, a new way to generate a map of the internal colon surface

Learning the representation of instrument images in laparoscopy videos

Marker-less real-time intra-operative camera and hand-eye calibration procedure for surgical augmented reality

Morphological active contour without edge-based model for real-time and non-rigid uterine fibroid tracking in HIFU treatment

Non-invasive reconstruction of dynamic myocardial transmembrane potential with graph-based total variation constraints

Probability analysis of axillary lymph node metastasis in breast cancer patients using particle space-time distribution model

Real-time surgical instrument detection in robot-assisted surgery using a convolutional neural network cascade

Real-time surgical instrument tracking in robot-assisted surgery using multi-domain convolutional neural network

Realistic endoscopic image generation method using virtual-to-real image-domain translation

Simultaneous shape and camera-projector parameter estimation for 3D endoscopic system using CNN-based grid-oneshot scan

Stable polyp-scene classification via subsampling and residual learning from an imbalanced large dataset

Towards AR-assisted visualisation and guidance for imaging of dental decay

Upper gastrointestinal anatomy detection with multi-task convolutional neural networks

Virtual linear measurement system for accurate quantification of medical images

Weakly supervised segmentation for real-time surgical tool tracking

Volume 6 (2019) : Issue 5, Oct

Volume 6 (2019) : Issue 4, Aug

Volume 6 (2019) : Issue 3, Jun

Volume 6 (2019) : Issue 2, Apr

Volume 6 (2019) : Issue 1, Feb

Volume 5 (2018)

Volume 4 (2017)

Volume 3 (2016)

Volume 2 (2015)

Volume 1 (2014)

IET Circuits, Devices & Systems

IET Collaborative Intelligent Manufacturing

IET Communications

IET Computer Vision

IET Computers & Digital Techniques

IET Control Theory & Applications

IET Cyber-Physical Systems: Theory & Applications

IET Cyber-Systems and Robotics

IET Electric Power Applications

IET Electrical Systems in Transportation

IET Energy Systems Integration

IET Generation, Transmission & Distribution

IET Image Processing

IET Information Security

IET Intelligent Transport Systems

IET Microwaves, Antennas & Propagation

IET Nanobiotechnology

IET Nanodielectrics

IET Optoelectronics

IET Power Electronics

IET Quantum Communication

IET Radar, Sonar & Navigation

IET Renewable Power Generation

IET Science, Measurement & Technology

IET Signal Processing

IET Smart Cities

IET Systems Biology

IET Wireless Sensor Systems

Micro & Nano Letters

The Journal of Engineering

Realistic endoscopic image generation method using virtual-to-real image-domain translation

Content Provider	IET Digital Library
Author	Oda, Masahiro Tanaka, Kiyohito Takabatake, Hirotsugu Mori, Masaki Natori, Hiroshi Mori, Kensaku
Abstract	A realistic image generation method for visualisation in endoscopic simulation systems is proposed in this study. Endoscopic diagnosis and treatment are performed in many hospitals. To reduce complications related to endoscope insertions, endoscopic simulation systems are used for training or rehearsal of endoscope insertions. However, current simulation systems generate non-realistic virtual endoscopic images. To improve the value of the simulation systems, improvement of the reality of their generated images is necessary. The authors propose a realistic image generation method for endoscopic simulation systems. Virtual endoscopic images are generated by using a volume rendering method from a CT volume of a patient. They improve the reality of the virtual endoscopic images using a virtual-to-real image-domain translation technique. The image-domain translator is implemented as a fully convolutional network (FCN). They train the FCN by minimising a cycle consistency loss function. The FCN is trained using unpaired virtual and real endoscopic images. To obtain high-quality image-domain translation results, they perform an image cleansing to the real endoscopic image set. They tested to use the shallow U-Net, U-Net, deep U-Net, and U-Net having residual units as the image-domain translator. The deep U-Net and U-Net having residual units generated quite realistic images.
Starting Page	214
Ending Page	219
Page Count	6
Volume Number	6
e-ISSN	20533713
Issue Number	Issue 6, Dec (2019)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/htl/6/6
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/htl.2019.0071
Journal	Healthcare Technology Letters
Publisher	The Institution of Engineering and Technology
Publisher Date	2019-11-26
Access Restriction	Open
Rights License	Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/)
Subject Keyword	Biological Organs Biology And Medical Computing Biomedical Imaging/measurement Computer Graphics Computer Vision And Image Processing Technique Computerised Tomography Data Visualisation Deep U-Net Endoscope Insertions Endoscopes Endoscopic Diagnosis Endoscopic Simulation System Endoscopic Treatment Graphics Technique High-quality Image-domain Translation Result Image Cleansing Image Segmentation Image-domain Translator Medical Image Processing Nonrealistic Virtual Endoscopic Image Optical And Laser Radiation Optical, Image And Video Signal Processing Patient Diagnostic Method And Instrumentation Radiography And Computed Tomography Real Endoscopic Image Realistic Endoscopic Image Generation Method Realistic Image Realistic Image Generation Method Rendering Shallow U-Net Unpaired Virtual Image Virtual Reality X-Ray Technique X-Rays And Particle Beam
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in