NDLI: An explainable CNN approach for medical codes prediction from clinical text

Please wait, while we are loading the content...

An explainable CNN approach for medical codes prediction from clinical text

Content Provider	Springer Nature : BioMed Central
Author	Hu, Shuyuan Teng, Fei Huang, Lufei Yan, Jun Zhang, Haibo
Abstract	Background Clinical notes are unstructured text documents generated by clinicians during patient encounters, generally are annotated with International Classification of Diseases (ICD) codes, which give formatted information about the diagnosis and treatment. ICD code has shown its potentials in many fields, but manual coding is labor-intensive and error-prone, lead to researches of automatic coding. Two specific challenges of this task are (1) given an annotated clinical notes, the reasons behind specific diagnoses and treatments are implicit; (2) explainability is important for practical automatic coding method, the method should not only explain its prediction output but also have explainable internal mechanics. This study aims to develop an explainable CNN approach to address these two challenges. Method Our key idea is that for the automatic ICD coding task, the presence of informative snippets in the clinical text that correlated with each code plays an important role in the prediction of codes, and an informative snippet can be considered as a local and low-level feature. We infer that there exists a correspondence between a convolution filter and a local and low-level feature. Base on the inference, we come up with the Shallow and Wide Attention convolutional Mechanism (SWAM) to improve the CNN-based models’ ability to learn local and low-level features for each label. Results We evaluate our approach on MIMIC-III, an open-access dataset of ICU medical records. Our approach substantially outperforms previous results on top-50 medical code prediction on MIMIC-III dataset, the precision of the worst-performing 10% labels in previous works is increased from 0% to 53% on average. We attribute this improvement to SWAM, by which the wide architecture with attention mechanism gives the model ability to more extensively learn the unique features of different codes, and we prove it by an ablation experiment. Besides, we perform manual analysis of the performance imbalance between different codes, and preliminary conclude the characteristics that determine the difficulty of learning specific codes. Conclusions Our main contributions can be summarized into the following three: (1) We present local and low-level features, a.k.a. informative snippets play an important role in the automatic ICD coding task, and the informative snippets extracted from the clinical text provide explanations for each code. (2) We propose that there exists a correspondence between a convolution filter and a local and low-level feature. A combination of wide and shallow convolutional layer and attention layer can help the CNN-based models better learn local and low-level features. (3) We improved the precision of the worst-performing 10% labels from 0 to 53% on average.
Related Links	https://bmcmedinformdecismak.biomedcentral.com/counter/pdf/10.1186/s12911-021-01615-6.pdf
Ending Page	12
Page Count	12
Starting Page	1
File Format	HTM / HTML
ISSN	14726947
DOI	10.1186/s12911-021-01615-6
Journal	BMC Medical Informatics and Decision Making
Issue Number	9
Volume Number	21
Language	English
Publisher	BioMed Central
Publisher Date	2021-11-16
Access Restriction	Open
Subject Keyword	Health Informatics Information Systems and Communication Service Management of Computing and Information Systems ICD coding Machine learning Attention mechanism Convolutional neural network
Content Type	Text
Resource Type	Article
Subject	Health Informatics Computer Science Applications Health Policy
Journal Impact Factor	3.3/2023
5-Year Journal Impact Factor	3.9/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Interpretable clinical prediction via attention-based neural network

A deep convolutional neural network approach using medical image classification

MRI-based brain tumor detection using convolutional deep learning methods and chosen machine learning techniques

Autonomous detection of nail disorders using a hybrid capsule CNN: a novel deep learning approach for early diagnosis

MSAL-Net: improve accurate segmentation of nuclei in histopathology images by multiscale attention learning network

Entity recognition in Chinese clinical text using attention-based CNN-LSTM-CRF

Construction of a semi-automatic ICD-10 coding system

Medical code prediction via capsule networks and ICD knowledge

Diagnosis of left ventricular hypertrophy using convolutional neural network

An explainable CNN approach for medical codes prediction from clinical text

Similar Documents

Interpretable clinical prediction via attention-based neural network

A deep convolutional neural network approach using medical image classification

MRI-based brain tumor detection using convolutional deep learning methods and chosen machine learning techniques

Autonomous detection of nail disorders using a hybrid capsule CNN: a novel deep learning approach for early diagnosis

MSAL-Net: improve accurate segmentation of nuclei in histopathology images by multiscale attention learning network

Entity recognition in Chinese clinical text using attention-based CNN-LSTM-CRF

Construction of a semi-automatic ICD-10 coding system

Medical code prediction via capsule networks and ICD knowledge

Diagnosis of left ventricular hypertrophy using convolutional neural network

An explainable CNN approach for medical codes prediction from clinical text