NDLI: Improving accuracy of identifying clinical concepts in noisy unstructured clinical notes using existing internal redundancy

Please wait, while we are loading the content...

Document: a useful level for facing noisy data

The nature of noise in linguistic corpora

A platform for storing, visualizing, and interpreting collections of noisy documents

Extracting person names from diverse and noisy OCR text

The effects of learner errors on the development of a collocation detection tool

Improving accuracy of identifying clinical concepts in noisy unstructured clinical notes using existing internal redundancy

Clustering based approach to learning regular expressions over large alphabet for noisy unstructured text

Reshaping automatic speech transcripts for robust high-level spoken document analysis

Statement map: reducing web information credibility noise through opinion classification

Variant search and syntactic tree similarity based approach to retrieve matching questions for SMS queries

Discovering users' topics of interest on twitter: a first look

Tokenizing micro-blogging messages using a text classification approach

Improving accuracy of identifying clinical concepts in noisy unstructured clinical notes using existing internal redundancy

Content Provider	ACM Digital Library
Author	Patrick, Jon David Motamedi, Negin Asgari, Pooyan
Abstract	This paper, reports on the results of research which is based originally on the 2009 criteria and corpus of "The Obesity Challenge", defined by Informatics for Integrating Biology and the Bedside (i2b2), a National Center for Biomedical Computing. In the original task, i2b2 asked participants to build software systems that could process a corpus of noisy patient's clinical discharge summaries and report on patients' condition. The ultimate aim was to compare the judgments of physicians in evaluating the patient condition to a machine performance over such a corpus. The authors used a collection of resources to lexically and semantically characterize the diseases and their associated signs, symptoms. In this approach, they combined dictionary look-up, rule-based, and machine-learning methods along with adopting a special internal redundancy algorithm to reduce the usage of customized rules and increase the consistency of the performance over various types of noisy corpora. The performance was strengthened by information extracted from the patient notes via an internal redundancy module to overcome False Positives (FPs) and False Negatives (FNs) arising from the noisy nature of corpus. The methods were applied to a collection of 507 previously unseen noisy patient discharge summaries, and the Judgments were evaluated against a manually provided gold standard. The overall ranking of the participating Research groups were primarily based on the macro-averaged F-measure over 16 Classes of diseases. The implemented method achieved the micro-averaged F-measure of 96.9% (ranked within the top 7 out of 28 research groups) where there was no statistical significant difference between top 7 teams in micro F-measure. The highest F-Measure was 97.2%. The performance achieved was in line with the agreement between human annotators, indicating the potential of text mining for accurate and efficient prediction of disease status from clinical discharge summaries. Comparison of the results of this approach to results of other submitted classical approaches also showed adopting the internal redundancy algorithm for clinical domains can boost the accuracy of classifiers without extensive usage of rules and customization and therefore has potential for a more consistent performance and more efficient processing over various type of noisy corpora.
Starting Page	35
Ending Page	42
Page Count	8
File Format	PDF
ISBN	9781450303767
DOI	10.1145/1871840.1871847
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2010-10-26
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Internal redundancy Concept matching Noisy corpus Unstructured text Classification Natural language processing Health informatics
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in