NDLI: Crowd-Sourced Annotation of ECG Signals Using Contextual Information

Content Provider	Springer Nature Link
Author	Zhu, Tingting Johnson, Alistair E. W. Behar, Joachim Clifford, Gari D.
Copyright Year	2013
Abstract	For medical applications, the ground truth is ascertained through manual labels by clinical experts. However, significant inter-observer variability and various human biases limit accuracy. A probabilistic framework addresses these issues by comparing aggregated human and automated labels to provide a reliable ground truth, with no prior knowledge of the individual performance. As an alternative to median or mean voting strategies, novel contextual features (signal quality and physiology) were introduced to allow the Probabilistic Label Aggregator (PLA) to weight an algorithm or human based on its performance. As a proof of concept, the PLA was applied to QT interval (pro-arrhythmic indicator) estimation from the electrocardiogram using labels from 20 humans and 48 algorithms crowd-sourced from the 2006 PhysioNet/Computing in Cardiology Challenge database. For automatic annotations, the root mean square error of the PLA was 13.97 ± 0.46 ms, significantly outperforming the best Challenge entry (16.36 ms) as well as mean and median voting strategies (17.67 ± 0.56 ms and 14.44 ± 0.52 ms respectively with p < 0.05). When selecting three annotators, the PLA improved the annotation accuracy over median aggregation by 10.7% for human annotators and 14.4% for automated algorithms. The PLA could therefore provide an improved “gold standard” for medical annotation tasks even when ground truth is not available.
Starting Page	871
Ending Page	884
Page Count	14
File Format	PDF
ISSN	00906964
Journal	Annals of Biomedical Engineering
Volume Number	42
Issue Number	4
e-ISSN	15739686
Language	English
Publisher	Springer US
Publisher Date	2013-12-25
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Probabilistic analysis Crowd-sourcing Unsupervised learning ECG QT estimation Signal quality Biomedicine general Biomedical Engineering Biophysics and Biological Physics Mechanics Biochemistry
Content Type	Text
Resource Type	Article
Subject	Biomedical Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Electrocardiogram Signals to Assess Zebrafih Heart Regeneration: Implication of Long QT Intervals

Impact of Ambulation in Wearable-ECG

Electrocardiographic Signals and Swarm-Based Support Vector Machine for Hypoglycemia Detection

A Comparison of Single Channel Fetal ECG Extraction Methods

Capacitive Measurement of ECG for Ubiquitous Healthcare

Baseline Characteristics of Dual-Axis Cervical Accelerometry Signals

Tissue Artifact Removal from Respiratory Signals Based on Empirical Mode Decomposition

Feature Factory: Crowd Sourced Feature Discovery

Special Issues

Crowd-Sourced Annotation of ECG Signals Using Contextual Information

Similar Documents

Electrocardiogram Signals to Assess Zebrafih Heart Regeneration: Implication of Long QT Intervals

Impact of Ambulation in Wearable-ECG

Electrocardiographic Signals and Swarm-Based Support Vector Machine for Hypoglycemia Detection

A Comparison of Single Channel Fetal ECG Extraction Methods

Capacitive Measurement of ECG for Ubiquitous Healthcare

Baseline Characteristics of Dual-Axis Cervical Accelerometry Signals

Tissue Artifact Removal from Respiratory Signals Based on Empirical Mode Decomposition

Feature Factory: Crowd Sourced Feature Discovery

Special Issues

Crowd-Sourced Annotation of ECG Signals Using Contextual Information