NDLI: srBERT: automatic article classification model for systematic review using BERT

Content Provider	Springer Nature : BioMed Central
Author	Aum, Sungmin Choe, Seon
Abstract	Background Systematic reviews (SRs) are recognized as reliable evidence, which enables evidence-based medicine to be applied to clinical practice. However, owing to the significant efforts required for an SR, its creation is time-consuming, which often leads to out-of-date results. To support SR tasks, tools for automating these SR tasks have been considered; however, applying a general natural language processing model to domain-specific articles and insufficient text data for training poses challenges. Methods The research objective is to automate the classification of included articles using the Bidirectional Encoder Representations from Transformers (BERT) algorithm. In particular, srBERT models based on the BERT algorithm are pre-trained using abstracts of articles from two types of datasets, and the resulting model is then fine-tuned using the article titles. The performances of our proposed models are compared with those of existing general machine-learning models. Results Our results indicate that the proposed srBERTmy model, pre-trained with abstracts of articles and a generated vocabulary, achieved state-of-the-art performance in both classification and relation-extraction tasks; for the first task, it achieved an accuracy of 94.35% (89.38%), F1 score of 66.12 (78.64), and area under the receiver operating characteristic curve of 0.77 (0.9) on the original and (generated) datasets, respectively. In the second task, the model achieved an accuracy of 93.5% with a loss of 27%, thereby outperforming the other evaluated models, including the original BERT model. Conclusions Our research shows the possibility of automatic article classification using machine-learning approaches to support SR tasks and its broad applicability. However, because the performance of our model depends on the size and class ratio of the training dataset, it is important to secure a dataset of sufficient quality, which may pose challenges.
Related Links	https://systematicreviewsjournal.biomedcentral.com/counter/pdf/10.1186/s13643-021-01763-w.pdf
Ending Page	8
Page Count	8
Starting Page	1
File Format	HTM / HTML
ISSN	20464053
DOI	10.1186/s13643-021-01763-w
Journal	Systematic Reviews
Issue Number	1
Volume Number	10
Language	English
Publisher	BioMed Central
Publisher Date	2021-10-30
Access Restriction	Open
Subject Keyword	Medicine Public Health Biomedicine Statistics for Life Sciences Health Sciences Systematic review Process automation Deep learning Text mining Medicine/Public Health
Content Type	Text
Resource Type	Article
Subject	Medicine
Journal Impact Factor	6.3/2023
5-Year Journal Impact Factor	4.5/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Text mining to support abstract screening for knowledge syntheses: a semi-automated workflow

Systematic review automation technologies

Using text mining for study identification in systematic reviews: a systematic review of current approaches

Ensemble of deep learning language models to support the creation of living systematic reviews for the COVID-19 literature

Supporting systematic reviews using LDA-based document representations

Introducing RAPTOR: RevMan Parsing Tool for Reviewers

Automation of systematic reviews of biomedical literature: a scoping review of studies indexed in PubMed

Editorial: Systematic review automation thematic series

Automation of duplicate record detection for systematic reviews: Deduplicator

srBERT: automatic article classification model for systematic review using BERT

Similar Documents

Text mining to support abstract screening for knowledge syntheses: a semi-automated workflow

Systematic review automation technologies

Using text mining for study identification in systematic reviews: a systematic review of current approaches

Ensemble of deep learning language models to support the creation of living systematic reviews for the COVID-19 literature

Supporting systematic reviews using LDA-based document representations

Introducing RAPTOR: RevMan Parsing Tool for Reviewers

Automation of systematic reviews of biomedical literature: a scoping review of studies indexed in PubMed

Editorial: Systematic review automation thematic series

Automation of duplicate record detection for systematic reviews: Deduplicator

srBERT: automatic article classification model for systematic review using BERT