NDLI: Measuring case severity: a novel tool for benchmarking and clinical documentation improvement

Content Provider	Springer Nature : BioMed Central
Author	Xiang, Jie Durance, Paul W. Griffes, Louisa C. Chen, Yalei Bakshi, Rishi R.
Abstract	Background Severity of illness (SOI) is an All Patients Refined Diagnosis Related Groups (APR DRG) modifier based on comorbidity capture. Tracking SOI helps hospitals improve performance and resource distribution. Furthermore, benchmarking SOI plays a key role in Quality Improvement (QI) efforts such as Clinical Documentation Improvement (CDI) programs. The current SOI system highly relies on the 3 M APR DRG grouper that is updated annually, making it difficult to track severity longitudinally and benchmark against hospitals with different patient populations. Here, we describe an alternative SOI scoring system that is grouper-independent and that can be tracked longitudinally. Methods Admission data for 2019–2020 U.S. News and World Report Honor Roll facilities were downloaded from the Vizient Clinical Database and split into training and testing datasets. Elixhauser comorbidities, body systems developed from the Healthcare Cost and Utilization Project (HCUP), and ICD-10-CM complication and comorbidity (CC/MCC) indicators were selected as the predictors for orthogonal polynomial regression models to predict patients’ admission and discharge SOI. Receiver operating characteristic (ROC) and Precision-Recall (PR) analysis, and prediction accuracy were used to evaluate model performance. Results In the training dataset, the full model including both Elixhauser comorbidities and body system CC/MCC indicators had the highest ROC AUC, PR AUC and predication accuracy for both admission (ROC AUC: 92.9%; PR AUC: 91.0%; prediction accuracy: 85.4%) and discharge SOI (ROC AUC: 93.6%; PR AUC: 92.8%; prediction accuracy: 86.2%). The model including only body system CC/MCC indicators had similar performance for admission (ROC AUC: 92.4%; PR AUC: 90.4%; prediction accuracy: 84.8%) and discharge SOI (ROC AUC: 93.1%; PR AUC: 92.2%; prediction accuracy: 85.6%) as the full model. The model including only Elixhauser comorbidities exhibited the lowest performance. Similarly, in the validation dataset, the prediction accuracy was 86.2% for the full model, 85.6% for the body system model, and 79.3% for the comorbidity model. With fewer variables and less model complexity, the body system model was more efficient and was determined to be the optimal model. The probabilities generated from this model, named J_Score and J_Score_POA, successfully measured SOI and had practical applications in assessment of CDI performance. Conclusions The J_Scores generated from the body system model have significant value in evaluating admission and discharge severity of illness. We believe that this new scoring system will provide a useful tool for healthcare institutions to benchmark patients’ illness severity and augment Quality Improvement (QI) efforts.
Related Links	https://bmchealthservres.biomedcentral.com/counter/pdf/10.1186/s12913-022-07935-1.pdf
Ending Page	9
Page Count	9
Starting Page	1
File Format	HTM / HTML
ISSN	14726963
DOI	10.1186/s12913-022-07935-1
Journal	BMC Health Services Research
Issue Number	1
Volume Number	22
Language	English
Publisher	BioMed Central
Publisher Date	2022-04-15
Access Restriction	Open
Subject Keyword	Public Health Health Administration Health Informatics Nursing Research Severity of Illness APR DRG Body Systems Elixhauser Comorbidities J Scores Benchmark Clinical Documentation Improvement
Content Type	Text
Resource Type	Article
Subject	Health Policy

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Hospital financing of ischaemic stroke: determinants of funding and usefulness of DRG subcategories based on severity of illness

Predicting red blood cell transfusion in hospitalized patients: role of hemoglobin level, comorbidities, and illness severity

Incorporating clinical and demographic data into the Elixhauser Comorbidity Model: deriving and validating an enhanced model in a tertiary hospital’s internal medicine department

Development of a benchmark tool for cancer centers; results from a pilot exercise

Roles of disease severity and post-discharge outpatient visits as predictors of hospital readmissions

Refined French DRG with four severity levels

Variability of nursing care by APR-DRG and by severity of illness in a sample of nine Belgian hospitals

Measuring implementation: development of the implementation process assessment tool (IPAT)

Lower comorbidity scores and severity levels in Veterans Health Administration hospitals: a cross-sectional study

Measuring case severity: a novel tool for benchmarking and clinical documentation improvement

Similar Documents

Hospital financing of ischaemic stroke: determinants of funding and usefulness of DRG subcategories based on severity of illness

Predicting red blood cell transfusion in hospitalized patients: role of hemoglobin level, comorbidities, and illness severity

Incorporating clinical and demographic data into the Elixhauser Comorbidity Model: deriving and validating an enhanced model in a tertiary hospital’s internal medicine department

Development of a benchmark tool for cancer centers; results from a pilot exercise

Roles of disease severity and post-discharge outpatient visits as predictors of hospital readmissions

Refined French DRG with four severity levels

Variability of nursing care by APR-DRG and by severity of illness in a sample of nine Belgian hospitals

Measuring implementation: development of the implementation process assessment tool (IPAT)

Lower comorbidity scores and severity levels in Veterans Health Administration hospitals: a cross-sectional study

Measuring case severity: a novel tool for benchmarking and clinical documentation improvement