NDLI: Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury – a comparison of an image extraction and classification system to expert scoring

Content Provider	Springer Nature : BioMed Central
Author	Mobbs, Ashleigh Kahn, Michelle Williams, Gavin Mentiplay, Benjamin F. Pua, Yong-Hao Clark, Ross A.
Abstract	Background Walking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI. Methods Frontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut™ and calculate two-dimensional kinematic joint angles. Assessment scores from three experienced neurorehabilitation clinicians were used with these joint angles to train random forest networks with nested cross-validation to predict assessor scores for all videos. Agreement between unseen participant (i.e. test group participants that were not used to train the model) predictions and each individual assessor’s scores were compared using quadratic weighted kappa. One sample t-tests (to determine over/underprediction against clinician ratings) and one-way ANOVA (to determine differences between networks) were applied to the four networks. Results The machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen’s d range = 0.156 to 0.217). Conclusions This study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.
Related Links	https://jneuroengrehab.biomedcentral.com/counter/pdf/10.1186/s12984-024-01406-w.pdf
Ending Page	11
Page Count	11
Starting Page	1
File Format	HTM / HTML
ISSN	17430003
DOI	10.1186/s12984-024-01406-w
Journal	Journal of NeuroEngineering and Rehabilitation
Issue Number	1
Volume Number	21
Language	English
Publisher	BioMed Central
Publisher Date	2024-07-23
Access Restriction	Open
Subject Keyword	Neurosciences Neurology Rehabilitation Medicine Biomedical Engineering and Bioengineering
Content Type	Text
Resource Type	Article
Subject	Health Informatics Rehabilitation
Journal Impact Factor	5.2/2023
5-Year Journal Impact Factor	5.6/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests

Automatic ML-based vestibular gait classification: examining the effects of IMU placement and gait task selection

The nature and extent of upper limb associated reactions during walking in people with acquired brain injury

Self-reported gait unsteadiness in mildly impaired neurological patients: an objective assessment through statistical gait analysis

Control strategies used in lower limb exoskeletons for gait rehabilitation after brain injury: a systematic review and analysis of clinical effectiveness

Quantitative gait analysis under dual-task in older people with mild cognitive impairment: a reliability study

Prediction of gait recovery in spinal cord injured individuals trained with robotic gait orthosis

Visual processing speed in hemianopia patients secondary to acquired brain injury: a new assessment methodology

Wearable fall risk assessment by discriminating recessive weak foot individual

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury – a comparison of an image extraction and classification system to expert scoring

Similar Documents

Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests

Automatic ML-based vestibular gait classification: examining the effects of IMU placement and gait task selection

The nature and extent of upper limb associated reactions during walking in people with acquired brain injury

Self-reported gait unsteadiness in mildly impaired neurological patients: an objective assessment through statistical gait analysis

Control strategies used in lower limb exoskeletons for gait rehabilitation after brain injury: a systematic review and analysis of clinical effectiveness

Quantitative gait analysis under dual-task in older people with mild cognitive impairment: a reliability study

Prediction of gait recovery in spinal cord injured individuals trained with robotic gait orthosis

Visual processing speed in hemianopia patients secondary to acquired brain injury: a new assessment methodology

Wearable fall risk assessment by discriminating recessive weak foot individual

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury – a comparison of an image extraction and classification system to expert scoring