NDLI: Video-based assessment (VBA) of an open, simulated orthopedic surgical procedure: a pilot study using a single-angle camera to assess surgical skill and decision making

Content Provider	Springer Nature : BioMed Central
Author	Al-Hubaishi, Obaid Hillier, Troy Gillis, Megan Oxner, William Trenholm, Andrew Richardson, Glen Leighton, Ross Glennie, Andrew
Abstract	Background Videos have been used in many settings including medical simulation. Limited information currently exists on video-based assessment in surgical training. Effective assessment tools have substantial impact on the future of training. The objectives of this study were as follows: to evaluate the inter-rater reliability of video-based assessment of orthopedic surgery residents performing open cadaveric simulation procedures and to explore the benefits and limitations of video-based assessment. Methods A multi-method technique was used. In the quantitative portion, four residents participated in a Surgical Objective Structured Clinical Examination in 2017 at a quaternary care training center. A single camera bird’s-eye view was used to videotape the procedures. Five orthopedic surgeons evaluated the surgical videos using the Ottawa Surgical Competency Operating Room Evaluation. Interclass correlation coefficient was used to calculate inter-rater reliability. In the qualitative section, semi-structured interviews were used to explore the perceived strengths and limitations of video-based assessment. Results and discussion The scores using video-based assessment demonstrated good inter-rater reliability (ICC = 0.832, p = 0.014) in assessing open orthopedic procedures on cadavers. Qualitatively, the strengths of video-based assessment in this study are its ability to assess global performance and/or specific skills, ability to reassess missed points during live assessment, and potential use for less common procedures. It also allows for detailed constructive feedback, flexible assessment time, anonymous assessment, multiple assessors and serves as a good coaching tool. The main limitations of video-based assessment are poor audio–video quality, and questionable feasibility for assessing readiness for practice. Conclusion Video-based assessment is a potential adjunct to live assessment in orthopedic open procedures with good inter-rater reliability. Improving audio–video quality will enhance the quality of the assessment and improve the effectiveness of using this tool in surgical training.
Related Links	https://josr-online.biomedcentral.com/counter/pdf/10.1186/s13018-023-03557-3.pdf
Ending Page	8
Page Count	8
Starting Page	1
File Format	HTM / HTML
DOI	10.1186/s13018-023-03557-3
Journal	Journal of Orthopaedic Surgery and Research
Issue Number	1
Volume Number	18
Language	English
Publisher	BioMed Central
Publisher Date	2023-02-07
Access Restriction	Open
Subject Keyword	Orthopedics Surgical Orthopedics Video-based assessment Orthopedic surgery Medical education Competency-Based Medical Education
Content Type	Text
Resource Type	Article
Subject	Surgery Orthopedics and Sports Medicine
Journal Impact Factor	2.8/2023
5-Year Journal Impact Factor	3/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Assessment of technical skill in hip fracture surgery using the postoperative radiograph: pilot development and validation of a final product analysis core outcome set

Risk assessment and decision-making for patients undergoing orthopedic surgery

"Sawbones": A pilot study assessing simulation-based orthopedic training for medical students.

First Use of a Brief 60-second Mindfulness Exercise in an Orthopedic Surgical Practice; Results from a Pilot Study.

First Use of a Brief 60-second Mindfulness Exercise in an Orthopedic Surgical Practice; Results from a Pilot Study.

Resident Education on the Surgical Treatment of Distal Radius Fractures Using a Point-of-View Camera.

The dawn of a new competency-based training era: a 70-year perspective on post-graduate training reform in trauma and orthopaedic surgery

Learning assessment toolkit.

Reshaping orthopaedic resident education in systems-based practice.

Video-based assessment (VBA) of an open, simulated orthopedic surgical procedure: a pilot study using a single-angle camera to assess surgical skill and decision making

Similar Documents

Assessment of technical skill in hip fracture surgery using the postoperative radiograph: pilot development and validation of a final product analysis core outcome set

Risk assessment and decision-making for patients undergoing orthopedic surgery

"Sawbones": A pilot study assessing simulation-based orthopedic training for medical students.

First Use of a Brief 60-second Mindfulness Exercise in an Orthopedic Surgical Practice; Results from a Pilot Study.

First Use of a Brief 60-second Mindfulness Exercise in an Orthopedic Surgical Practice; Results from a Pilot Study.

Resident Education on the Surgical Treatment of Distal Radius Fractures Using a Point-of-View Camera.

The dawn of a new competency-based training era: a 70-year perspective on post-graduate training reform in trauma and orthopaedic surgery

Learning assessment toolkit.

Reshaping orthopaedic resident education in systems-based practice.

Video-based assessment (VBA) of an open, simulated orthopedic surgical procedure: a pilot study using a single-angle camera to assess surgical skill and decision making