NDLI: eOSCE stations live versus remote evaluation and scores variability

Content Provider	Springer Nature : BioMed Central
Author	Bouzid, Donia Mullaert, Jimmy Ghazali, Aiham Ferré, Valentine Marie Mentré, France Lemogne, Cédric Ruszniewski, Philippe Faye, Albert Dinh, Alexy Tran Mirault, Tristan
Abstract	Background Objective structured clinical examinations (OSCEs) are known to be a fair evaluation method. These recent years, the use of online OSCEs (eOSCEs) has spread. This study aimed to compare remote versus live evaluation and assess the factors associated with score variability during eOSCEs. Methods We conducted large-scale eOSCEs at the medical school of the Université de Paris Cité in June 2021 and recorded all the students’ performances, allowing a second evaluation. To assess the agreement in our context of multiple raters and students, we fitted a linear mixed model with student and rater as random effects and the score as an explained variable. Results One hundred seventy observations were analyzed for the first station after quality control. We retained 192 and 110 observations for the statistical analysis of the two other stations. The median score and interquartile range were 60 out of 100 (IQR 50–70), 60 out of 100 (IQR 54–70), and 53 out of 100 (IQR 45–62) for the three stations. The score variance proportions explained by the rater (ICC rater) were 23.0, 16.8, and 32.8%, respectively. Of the 31 raters, 18 (58%) were male. Scores did not differ significantly according to the gender of the rater (p = 0.96, 0.10, and 0.26, respectively). The two evaluations showed no systematic difference in scores (p = 0.92, 0.053, and 0.38, respectively). Conclusion Our study suggests that remote evaluation is as reliable as live evaluation for eOSCEs.
Related Links	https://bmcmededuc.biomedcentral.com/counter/pdf/10.1186/s12909-022-03919-1.pdf
Ending Page	6
Page Count	6
Starting Page	1
File Format	HTM / HTML
ISSN	14726920
DOI	10.1186/s12909-022-03919-1
Journal	BMC Medical Education
Issue Number	1
Volume Number	22
Language	English
Publisher	BioMed Central
Publisher Date	2022-12-13
Access Restriction	Open
Subject Keyword	Medical Education Theory of Medicine Bioethics Interrater reliability Remote objective structured clinical examination Global ratings Theory of Medicine/Bioethics
Content Type	Text
Resource Type	Article
Subject	Education Medicine
Journal Impact Factor	2.7/2023
5-Year Journal Impact Factor	3.4/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Impact of station number and duration time per station on the reliability of Objective Structured Clinical Examination (OSCE) scores: a systematic review and meta-analysis

Validity evidence for two objective structured clinical examination stations to evaluate core skills of the shoulder and knee assessment

Situational awareness within objective structured clinical examination stations in undergraduate medical training - a literature search

Examining validity and reliability of objective structured clinical examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

Conducting an objective structured clinical examination under COVID-restricted conditions

Perception of undergraduate medical students and examiners towards grand objective structured clinical examination

Inter-Rater Reliability: Comparison of Checklist and Global Scoring for OSCEs

Objective structured clinical examination versus traditional written examinations: a prospective observational study

Scoring consistency of standard patients and examiners in the developed dental objective structured clinical examination system

eOSCE stations live versus remote evaluation and scores variability

Similar Documents

Impact of station number and duration time per station on the reliability of Objective Structured Clinical Examination (OSCE) scores: a systematic review and meta-analysis

Validity evidence for two objective structured clinical examination stations to evaluate core skills of the shoulder and knee assessment

Situational awareness within objective structured clinical examination stations in undergraduate medical training - a literature search

Examining validity and reliability of objective structured clinical examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

Conducting an objective structured clinical examination under COVID-restricted conditions

Perception of undergraduate medical students and examiners towards grand objective structured clinical examination

Inter-Rater Reliability: Comparison of Checklist and Global Scoring for OSCEs

Objective structured clinical examination versus traditional written examinations: a prospective observational study

Scoring consistency of standard patients and examiners in the developed dental objective structured clinical examination system

eOSCE stations live versus remote evaluation and scores variability