NDLI: Assessing communication skills during OSCE: need for integrated psychometric approaches

Content Provider	Springer Nature : BioMed Central
Author	Piumatti, Giovanni Cerutti, Bernard Perron, Noëlle Junod
Abstract	Background Physicians’ communication skills (CS) are known to significantly affect the quality of health care. Communication skills training programs are part of most undergraduate medical curricula and are usually assessed in Objective Structured Clinical Examinations (OSCE) throughout the curriculum. The adoption of reliable measurement instruments is thus essential to evaluate such skills. Methods Using Exploratory Factor Analysis (EFA), Multi-Group Confirmatory Factor Analysis (MGCFA) and Item Response Theory analysis (IRT) the current retrospective study tested the factorial validity and reliability of a four-item global rating scale developed by Hodges and McIlroy to measure CS among 296 third- and fourth-year medical students at the Faculty of Medicine in Geneva, Switzerland, during OSCEs. Results EFA results at each station showed good reliability scores. However, measurement invariance assessments through MGCFA across different stations (i.e., same students undergoing six or three stations) and across different groups of stations (i.e., different students undergoing groups of six or three stations) were not satisfactory, failing to meet the minimum requirements to establish measurement invariance and thus possibly affecting reliable comparisons between students’ communication scores across stations. IRT revealed that the four communication items provided overlapping information focusing especially on high levels of the communication spectrum. Conclusions Using this four-item set in its current form it may be difficult to adequately differentiate between students who are poor in CS from those who perform better. Future directions in best-practices to assess CS among medical students in the context of OSCE may thus focus on (1) training examiners so to obtain scores that are more coherent across stations; and (2) evaluating items in terms of their ability to cover a wider spectrum of medical students’ CS. In this respect, IRT can prove to be very useful for the continuous evaluation of CS measurement instruments in performance-based assessments.
Related Links	https://bmcmededuc.biomedcentral.com/counter/pdf/10.1186/s12909-021-02552-8.pdf
Ending Page	10
Page Count	10
Starting Page	1
File Format	HTM / HTML
ISSN	14726920
DOI	10.1186/s12909-021-02552-8
Journal	BMC Medical Education
Issue Number	1
Volume Number	21
Language	English
Publisher	BioMed Central
Publisher Date	2021-02-16
Access Restriction	Open
Subject Keyword	Medical Education Theory of Medicine Bioethics Communication assessment OSCE Item response theory Measurement invariance Theory of Medicine/Bioethics
Content Type	Text
Resource Type	Article
Subject	Education Medicine
Journal Impact Factor	2.7/2023
5-Year Journal Impact Factor	3.4/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Assessing the utility and efficacy of e-OSCE among undergraduate medical students during the COVID-19 pandemic

Assessing clinical communication skills in physicians: are the skills context specific or generalizable

Optimizing a national examination for medical undergraduates via modern automated test assembly approaches

Simulated consultations: a sociolinguistic perspective

Communication skills of medical students during the OSCE: Gender-specific differences in a longitudinal trend study

Comparison of self and simulated patient assessments of first-year medical students’ Interpersonal and Communication Skills (ICS) during Objective Structured Clinical Examinations (OSCE)

Assessment of life support skills of resident dentists using OSCE: cross-sectional survey

Validation of the 5-item doctor-patient communication competency instrument for medical students (DPCC-MS) using two years of assessment data

Undertaking a high stakes virtual OSCE (“VOSCE”) during Covid-19

Assessing communication skills during OSCE: need for integrated psychometric approaches

Similar Documents

Assessing the utility and efficacy of e-OSCE among undergraduate medical students during the COVID-19 pandemic

Assessing clinical communication skills in physicians: are the skills context specific or generalizable

Optimizing a national examination for medical undergraduates via modern automated test assembly approaches

Simulated consultations: a sociolinguistic perspective

Communication skills of medical students during the OSCE: Gender-specific differences in a longitudinal trend study

Comparison of self and simulated patient assessments of first-year medical students’ Interpersonal and Communication Skills (ICS) during Objective Structured Clinical Examinations (OSCE)

Assessment of life support skills of resident dentists using OSCE: cross-sectional survey

Validation of the 5-item doctor-patient communication competency instrument for medical students (DPCC-MS) using two years of assessment data

Undertaking a high stakes virtual OSCE (“VOSCE”) during Covid-19

Assessing communication skills during OSCE: need for integrated psychometric approaches