NDLI: Psychometric evaluation of a pragmatic measure of clinical supervision as an implementation strategy

Content Provider	Springer Nature : BioMed Central
Author	Choy-Brown, Mimi Williams, Nathaniel J. Ramirez, Nallely Esp, Susan
Abstract	Background Valid and reliable measurement of implementation strategies is essential to advancing implementation science; however, this area lags behind the measurement of implementation outcomes and determinants. Clinical supervision is a promising and highly feasible implementation strategy in behavioral healthcare for which pragmatic measures are lacking. This research aimed to develop and psychometrically evaluate a pragmatic measure of clinical supervision conceptualized in terms of two broadly applicable, discrete clinical supervision techniques shown to improve providers’ implementation of evidence-based psychosocial interventions—(1) audit and feedback and (2) active learning. Methods Items were generated based on a systematic review of the literature and administered to a sample of 154 outpatient mental health clinicians serving youth and 181 community-based mental health providers serving adults. Scores were evaluated for evidence of reliability, structural validity, construct-related validity, and measurement invariance across the two samples. Results In sample 1, confirmatory factor analysis (CFA) supported the hypothesized two-factor structure of scores on the Evidence-Based Clinical Supervision Strategies (EBCSS) scale (χ2=5.89, df=4, p=0.208; RMSEA=0.055, CFI=0.988, SRMR=0.033). In sample 2, CFA replicated the EBCSS factor structure and provided discriminant validity evidence relative to an established supervisory alliance measure (χ2=36.12, df=30, p=0.204; RMSEA=0.034; CFI=0.990; SRMR=0.031). Construct-related validity evidence was provided by theoretically concordant associations between EBCSS subscale scores and agency climate for evidence-based practice implementation in sample 1 (d= .47 and .55) as well as measures of the supervision process in sample 2. Multiple group CFA supported the configural, metric, and partial scalar invariance of scores on the EBCSS across the two samples. Conclusions Scores on the EBCSS provide a valid basis for inferences regarding the extent to which behavioral health providers experience audit and feedback and active learning as part of their clinical supervision in both clinic- and community-based behavioral health settings. Trial registration ClinicalTrials.gov NCT04096274 . Registered on 19 September 2019.
Related Links	https://implementationsciencecomms.biomedcentral.com/counter/pdf/10.1186/s43058-023-00419-1.pdf
Ending Page	14
Page Count	14
Starting Page	1
File Format	HTM / HTML
ISSN	26622211
DOI	10.1186/s43058-023-00419-1
Journal	Implementation Science Communications
Issue Number	1
Volume Number	4
Language	English
Publisher	BioMed Central
Publisher Date	2023-04-06
Access Restriction	Open
Subject Keyword	Health Services Research Public Health Health Policy Health Administration Health Promotion and Disease Prevention Evidence-based practice Implementation Clinical supervision Measure development
Content Type	Text
Resource Type	Article
Subject	Health Policy Public Health, Environmental and Occupational Health Health Informatics

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Advancing implementation science through measure development and evaluation: a study protocol

Lessons learned about the effective operationalization of champions as an implementation strategy: results from a qualitative process evaluation of a pragmatic trial

Pragmatic approaches to analyzing qualitative data for implementation science: an introduction

Development and psychometric evaluation of the Implementation Support Competencies Assessment

An exposure-based implementation strategy to decrease clinician anxiety about implementing suicide prevention evidence-based practices: protocol for development and pilot testing (Project CALMER)

The Evidence-based Practice Attitude Scale-36 (EBPAS-36): a brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples

Assessing fidelity to evidence-based quality improvement as an implementation strategy for patient-centered medical home transformation in the Veterans Health Administration

Sustainable implementation efforts in physio- and occupational therapy: a scoping review

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Psychometric evaluation of a pragmatic measure of clinical supervision as an implementation strategy

Similar Documents

Advancing implementation science through measure development and evaluation: a study protocol

Lessons learned about the effective operationalization of champions as an implementation strategy: results from a qualitative process evaluation of a pragmatic trial

Pragmatic approaches to analyzing qualitative data for implementation science: an introduction

Development and psychometric evaluation of the Implementation Support Competencies Assessment

An exposure-based implementation strategy to decrease clinician anxiety about implementing suicide prevention evidence-based practices: protocol for development and pilot testing (Project CALMER)

The Evidence-based Practice Attitude Scale-36 (EBPAS-36): a brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples

Assessing fidelity to evidence-based quality improvement as an implementation strategy for patient-centered medical home transformation in the Veterans Health Administration

Sustainable implementation efforts in physio- and occupational therapy: a scoping review

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Psychometric evaluation of a pragmatic measure of clinical supervision as an implementation strategy