NDLI: Five-year fidelity assessment of an evidence-based parenting program (GenerationPMTO): inter-rater reliability following international implementation

Content Provider	Springer Nature : BioMed Central
Author	Sigmarsdóttir, Margrét Rodríguez, Melanie M. Domenech Gewirtz, Abigail Rains, Laura Tjaden, Jolle Forgatch, Marion S.
Abstract	Background Implementing evidence-based programs in community service settings introduces the challenge of ensuring sustained fidelity to the original program. We employ a fidelity measure based on direct observation of practitioners’ competence and adherence to the evidence-based parenting program (EBPP) GenerationPMTO following installation in national and international sites. Fidelity monitoring is crucial, especially when the program purveyor transfers administration of the program to the community as was done in this case. In previous studies, the Fidelity of Implementation rating system (FIMP) was used to evaluate practitioners’ fidelity to the GenerationPMTO intervention in six countries following implementation showing high levels of adherence up to 17 years post certification. Other studies showed FIMP to have predictive validity. The present study provides inter-rater reliability data for this fidelity tool across teams of the purveyor, Implementation Sciences International, Inc./ISII, and national and international sites over a five-year period. Methods Data assess inter-rater reliability in terms of percent agreement and intraclass correlation (ICC) for the purveyor’s two fidelity teams and the fidelity teams in seven implementation sites. Results Results report stable good to excellent levels of inter-rater reliability and ICCs as well as good attendance at fidelity meetings for all fidelity teams. Conclusions This observational method of assessing fidelity post implementation is a promising approach to enable EBPPs to be transferred safely from purveyors to communities while maintaining reliable fidelity to the intervention.
Related Links	https://bmchealthservres.biomedcentral.com/counter/pdf/10.1186/s12913-023-09611-4.pdf
Ending Page	12
Page Count	12
Starting Page	1
File Format	HTM / HTML
ISSN	14726963
DOI	10.1186/s12913-023-09611-4
Journal	BMC Health Services Research
Issue Number	1
Volume Number	23
Language	English
Publisher	BioMed Central
Publisher Date	2023-06-05
Access Restriction	Open
Subject Keyword	Public Health Health Administration Health Informatics Nursing Research Implementation Fidelity Evidence-based parenting program GenerationPMTO
Content Type	Text
Resource Type	Article
Subject	Health Policy

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Changes in practitioners’ attitudes, perceived training needs and self-efficacy over the implementation process of an evidence-based parenting program

Intra- and inter-rater reliability of an electronic health record audit used in a chiropractic teaching clinic system: an observational study

Inter-rater reliability of nursing home quality indicators in the U.S

Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol

Perspectives on program mis-implementation among U.S. local public health departments

Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program

An instrument for quality assurance in work capacity evaluation: development, evaluation, and inter-rater reliability

Assessing fidelity to evidence-based quality improvement as an implementation strategy for patient-centered medical home transformation in the Veterans Health Administration

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Five-year fidelity assessment of an evidence-based parenting program (GenerationPMTO): inter-rater reliability following international implementation

Similar Documents

Changes in practitioners’ attitudes, perceived training needs and self-efficacy over the implementation process of an evidence-based parenting program

Intra- and inter-rater reliability of an electronic health record audit used in a chiropractic teaching clinic system: an observational study

Inter-rater reliability of nursing home quality indicators in the U.S

Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol

Perspectives on program mis-implementation among U.S. local public health departments

Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program

An instrument for quality assurance in work capacity evaluation: development, evaluation, and inter-rater reliability

Assessing fidelity to evidence-based quality improvement as an implementation strategy for patient-centered medical home transformation in the Veterans Health Administration

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Five-year fidelity assessment of an evidence-based parenting program (GenerationPMTO): inter-rater reliability following international implementation