Development and validation for evaluation of an evaluation tool for guideline implementation_Chinese Journal of Evidence-Based Medicine

Authors：

JIN Yinghui ¹ , ZHAO Zhihui ² , HUANG Canran ² , HUANG Di ¹ , WANG Yunyun ¹ , YAN Siyu ¹ , HUANG Qiao ¹ , LI Xuhui ¹ , HUANG Chao ³ ,  WANG Qiang ³ , ZENG Xiantao ¹

1. Center for Evidence-Based and Translational Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, P.R.China;
2. School of Health Sciences, Wuhan University, Wuhan 430071, P.R.China;
3. National Center for Medical Service Administration, National Health and Family Planning Commission, Beijing 100044, P.R.China;

Corresponding?author：

WANG Qiang, Email: zengxiantao1128@163.com

Keywords：

Clinical practice guideline; Implementation; Evaluation tool

DOI：

10.7507/1672-2531.202106002

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Objective The ultimate goal of developing guidelines is for using them in clinical practice. In this study, an implementation evaluation tool was developed to promote the overall evaluation of guidelines and to improve their promotion and implementation. Methods The research group set up a team to formulate and establish a guideline implementation evaluation tool, through preliminary research, interviews, a systematic review of relevant literature, two expert consensus meetings and two Delphi expert consensus meetings to evaluate the guideline implementation tool. Experts were invited to give opinions and grades on the fields, items and overall implementation evaluation method of the tool. Results The evaluation tool for the implementation of guidelines included 5 fields, accessibility, communicability, performability, recognizability and applicability, with a total of 7 items. The scale-level CVIs in two rounds of Delphi expert consensus were 0.91 and 0.93. We collected opinions and suggestions and made some revisions and insertions without deleting any items based on the parameter that no items fulfilled the standard if mean <3.5, coefficient of variation >15% and I-CVI<0.78. Conclusion In this study, in order to provide a standard and method for the evaluation of guideline implementation, a guideline implementation evaluation tool has been developed and evaluated by clinically-related physicians and guideline formulation methodology experts. The guideline implementation evaluation tool presents satisfactory face and content validity. Empirical research is needed to verify the tool’s performance in evaluating guideline implementation.

Citation： JIN Yinghui, ZHAO Zhihui, HUANG Canran, HUANG Di, WANG Yunyun, YAN Siyu, HUANG Qiao, LI Xuhui, HUANG Chao, WANG Qiang, ZENG Xiantao. Development and validation for evaluation of an evaluation tool for guideline implementation. Chinese Journal of Evidence-Based Medicine, 2022, 22(1): 111-119. doi: 10.7507/1672-2531.202106002 Copy

1.	中華人民共和國中央人民政府. 關于加強衛生與健康科技成果轉移轉化工作的指導意見. Available at: http://www.gov.cn/xinwen/2016-10/12/content_5117948.htm.
2.	中華人民共和國中央人民政府. 中共中央國務院印發《“健康中國2030”規劃綱要》. Available at: http://www.gov.cn/xinwen/2016-10/25/content_5124174.htm.
3.	Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington (DC): National Academies Press (US); 2011.
4.	Institute of Medicine (US) Committee on Clinical Practice Guidelines. Guidelines for clinical practice: from development to use. Washington (DC): National Academies Press (US); 1992.
5.	Jin Y, Li Z, Han F, et al. Barriers and enablers for the implementation of clinical practice guidelines in China: a mixed-method study. BMJ Open, 2019, 9(9): e026328.
6.	Jin YH, Tan LM, Khan KS, et al. Determinants of successful guideline implementation: a national cross-sectional survey. BMC Med Inform Decis Mak, 2021, 21(1): 19.
7.	吳明隆. 問卷統計分析實務——SPSS操作與應用. 重慶: 重慶大學出版社, 2010.
8.	靳英輝, 鄧通, 曾憲濤, 等. 臨床實踐指南制訂方法——指南的實施工具. 中國循證心血管醫學雜志, 2019, 11(10): 1157-1161.
9.	靳英輝, 鄧通, 曾憲濤, 等. 臨床實踐指南制訂方法——指南的實施與轉化. 中國循證心血管醫學雜志, 2019, 11(9): 1040-1042,1046.
10.	史靜琤, 莫顯昆, 孫振球. 量表編制中內容效度指數的應用. 中南大學學報(醫學版), 2012, 37(2): 152-155.
11.	華琳, 閻巖, 張建. 關于對診斷一致性Kappa系統的探討. 數理醫藥學雜志, 2006, 19(5): 518-520.
12.	趙俊強. 引入復雜科學理念, 推動實施科學研究范式的多樣化. 醫學新知, 2020, 30(5): 364-375.
13.	Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 2017, 358: j4008.
14.	Vandvik PO, Brandt L, Alonso-Coello P, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest, 2013, 144(2): 381-389.
15.	Siemieniuk RA, Agoritsas T, Macdonald H, et al. Introduction to BMJ rapid recommendations. BMJ, 2016, 354: i5191.
16.	曾可. 基于本體技術的中文臨床指南計算機化研究. 武漢: 華中科技大學, 2017.
17.	趙志娟, 趙玉虹. 文本臨床指南轉變為數字化臨床指南發展現狀及趨勢. 中國數字醫學, 2017, 12(1): 32-34.
18.	覃露, 徐曉巍, 丁玲玲, 等. 面向決策支持的臨床指南知識表示方法研究. 中華醫學圖書情報雜志, 2020, 29(2): 1-8.

1. 中華人民共和國中央人民政府. 關于加強衛生與健康科技成果轉移轉化工作的指導意見. Available at: http://www.gov.cn/xinwen/2016-10/12/content_5117948.htm.
2. 中華人民共和國中央人民政府. 中共中央國務院印發《“健康中國2030”規劃綱要》. Available at: http://www.gov.cn/xinwen/2016-10/25/content_5124174.htm.
3. Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington (DC): National Academies Press (US); 2011.
4. Institute of Medicine (US) Committee on Clinical Practice Guidelines. Guidelines for clinical practice: from development to use. Washington (DC): National Academies Press (US); 1992.
5. Jin Y, Li Z, Han F, et al. Barriers and enablers for the implementation of clinical practice guidelines in China: a mixed-method study. BMJ Open, 2019, 9(9): e026328.
6. Jin YH, Tan LM, Khan KS, et al. Determinants of successful guideline implementation: a national cross-sectional survey. BMC Med Inform Decis Mak, 2021, 21(1): 19.
7. 吳明隆. 問卷統計分析實務——SPSS操作與應用. 重慶: 重慶大學出版社, 2010.
8. 靳英輝, 鄧通, 曾憲濤, 等. 臨床實踐指南制訂方法——指南的實施工具. 中國循證心血管醫學雜志, 2019, 11(10): 1157-1161.
9. 靳英輝, 鄧通, 曾憲濤, 等. 臨床實踐指南制訂方法——指南的實施與轉化. 中國循證心血管醫學雜志, 2019, 11(9): 1040-1042,1046.
10. 史靜琤, 莫顯昆, 孫振球. 量表編制中內容效度指數的應用. 中南大學學報(醫學版), 2012, 37(2): 152-155.
11. 華琳, 閻巖, 張建. 關于對診斷一致性Kappa系統的探討. 數理醫藥學雜志, 2006, 19(5): 518-520.
12. 趙俊強. 引入復雜科學理念, 推動實施科學研究范式的多樣化. 醫學新知, 2020, 30(5): 364-375.
13. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 2017, 358: j4008.
14. Vandvik PO, Brandt L, Alonso-Coello P, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest, 2013, 144(2): 381-389.
15. Siemieniuk RA, Agoritsas T, Macdonald H, et al. Introduction to BMJ rapid recommendations. BMJ, 2016, 354: i5191.
16. 曾可. 基于本體技術的中文臨床指南計算機化研究. 武漢: 華中科技大學, 2017.
17. 趙志娟, 趙玉虹. 文本臨床指南轉變為數字化臨床指南發展現狀及趨勢. 中國數字醫學, 2017, 12(1): 32-34.
18. 覃露, 徐曉巍, 丁玲玲, 等. 面向決策支持的臨床指南知識表示方法研究. 中華醫學圖書情報雜志, 2020, 29(2): 1-8.

Previous Article
Methodological quality assessment of clinical guidelines and consensus for lupus nephritis
Next Article
Classification and application of effectiveness-implementation hybrid designs

Chinese Journal of Evidence-Based Medicine

Development and validation for evaluation of an evaluation tool for guideline implementation

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content