ObjectiveTo formulate the Chinese version of Fear of Progression Questionnaire-Short Form/Caregiver Version (FoP-Q-SF/C) and examine the reliability and validity of the scale.MethodsA questionnaire survey of FoP-Q-SF/C was conducted among the caregivers of melanoma out-patients in West China Hospital of Sichuan University from June 2019 to March 2020. Convenient sampling method was adopted. The validity and reliability of the scale were analyzed.ResultsA total of 247 caregivers of melanoma out-patients were investigated by the FoP-Q-SF/C, and 101 valid questionnaires were finally collected. The Cronbach’s α of the FoP-Q-SF/C scale was 0.919, and the Guttman Split-Half coefficient was 0.906. Using exploratory factor analysis to extract 3 common factors, the cumulative explainable total variation was 73.964%. The model fit was as follows: chi-square/degree of freedom was 1.950, standardized root mean square residual was 0.067, goodness of fit index was 0.859, incremental fit index was 0.939, comparative fit index was 0.938, Tucker-Lewis index or non-normed fit index was 0.918, and the root-mean-square error of approximation was 0.097.ConclusionsThe FoP-Q-SF/C scale formulated in this study is divided into three dimensions, which has good reliability and validity, meanwhile, it is relatively simple and can be used to clinically screen melanoma caregivers’ FoP-Q-SF/C levels. However, the application of this scale in other diseases still needs further testing.
在GRADE方法中，若多數相關證據來自高偏倚風險的研究，則起初被定為高質量證據的隨機試驗和低質量證據的觀察性研究均有可能被降低質量等級。隨機試驗已確定的局限性包括：未進行分配隱藏、未實施盲法、未報告失訪情況及未恰當考慮意向性治療原則。最近提出的局限性包括：因明顯獲益而早期終止試驗和基于結果選擇性報告結局。觀察性研究的主要局限性包括使用不合適的對照及未能充分調整預后的不平衡。偏倚風險可因不同結果而異（如全死因死亡率的失訪遠少于生命質量的失訪），許多系統評價都容易忽略這一點。在決定是否因偏倚風險而降低質量等級時，不管是隨機試驗還是觀察性研究，作者不應采用對各個研究取平均值的方法。相反，對任何單個結果，當同時存在高、低偏倚風險的研究時，則應考慮只納入較低偏倚風險的研究。
Patient-reported outcome measures (PROM) measure attribute studies refer to studies conducted by investigators to validate the measurement attributes of PROM. The consensus-based standards for the selection of health measurement instruments (COSMIN), an international consensus standard for the selection of health measurement instruments, divides this attribute into three aspects: reliability, validity and responsiveness, and adds interpretability as an additional important feature for evaluating PROM. The purpose of this paper is to introduce the verification methods and principles of the three major measurement attributes in the COSMIN consensus, as well as the significance and direction of interpretability evaluation, and to provide international methodological experience and reference for the development of high-quality PROM psychometric attribute verification in China.
Network meta-analysis (NMA) is a method that can compare and rank the effects of different interventions, which plays an important role in evidence translation and evidence-based decision-making. In 2014, the GRADE working group first introduced the GRADE method for NMA evidence certainty grading. Since then, its method system has been gradually supplemented and improved. In recent years, the GRADE working group has further improved the methods for evaluating intransitivity and imprecision in NMA, and has made recommendations for the presentation and interpretation of NMA results, forming a complete methodological chain of NMA evidence certainty grading and result interpretation consisting of 6 steps. Our team updated the method system of GRADE applied in NMA with specific cases to provide references for relevant researchers.
ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.
ObjectiveTo evaluate the reliability,validity and feasibility of a patient-reported outcomes (PRO) scale in the subjects with respiratory failure. Methods364 patients with chronic respiratory failure and 97 healthy subjects were face-to-face interviewed by well-trained investigators,and the data of respiratory failure -PRO instrument were collected. The psychometric performance such as reliability,validity,responsiveness and clinical feasibility in the respiratory failure -PRO instrument was evaluated. ResultsThe Cronbach's alpha coefficient of the respiratory failure -PRO instrument and each dimension were greater than 0.7. Factor analysis showed that the instrument had good construct validity. The scores of each of the facets and total scores between the patients and the healthy subjects were different. The recovery rate and the efficient rate of the questionnaire were more than 95%,and the time required to complete a questionnaire was within 15 minutes,indicating that the scale had a high clinical feasibility. ConclusionThe respiratory failure -PRO instrument has good reliability,validity,responsiveness and clinical feasibility.
Previous methods of grading evidence for systematic reviews of diagnostic test accuracy have generally focused on assessing the certainty (quality) of evidence at the level of diagnostic indicators. When the question is not limited to follow the diagnostic test accuracy results themselves, the grading results may be inaccurate due to the lack of consideration of the downstream effects of the test accuracy in specific settings. To address these challenges, the GRADE working group conducted a series of studies focused on updating methods to explore or simulate important downstream effects of diagnostic test accuracy outcomes within a contextual framework. This paper aimed to introduce advances in the contextual framework of the GRADE approach to rate the certainty of evidence from systematic reviews of single diagnostic test accuracy.
Objective To primarily test the reliability and validity of the Kashin-Beck Disease (KBD) affected big joints function assessing system for adult Tibetans in Rangtang County. Method From June to July 2009, 142 KBD patients were investigated with the function assessing system in Rangtang County of Ngawa. Cronbach’s α coefficient was calculated to estimate internal consistency reliability. Pearson’s r for the correlation of the items with the total score of the scale was computed to test the internal validity. Principal component factor analysis with varimax rotation analysis was conducted to explore construct validity. Result Both the response and complete rates of the scale were 100%. The time for completing the scale was 7.8±3.4 minutes. Cronbach’s α was 0.857, which revealed satisfactory internal consistency reliability. Pearson correlation analysis revealed significant correlation between the scores of each item and the total score of the scale (Plt;0.05). Pearson’s r value of each item was more than 0.4, only except the items of “sitting with legs crossed” and “standing at attention”. The principal factor analysis extracted three latent factors explaining 68.1% of the variation together. The latent factors weights of the items were over 0.4 except the items of “standing at attention”, "taking food” and “wiping after defecation”. Conclusion The reliability and validity of KBD affected big joints function assessing system for adult Tibetans in Rangtang County was good in this primary test, the function assessing system has to be widely applied and further assessed among Tibetans suffered with KBD, in order to provide a standard evaluation criterion in KBD integrate control.
Objective To evaluate the reliability and validity of the three-dimensional motion capture analysis system COFT-Motion? in evaluating the active range of motion of upper limbs in healthy subjects, and provide objective basis for its clinical application. Methods From January to March 2022, healthy subjects were publicly recruited for enrollment. The evaluator applied the three-dimensional motion capture analysis system COFT-Motion? and angle ruler to evaluate the active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) in healthy subjects. Pearson correlation analysis was used to evaluate validity, and intraclass correlation coefficient (ICC) was used to evaluate reliability. Results There was a positive correlation between the measurements of COFT-Motion? and the angle ruler of the active range of motion of upper limbs in healthy subjects. The Pearson correlation coefficients for active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) were 0.913, 0.964, 0.961, 0.941, 0.864, and 0.919, respectively (P<0.05). The results of using COFT-Motion? by different evaluators to evaluate the active range of motion of healthy subjects’ shoulder joints (flexion, extension, adduction, abduction) and elbow joints (flexion, extension) showed that the ICC values were 0.892, 0.942, 0.961, 0.988, 0.989, and 0.928, respectively (P<0.05). The results of repeated evaluations by the same evaluator showed that the ICC values were 0.795, 0.916, 0.900, 0.868, 0.918, and 0.911, respectively (P<0.05). Conclusion The application of the three-dimensional motion capture analysis system COFT-Motion? in healthy subjects has good validity and reliability. However, due to the limited sample size and subject of the study, further promotion and application of the system still need to be further explored.
ObjectiveTo evaluate the reliability and validity of the Quality of Working Life Scale (QWL7-32). MethodsThe QWL7-32 scale was used to survey 487 drilling workers. The presence of chronic diseases was regarded as an effector for evaluating physical health, and the result of SCL-90 measurement was regarded as an effector for evaluating psychological health. The reliability and validity of the scale were statistically analyzed. ResultsThe results of the Pearson correlation coefficient was 0.713, the Cronbach's alpha coefficient was 0.920, and the Splithalf reliability coefficient was 0.942. The result of confirmatory factor analysis showed that the construct validity of scale was good, and the accumulative rate of 7 variances was 62.59%. The results of correlation analysis and t test showed that the validity of scale criterion was also good. In QWL7-32 scale, each dimension showed a good correlation with its relevant item but poor correlation with any other items. ConclusionThe QWL7-32 has a good reliability and validity.