Reliability and Validity of the Chinese Version Appropriateness Evaluation Protocol

Objective

To adapt the Appropriateness Evaluation Protocol (AEP) to the specific settings of health care in China and to validate the Chinese version AEP (C-AEP).

Methods

Forward and backward translations were carried out to the original criteria. Twenty experts participated in the consultancy to form a preliminary version of the C-AEP. To ensure applicability, tests of reliability and validity were performed on 350 admissions and 3,226 hospital days of acute myocardial infraction patients and total hip replacement patients in two tertiary hospitals by two C-AEP reviewers and two physician reviewers. Overall agreement, specific agreement, and Cohen’s Kappa were calculated to compare the concordance of decisions between pairs of reviewers to test inter-rater reliability and convergent validity. The use of “overrides” and opinions of experts were recorded as measurements of content validity. Face validity was tested through collecting perspectives of nonprofessionals. Sensitivity, specificity, and predictive values were also reported.

Results

There are 14 admission and 24 days of care criteria in the initial version of C-AEP. Kappa coefficients indicate substantial agreement between reviewers: with regard to inter-rater reliability, Kappa (κ) coefficients are 0.746 (95% confidence interval [CI] 0.644–0.834) and 0.743 (95% CI 0.698–0.767) of admission and hospital days, respectively; for convergent validity, the κ statistics are 0.678 (95% CI 0.567–0.778) and 0.691 (95% CI 0.644–0.717), respectively. Overrides account for less than 2% of all judgments. Content validity and face validity were confirmed by experts and nonprofessionals, respectively. According to the C-AEP reviewers, 18.3% of admissions and 28.5% of inpatient days were deemed inappropriate.

Conclusions

The C-AEP is a reliable and valid screening tool in China’s tertiary hospitals. The prevalence of inappropriateness is substantial in our research. To reduce inappropriate utilization, further investigation is needed to elucidate the reasons and risk factors for this inappropriateness.     

Development of Chinese Version of Polycystic Ovary Syndrome Health-Related Quality of Life Questionnaire (Chi-PCOSQ)

Objectives

To develop the Chinese version of the Polycystic Ovary Syndrome Health-related Quality of Life Questionnaire (Chi-PCOSQ).

Research Design and Method

This cross-sectional study was conducted in a medical center in Taiwan. Eighty women who met the criteria were enrolled: female, age range of 18–45 years, competent in the Chinese language, had been diagnosed with polycystic ovary syndrome (PCOS), and were regularly followed at outpatient clinics (defined as at least two outpatient visits before enrollment). The PCOSQ was translated and culturally adapted according to standard procedures. A semi-structured interview was applied to assess face validity. Exploratory factor analysis (EFA) was applied to determine scale constructs. Measurements of internal consistency via Cronbach’s α, test-retest reliability via intraclass correlation coefficient (ICC), construct validity, and discriminative validity were performed.

Results

Five additional items, representing the issues of acne, hair loss, and fear of getting diabetes, were incorporated into the original scale. A six-factor structure emerged as a result of the EFA, explaining 71.9% of the variance observed. The reliability analyses demonstrated satisfactory results for Cronbach’s α ranging from 0.78–0.96, and for ICC ranging from 0.73–0.86. Construct validity was confirmed by significant correlation between the domains of the Chi-PCOSQ and generic health-related quality of life (HRQoL) measures (WHOQOL-BREF, EQ-5D) and clinical parameters (body mass index, waist-hip ratio, blood pressure). The known-group analysis indicated that the Chi-PCOSQ is a discriminative tool that differentiates patients according to their HRQoL.

Conclusion

The Chi-PCOSQ seems internally consistent, culturally acceptable, and our preliminary evidence suggests that it may be reliable and valid. The Chi-PCOSQ is a promising assessment tool to address the HRQoL of women affected by PCOS in Chinese-speaking countries and to further identify ethnic/cultural differences in the HRQoL of women with PCOS.     

Reliability and validity of simplified Chinese version of Roland-Morris questionnaire in evaluating rural and urban patients with low back pain

Objective

The causes of low back pain in China and Western countries are extremely different. We attempted to analyze the risk factors of low back pain in urban and rural patients under the dual economy with the simplified Chinese version of Roland-Morris disability questionnaire (SC-RMDQ) to demonstrate that SC-RMDQ could evaluate patients with low back pain arising from different causes.

Methods

Roland-Morris disability questionnaire was translated into SCRMDQ according to international guidelines for questionnaire adaptation. In this study, causes of low back pain of 187 outpatients and inpatients (99 urban patients and 88 rural patients) were analyzed. All patients underwent simplified Chinese version of Roland-Morris disability questionnaire (SC-RMDQ), simplified Chinese Oswestry disability index (SCODI) and visual analogue scale (VAS). Reliability was tested using reproducibility (intraclass coefficient of correlation – ICC) and internal consistency (Cronbach''s alpha). Validity was tested using Pearson correlation analysis.

Results

The leading causes for low back pain were sedentariness (38.4%) and vibration (18.1%) in urban patients and waist bending (48.9%) and spraining (25%) in rural patients. Although causes of low back pain in the two groups of population were completely different, SCRMDQ had high internal consistency (Cronbach''s α value of 0.874 in urban patients and 0.883 in rural patients) and good reproducibility (ICC value of .952 in urban patients and 0.949 in rural patients, P<0.01). SCRMDQ also showed significant correlation with Simplified Chinese version of Oswestry disability index (SCODI) and visual analogue scale (VAS) in rural areas (SCRMDQ-SCODI r = 0.841; SCRMDQ -VAS: r = 0.685, P<0.01) and in urban areas (SCRMDQ-SCODI: r = 0.818, P<0.01; SCRMDQ –VAS: r = 0.666, P<0.01).

Conclusions

Although causes of low back pain are completely different in rural and urban patients, SCRMDQ has a good reliability and validity, which is a reliable clinical method to evaluate disability of rural and urban patients.     

Arabic version of the Geriatric Oral Health Assessment Index

Objectives: The purpose of this study was to translate the original English version of the Geriatric Oral Health Assessment Index (GOHAI) into an Arabic version, and to test the validity and reliability of the translated instrument (GOHAI‐Ar) for use among the elderly in Saudi Arabia. Methods: The 12‐item GOHAI was translated into Arabic using the back‐translation technique and performing a preliminary test to determine the comprehensibility and readability of the Arabic language version. A total of 156 elderly patients answered the questionnaire, and underwent a clinical examination by one calibrated dentist. Information on subjects’ socio‐demographic background and oral health conditions was collected. Convergent validity was evaluated by identifying the associations between perceived oral health status, general health status, perceived need for dental care and GOHAI‐Ar scores. Discriminant validity was examined by comparing the GOHAI‐Ar scores and six oral health parameters. Internal consistency was measured by Cronbach’s alpha. Test–retest reliability was assessed by intra‐class correlation coefficient (ICC) and weighted kappa. Factor structure of GOHAI‐Ar was evaluated using principal component factor analysis. Results: The mean GOHAI‐Ar was 32.1 (SD 12.2; range 11–59). Mean GOHAI‐Ar scores were higher for the elderly who rated their oral and general health as good. Subjects with perceived dental treatment needs had a lower mean GOHAI‐Ar score than those without any such needs. The caries experience, number of missing teeth, OHI‐S score, number of pathologically mobile teeth and number of oral lesions were negatively correlated with the GOHAI‐Ar score. The Cronbach’s alpha (0.93) indicated a high degree of internal consistency and homogeneity between items. The ICC for GOHAI‐Ar was 0.95, the weighted kappa coefficient for individual items varied between 0.42 and 0.71, and the correlation coefficients for the 12 items were above 0.70. Factor analysis didn’t support the expected dimensions of the index, and only one factor was found at eigenvalue greater than 1. Conclusions: The findings suggest an excellent reliability and validity of GOHAI‐Ar. Further research is needed to assess the value of this instrument in oral health‐related quality of life studies in Arabic elderly population.     

Chinese Adaptation and Psychometric Properties of the Child Version of the Cognitive Emotion Regulation Questionnaire

This study aimed to validate a Chinese’s adaption of the Cognitive Emotion Regulation Questionnaire for children (CERQ-Ck). This self-report instrument evaluates nine cognitive emotion regulation strategies that can be used by children after experiencing a negative life event. The CERQ-Ck was evaluated in a sample of 1403 elementary students between the ages of 9 and 11 by using cluster sampling. All the item-correlation coefficients for CERQ-Ck were above 0.30. The internal consistencies of the nine factors suggested moderate reliability (0.66 to 0.73). Confirmatory factor analysis (CFA) indicated that the current version had the same structure as the original instrument (Tucker–Lewis index = 0.912, comparative fit index = 0.922, root mean square error of approximation = 0.032, standardized root mean square residual = 0.044). A second-order factor and a third-order factor structure were also found. Test–retest correlations (0.53 to 0.70, ps < 0.01) over a period of 1 month, which ranged from acceptable to moderately strong were obtained from a random and stratified subsample of elementary students (N = 76). In addition, we analyzed convergent validity in relation to CERQ-Ck and the Chinese version of the Children’s Depression Inventory model dimensions with a subsample of 1083 elementary students. Multiple-group CFA confirmed the measurement invariance for both the male and female groups (ΔCFI < 0.01, ΔRMSEA < 0.015). Overall, results indicate that CERQ-Ck has similar psychometric properties to the original instrument as well as with adequate reliability and validity to investigate the nine cognitive emotion regulation strategies during late childhood developmental periods.     

Validation of the Serbian Version of Multiple Sclerosis Spasticity Scale 88 (MSSS-88)

Objective

Multiple Sclerosis Spasticity Scale (MSSS)-88 has been developed for self-assessment of spasticity symptoms in patients with multiple sclerosis (MS). The objective of this study was to validate MSSS-88 and evaluate the psychometric properties in patients with MS in Serbia.

Methods

The study comprised 65 MS patients with spasticity. MSSS-88 consists of 88 items grouped in eight sections. Internal consistency of the MSSS-88_SR subscales was determined using Cronbach’s alpha coefficient. Test/retest reliability with an intra-class correlation coefficient (ICC) for each MSSS-88_SR subscale was performed. Clinical validity of MSSS-88_SR was determined by correlations with the Numeric Rating Scale (NRS) and the Modified Ashworth Scale (MAS).

Results

The range of Cronbach’s alpha for all scales and ICC was 0.91–0.96 and 0.84–0.91, respectively. All ICCs were statistically significant (p<0.05). All evaluated subscales of MSSS-88 were significantly correlated with the NRS scale. The highest correlation coefficients were registered between the WL subscale and the EDSS and MAS, while the strongest relationship was observed between the MSS subscale and the NRS.

Conclusion

The Serbian translated version of this instrument may be useful as a clinical measure for spasticity and functionality in patients with MS.     

Psychometrics of the Short Form 36 Health Survey Version 2 (SF-36v2) and the Quality of Life Scale for Drug Addicts (QOL-DAv2.0) in Chinese Mainland Patients with Methadone Maintenance Treatment

Objective

To test psychometrics of the Short Form 36 Health Survey version 2 (SF-36v2) and the Quality of Life Scale for Drug Addicts (QOL-DAv2.0) in Chinese mainland patients with methadone maintenance treatment (MMT).

Methods

A total of 1,212 patients were recruited from two MMT clinics in Xi’an, China. Reliability was estimated with Cronbach’s α and intra-class correlation (ICC). Convergent and discriminant validity was assessed using multitrait-multimethod correlation matrix. Sensitivity was measured with ANOVA and relative efficiency. Responsiveness was evaluated by pre-post paired-samples t-test and standardized response mean based on the patients’ health status changes following 6-month period.

Results

Cronbach’s α of the SF-36v2 physical and mental summary components were 0.80 and 0.86 (eight scales range 0.73–0.92) and the QOL-DAv2.0 was 0.96 (four scales range: 0.80–0.93). ICC of the SF-36v2 two components were 0.86 and 0.85 (eight scales range: 0.72–0.87) and the QOL-DAv2.0 was 0.94 (four scales range: 0.88–0.92). Convergent validity was lower between the two instruments (γ <0.70) while discriminant validity was acceptable within each instrument. Sensitivity was satisfied in self-evaluated health status (both instruments) and average daily methadone dose (SF-36v2 physical functioning and vitality scales; QOL-DAv2.0 except psychology scale). Responsiveness was acceptable in the improved health status change (SF-36v2 except vitality scale; QOL-DAv2.0 except psychology and symptoms scales) and deteriorated health status change (SF-36v2 except vitality, social functioning and mental health scales; QOL-DAv2.0 except society scale).

Conclusions

The SF-36v2 and the QOL-DAv2.0 are valid tools and can be used independently or complementary according to different emphases of health-related quality of life evaluation in patients with MMT.     

Development and Validation of a Questionnaire Assessing Fears and Beliefs of Patients with Knee Osteoarthritis: The Knee Osteoarthritis Fears and Beliefs Questionnaire (KOFBeQ)

Objective

We aimed to develop a questionnaire assessing fears and beliefs of patients with knee OA.

Design

We sent a detailed document reporting on a qualitative analysis of interviews of patients with knee OA to experts, and a Delphi procedure was adopted for item generation. Then, 80 physicians recruited 566 patients with knee OA to test the provisional questionnaire. Items were reduced according to their metric properties and exploratory factor analysis. Reliability was tested by the Cronbach α coefficient. Construct validity was tested by divergent validity and confirmatory factor analysis. Test–retest reliability was assessed by the intra-class correlation coefficient (ICC) and the Bland and Altman technique.

Results

137 items were extracted from analysis of the interview data. Three Delphi rounds were needed to obtain consensus on a 25-item provisional questionnaire. The item-reduction process resulted in an 11-item questionnaire. Selected items represented fears and beliefs about daily living activities (3 items), fears and beliefs about physicians (4 items), fears and beliefs about the disease (2 items), and fears and beliefs about sports and leisure activities (2 items). The Cronbach α coefficient of global score was 0.85. We observed expected divergent validity. Confirmation factor analyses confirmed higher intra-factor than inter-factor correlations. Test–retest reliability was good, with an ICC of 0.81, and Bland and Altman analysis did not reveal a systematic trend.

Conclusions

We propose an 11-item questionnaire assessing patients'' fears and beliefs concerning knee OA with good content and construct validity.     

Intra and Interobserver Reliability and Agreement of Semiquantitative Vertebral Fracture Assessment on Chest Computed Tomography

Objectives

To evaluate the reliability of semiquantitative Vertebral Fracture Assessment (VFA) on chest Computed Tomography (CT).

Methods

Four observers performed VFA twice upon sagittal reconstructions of 50 routine clinical chest CTs. Intra- and interobserver agreement (absolute agreement or 95% Limits of Agreement) and reliability (Cohen''s kappa or intraclass correlation coefficient(ICC)) were calculated for the visual VFA measures (fracture present, worst fracture grade, cumulative fracture grade on patient level) and for percentage height loss of each fractured vertebra compared to the adjacent vertebrae.

Results

Observers classified 24–38% patients as having at least one vertebral fracture, giving rise to kappa''s of 0.73–0.84 (intraobserver) and 0.56–0.81 (interobserver). For worst fracture grade we found good intraobserver (76–88%) and interobserver (74–88%) agreement, and excellent reliability with square-weighted kappa''s of 0.84–0.90 (intraobserver) and 0.84–0.94 (interobserver). For cumulative fracture grade the 95% Limits of Agreement were maximally ±1,99 (intraobserver) and ±2,69 (interobserver) and the reliability (ICC) varied from 0.84–0.94 (intraobserver) and 0.74–0.94 (interobserver). For percentage height-loss on a vertebral level the 95% Limits of Agreement were maximally ±11,75% (intraobserver) and ±12,53% (interobserver). The ICC was 0.59–0.90 (intraobserver) and 0.53–0–82 (interobserver). Further investigation is needed to evaluate the prognostic value of this approach.

Conclusion

In conclusion, these results demonstrate acceptable reproducibility of VFA on CT.     

Reliability of serum metabolite concentrations over a 4-month period using a targeted metabolomic approach

Metabolomics is a promising tool for discovery of novel biomarkers of chronic disease risk in prospective epidemiologic studies. We investigated the between- and within-person variation of the concentrations of 163 serum metabolites over a period of 4 months to evaluate the metabolite reliability expressed by the intraclass-correlation coefficient (ICC: the ratio of between-person variance and total variance). The analyses were performed with the BIOCRATES AbsoluteIDQ™ targeted metabolomics technology, including acylcarnitines, amino acids, glycerophospholipids, sphingolipids and hexose in 100 healthy individuals from the European Prospective Investigation into Cancer and Nutrition (EPIC)-Potsdam study who had provided two fasting blood samples 4 months apart. Overall, serum reliability of metabolites over a 4-month period was good. The median ICC of the 163 metabolites was 0.57. The highest ICC was observed for hydroxysphingomyelin C14:1 (ICC = 0.85) and the lowest was found for acylcarnitine C3:1 (ICC = 0). Reliability was high for hexose (ICC = 0.76), sphingolipids (median ICC = 0.66; range: 0.24–0.85), amino acids (median ICC = 0.58; range: 0.41–0.72) and glycerophospholipids (median ICC = 0.58; range: 0.03–0.81). Among acylcarnitines, reliability of short and medium chain saturated compounds was good to excellent (ICC range: 0.50–0.81). Serum reliability was lower for most hydroxyacylcarnitines and monounsaturated acylcarnitines (ICC range: 0.11–0.45 and 0.00–0.63, respectively). For most of the metabolites a single measurement may be sufficient for risk assessment in epidemiologic studies with healthy subjects.     

The functional comorbidity index had high inter-rater reliability in patients with acute lung injury

ABSTRACT: BACKGROUND: The Functional Comorbidity Index (FCI) was recently developed to predict physical function in acute lung injury patients using comorbidity data. Our objectives were to determine: (1) the inter-rater reliability of the FCI collected using in-patient discharge summaries (primary objective); and (2) the accuracy and predictive validity of the FCI collected using hospital discharge summaries and admission records versus complete chart review (secondary objectives). METHODS: For reliability, we evaluated the FCI's intraclass correlation coefficient (ICC) among trained research staff performing data collection for 421 acute lung injury patients enrolled in a prospective cohort study. For validity and accuracy, we compared the detection of FCI comorbidities across three types of inpatient medical records, and the association of the respective FCI scores obtained with patients' SF-36 physical function subscale (PFS) scores at 1-year follow-up. RESULTS: Inter-rater reliability was near-perfect (ICC 0.91; 95% CI 0.89-0.94). Hospital admission records and discharge summaries (vs. complete chart review) significantly underestimated the total FCI score. However, using multivariable linear regression, FCI scores collected using each of the three types of inpatient medical records had similar associations with PFS, suggesting similar predictive value. CONCLUSIONS: Data collection using in-patient discharge summaries represents a reliable and valid method for collecting FCI comorbidity information.     

Measurement Properties of the Chinese Version of the Youth Quality of Life Instrument–Weight Module (YQOL-W)

Background

Childhood obesity is a growing public health concern in China. It not only compromises physical health, but also has negative impacts on psychosocial well-being. As obesity rates increase, finding out what the perceptions of Chinese youth are regarding their weight is important for intervention planning and evaluation. However, there is a paucity of available obesity-specific instruments for children and adolescents in China and youth weight-specific quality of life (QOL) has been little reported. This study aimed to evaluate the measurement properties of the Chinese version of the Youth Quality of Life Instrument – Weight Module (YQOL-W).

Methods

The Chinese version of the YQOL-W was administered to 840 youth aged 11–18 from nine schools. Measurement properties including measurement model, reliability, validity and burden were evaluated.

Results

Confirmatory factor analysis showed that a three-factor model had acceptable model fit. The instrument had robust internal consistency reliability with Cronbach''s α ranging from 0.84 to 0.96 and acceptable test-retest reliability with the intraclass correlation coefficients (ICCs) all higher than 0.7. The standard error of measurement (SEM) values for the Self, Social and Environment factors and total score were 10.352, 9.526, 12.086 and 8.425, respectively. The small real differences (SRDs) for the Self, Social and Environment factors and total score were 28.675, 26.387, 33.478, and 23.337, respectively. The Pearson''s correlation coefficients between the YQOL-W and the PedsQL4.0 General Core Scales were stronger between comparable dimensions than those between less comparable dimensions, demonstrating convergent and discriminant evidence of construct validity. Significant differences were found in subscale and total scores across weight status, age and genders (P<0.01), supporting the known-groups validity of the instrument.

Conclusion

The Chinese version of the YQOL-W has acceptable measurement properties and can be used to assess the weight-specific QOL of children and adolescents in China.     

Verbal Autopsy: Reliability and Validity Estimates for Causes of Death in the Golestan Cohort Study in Iran

Background

Verbal autopsy (VA) is one method to obtain valid estimates of causes of death in the absence of valid medical records. We tested the reliability and validity of a VA questionnaire developed for a cohort study in Golestan Province in northeastern Iran.

Method

A modified version of the WHO adult verbal autopsy was used to assess the cause of death in the first 219 Golestan Cohort Study (GCS) subjects who died. The GCS cause of death was determined by two internists who independently reviewed all available medical records. Two other internists (“reviewers”) independently reviewed only the VA answers and classified the cause of death into one of nine general categories; they repeated this evaluation one month later. The reliability of the VA was measured by calculating intra-reviewer and inter-reviewer kappa statistics. The validity of the VA was measured using the GCS cause of death as the gold standard.

Results

VA showed both good validity (sensitivity, specificity, PPV, and NPV all above 0.81) and reliability (kappa>0.75) in determining the general cause of death independent of sex and place of residence. The overall multi-rater agreement across four reviews was 0.84 (95%CI: 0.78–0.89). The results for identifying specific cancer deaths were also promising, especially for upper GI cancers (kappa = 0.95). The multi-rater agreement in cancer subgroup was 0.93 (95%CI: 0.85–0.99).

Conclusions

VA seems to have good reliability and validity for determining the cause of death in a large-scale adult follow up study in a predominantly rural area of a middle-income country.     

Reliability and Validity Study of Clinical Ultrasound Imaging on Lateral Curvature of Adolescent Idiopathic Scoliosis

Background

Non-ionizing radiation imaging assessment has been advocated for the patients with adolescent idiopathic scoliosis (AIS). As one of the radiation-free methods, ultrasound imaging has gained growing attention in scoliosis assessment over the past decade. The center of laminae (COL) method has been proposed to measure the spinal curvature in the coronal plane of ultrasound image. However, the reliability and validity of this ultrasound method have not been validated in the clinical setting.

Objectives

To evaluate the reliability and validity of clinical ultrasound imaging on lateral curvature measurements of AIS with their corresponding magnetic resonance imaging (MRI) measurements.

Methods

Thirty curves (ranged 10.2°–68.2°) from sixteen patients with AIS were eligible for this study. The ultrasound scan was performed using a 3-D ultrasound unit within the same morning of MRI examination. Two researchers were involved in data collection of these two examinations. The COL method was used to measure the coronal curvature in ultrasound image, compared with the Cobb method in MRI. The intra- and inter-rater reliability of the COL method was evaluated by intra-class correlation coefficient (ICC). The validity of this method was analyzed by paired Student’s t-test, Bland–Altman statistics and Pearson correlation coefficient. The level of significance was set as 0.05.

Results

The COL method showed high intra- and inter-rater reliabilities (both with ICC (2, K) >0.9, p<0.05) to measure the coronal curvature. Compared with Cobb method, COL method showed no significant difference (p<0.05) when measuring coronal curvature. Furthermore, Bland-Altman method demonstrated an agreement between these two methods, and Pearson’s correlation coefficient (r) was high (r>0.9, p<0.05).

Conclusion

The ultrasound imaging could provide a reliable and valid measurement of spinal curvature in the coronal plane using the COL method. Further research is needed to validate the proposed ultrasound measurement in larger clinical trial and to optimize the ultrasound scanning and measuring procedure.     

Hospital staff education on severe sepsis/septic shock and hospital mortality: an original hypothesis

Background

The Functional Comorbidity Index (FCI) was recently developed to predict physical function in acute lung injury patients using comorbidity data. Our objectives were to determine: (1) the inter-rater reliability of the FCI collected using in-patient discharge summaries (primary objective); and (2) the accuracy and predictive validity of the FCI collected using hospital discharge summaries and admission records versus complete chart review (secondary objectives).

Methods

For reliability, we evaluated the FCI’s intraclass correlation coefficient (ICC) among trained research staff performing data collection for 421 acute lung injury patients enrolled in a prospective cohort study. For validity and accuracy, we compared the detection of FCI comorbidities across three types of inpatient medical records, and the association of the respective FCI scores obtained with patients’ SF-36 physical function subscale (PFS) scores at 1-year follow-up.

Results

Inter-rater reliability was near-perfect (ICC 0.91; 95% CI 0.89-0.94). Hospital admission records and discharge summaries (vs. complete chart review) significantly underestimated the total FCI score. However, using multivariable linear regression, FCI scores collected using each of the three types of inpatient medical records had similar associations with PFS, suggesting similar predictive value.

Conclusions

Data collection using in-patient discharge summaries represents a reliable and valid method for collecting FCI comorbidity information.     

Reliability and validity of the Ethiopian version of the hospital anxiety and depression scale (HADS) in HIV infected patients

Background

The hospital anxiety and depression scale (HADS) is a widely used instrument for evaluating psychological distress from anxiety and depression. HADS has not yet been validated in Ethiopia. The aim of this study was to evaluate the reliability and validity of the Amharic (Ethiopian language) version of HADs among HIV infected patients.

Methods

The translated scale was administered to 302 HIV/AIDS patients on follow up for and taking anti-retroviral treatment. Consistency assessment was conducted using Cronbach''s alpha, test-retest reliability using intra-class correlation coefficients (ICC). Construct validity was examined using principal components analysis (PCA). Parallel analysis, Kaiser''s criterion and the scree test were used for factor extraction.

Results

The internal consistency was 0.78 for the anxiety, 0.76 for depression subscales and 0.87 for the full scale of HADS. The intra-class correlation coefficient (ICC) was 80%, 86%, and 84% for the anxiety and depression subscales, and total score respectively. PCA revealed a one dimensional scale.

Conclusion

This preliminary validation study of the Ethiopian version of the HADs indicates that it has promising acceptability, reliability and validity. The adopted scale has a single underlying dimension as indicated by Razavi''s model. The HADS can be used to examine psychological distress in HIV infected patients. Findings are discussed and recommendations made.     

Prevalence and Risk Factors of Poor Sleep Quality among Chinese Elderly in an Urban Community: Results from the Shanghai Aging Study

Background

Sleep disorders causes a significant negative effect on mental and physical health, particularly among the elderly. The disease burden and risk factors of poor sleep quality of the elderly need to be verified using a validated form of measurement in urban mainland China.

Methods

This study included 1086 community residents aged ≥60 years who completed the Chinese version of the Pittsburgh Sleep Quality Index (CPSQI). Poor sleeper was defined by a CPSQI global score of >5. Subjects also accepted the neurological and neuropsychological assessments, including the Mini-Mental State Examination, Center for Epidemiological Studies Depression Scale, and Zung Self-Rating Anxiety Scale (ZSAS). A history of chronic diseases was confirmed by the medical records of each participant.

Results

The prevalence of poor sleep quality in this population was 41.5% (95% confidence interval (CI) = 38.6–44.5%), with a higher rate observed in elderly females (45.8% [95% CI = 41.9–49.7%]) than that in elderly males (35.8% [95% CI = 31.4–40.1%]). The prevalence rate increased with age, from 32.1% (95% CI = 27.8–36.4%) in those aged 60–69 years to 52.5% (95% CI = 45.9–59.1%) in those aged ≥80 years (p value for trend<0.001). Multivariate logistic regression analysis indicated that age (OR = 1.03[95% CI = 1.01–1.05], p<0.001), less education duration (OR = 1.04 [95% CI = 1.01–1.08, p = 0.014), living alone (OR = 1.62 [95% CI = 1.02–2.58], p = 0.04), anxiety (ZSAS score: OR = 1.09 [95% CI = 1.05–1.12], p<0.001), number of chronic disease (OR = 1.18 [95% CI = 1.07–1.30], p = 0.14) and arthritis (OR = 1.45[95% CI = 1.05–2.01], p = 0.025) were risk factors of poor sleep quality.

Conclusions

Poor sleep quality is highly prevalent among elderly Chinese residents in urban Shanghai. Growing attention and comprehensive countermeasures involving psycho-social and personal activities might alleviate the sleep problem in the elderly.     

Validation of the Chinese Version of the Quality of Nursing Work Life Scale

Quality of Nursing Work Life (QNWL) serves as a predictor of a nurse’s intent to leave and hospital nurse turnover. However, QNWL measurement tools that have been validated for use in China are lacking. The present study evaluated the construct validity of the QNWL scale in China. A cross-sectional study was conducted conveniently from June 2012 to January 2013 at five hospitals in Guangzhou, which employ 1938 nurses. The participants were asked to complete the QNWL scale and the World Health Organization Quality of Life abbreviated version (WHOQOL-BREF). A total of 1922 nurses provided the final data used for analyses. Sixty-five nurses from the first investigated division were re-measured two weeks later to assess the test-retest reliability of the scale. The internal consistency reliability of the QNWL scale was assessed using Cronbach’s α. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC). Criterion-relation validity was assessed using the correlation of the total scores of the QNWL and the WHOQOL-BREF. Construct validity was assessed with the following indices: χ² statistics and degrees of freedom; relative mean square error of approximation (RMSEA); the Akaike information criterion (AIC); the consistent Akaike information criterion (CAIC); the goodness-of-fit index (GFI); the adjusted goodness of fit index; and the comparative fit index (CFI). The findings demonstrated high internal consistency (Cronbach’s α = 0.912) and test-retest reliability (interclass correlation coefficient = 0.74) for the QNWL scale. The chi-square test (χ² = 13879.60, df [degree of freedom] = 813 P = 0.0001) was significant. The RMSEA value was 0.091, and AIC = 1806.00, CAIC = 7730.69, CFI = 0.93, and GFI = 0.74. The correlation coefficient between the QNWL total scores and the WHOQOL-BREF total scores was 0.605 (p<0.01). The QNWL scale was reliable and valid in Chinese-speaking nurses and could be used as a clinical and research instrument for measuring work-related factors among nurses in China.     

The Smartphone Addiction Scale: Development and Validation of a Short Version for Adolescents

Objective

This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents.

Method

A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off.

Results

The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach''s alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001) and self-evaluation of smartphone addiction (p<.001) showed significant difference. The ROC analysis results showed an area under a curve (AUC) value of 0.963(0.888–1.000), a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887–1.000), a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls.

Conclusions

The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas.     

Assessment of Lower Limb Muscle Strength and Power Using Hand-Held and Fixed Dynamometry: A Reliability and Validity Study

Introduction

Hand-held dynamometry (HHD) has never previously been used to examine isometric muscle power. Rate of force development (RFD) is often used for muscle power assessment, however no consensus currently exists on the most appropriate method of calculation. The aim of this study was to examine the reliability of different algorithms for RFD calculation and to examine the intra-rater, inter-rater, and inter-device reliability of HHD as well as the concurrent validity of HHD for the assessment of isometric lower limb muscle strength and power.

Methods

30 healthy young adults (age: 23±5yrs, male: 15) were assessed on two sessions. Isometric muscle strength and power were measured using peak force and RFD respectively using two HHDs (Lafayette Model-01165 and Hoggan microFET2) and a criterion-reference KinCom dynamometer. Statistical analysis of reliability and validity comprised intraclass correlation coefficients (ICC), Pearson correlations, concordance correlations, standard error of measurement, and minimal detectable change.

Results

Comparison of RFD methods revealed that a peak 200ms moving window algorithm provided optimal reliability results. Intra-rater, inter-rater, and inter-device reliability analysis of peak force and RFD revealed mostly good to excellent reliability (coefficients ≥ 0.70) for all muscle groups. Concurrent validity analysis showed moderate to excellent relationships between HHD and fixed dynamometry for the hip and knee (ICCs ≥ 0.70) for both peak force and RFD, with mostly poor to good results shown for the ankle muscles (ICCs = 0.31–0.79).

Conclusions

Hand-held dynamometry has good to excellent reliability and validity for most measures of isometric lower limb strength and power in a healthy population, particularly for proximal muscle groups. To aid implementation we have created freely available software to extract these variables from data stored on the Lafayette device. Future research should examine the reliability and validity of these variables in clinical populations.