Multi-Country Evaluation of Affective Experience: Validation of an Abbreviated Version of the Day Reconstruction Method in Seven Countries

Background

The Day Reconstruction Method (DRM) was developed to assess affective states as measures of experienced well-being. The present study aimed to validate an abbreviated version of the DRM in a representative sample of the population in seven countries (China, Ghana, India, Mexico, Russia, South Africa, and Spain), and to examine whether there are country differences in affect and in the relationships among the activities based on the similarity of the affect associated with each of them.

Methods

Interviews were conducted with 47,222 non-institutionalized adults from seven countries, using an abbreviated version of the DRM. A cluster analysis was carried out to classify activities on the basis of the similarity of the associated affect. In each country, the factorial structure of the affect adjectives was tested through Confirmatory Factor Analysis. Internal consistency and construct validity were also assessed. Moreover, the differences in affect across countries and the diurnal cycles of affect were evaluated.

Results

The DRM showed adequate psychometric properties regarding reliability and construct validity in all countries. Respondents from Ghana and South Africa reported more positive net affect whereas Indian respondents reported less positive net affect. Most of the countries showed a similar diurnal variation of affect, which tended to improve throughout the day.

Conclusions

The results show that this abbreviated version of the DRM is a useful tool for multi-country evaluation of experienced well-being.     

Weight Bias Internalization Scale: Psychometric Properties and Population Norms

Objective

Internalizing the pervasive weight bias commonly directed towards individuals with overweight and obesity, co-occurs with increased psychopathology and impaired quality of life. This study sought to establish population norms and psychometric properties of the most widely used self-report questionnaire, the Weight Bias Internalization Scale (WBIS), in a representative community sample.

Design and Methods

In a survey of the German population, N = 1158 individuals with overweight and obesity were assessed with the WBIS and self-report measures for convergent validation.

Results

Item analysis revealed favorable item-total correlation of all but one WBIS item. With this item removed, item homogeneity and internal consistency were excellent. The one-factor structure of the WBIS was confirmed using confirmatory factor analysis. Convergent validity was shown through significant associations with measures of depressive and somatoform symptoms. The WBIS contributed to the explanation of variance in depressive and somatoform symptoms over and above body mass index. Higher WBIS scores were found in women than in men, in individuals with obesity than in individuals with overweight, and in those with lower education or income than those with higher education or income. Sex-specific norms were provided.

Conclusions

The results showed good psychometric properties of the WBIS after removal of one item. Future research is warranted on further indicators of reliability and validity, for example, retest reliability, sensitivity to change, and prognostic validity.     

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

Objective

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism.

Methods

We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability.

Results

Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains.

Conclusion

The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.     

Diabetes Attitude Scale: Validation in Type-2 Diabetes Patients in Multiple Centers in China

Objective

The aim of the paper is to report the development and psychometric testing of Diabetes Attitude Scale.

Method

A prospective study was performed. The cultural equivalency and content validity of the Diabetes Attitude Scale were determined by panels of endocrinologists, physiologists, nurses and dieticians. An accurate and usable translation was obtained for each of five subscales examining attitudes on need for special training, the seriousness of type-2 diabetes, the need for controlling the condition, its psychosocial impact and the degree of autonomy given to patients in decision making. The validation was derived from 5961 patients with type-2 diabetes, recruited from 50 centers in 29 provinces throughout China between March 1st and September 30th, 2010.

Results

The modified Diabetes Attitude Scale showed an acceptable level of internal consistency. The strength of the inter-correlations among the domains of five subscales suggests that the instrument measures related but separate domains of patients'' attitudes toward diabetes. Moreover, the test-retest intraclass correlation coefficients were high enough to support the stability of the Chinese version of the third version of the scale.

Conclusions

The psychometric properties of the Chinese version of Diabetes Attitude Scale demonstrated satisfactory validity and reliability and appeared to effectively evaluate attitudes toward diabetes in patients with type-2 diabetes.     

Measurement of Physician-Patient Communication—A Systematic Review

Background

Effective communication with health care providers has been found as relevant for physical and psychological health outcomes as well as the patients'' adherence. However, the validity of the findings depends on the quality of the applied measures. This study aimed to provide an overview of measures of physician-patient communication and to evaluate the methodological quality of psychometric studies and the quality of psychometric properties of the identified measures.

Methods

A systematic review was performed to identify psychometrically tested instruments which measure physician-patient communication. The search strategy included three databases (EMBASE, PsycINFO, PubMed), reference and citation tracking and personal knowledge. Studies that report the psychometric properties of physician-patient communication measures were included. Two independent raters assessed the methodological quality of the selected studies with the COSMIN (COnsensus based Standards for the selection of health status Measurement INtruments) checklist. The quality of psychometric properties was evaluated with the quality criteria of Terwee and colleagues.

Results

Data of 25 studies on 20 measures of physician-patient communication were extracted, mainly from primary care samples in Europe and the USA. Included studies reported a median of 3 out of the nine COSMIN criteria. Scores for internal consistency and content validity were mainly fair or poor. Reliability and structural validity were rated mainly of fair quality. Hypothesis testing scored mostly poor. The quality of psychometric properties of measures evaluated with Terwee et al.''s criteria was rated mainly intermediate or positive.

Discussion

This systematic review identified a number of measures of physician-patient communication. However, further psychometric evaluation of the measures is strongly recommended. The application of quality criteria like the COSMIN checklist could improve the methodological quality of psychometric property studies as well as the comparability of the studies'' results.     

Psychometric Properties of the Participation Scale among Former Buruli Ulcer Patients in Ghana and Benin

Background

Buruli ulcer is a stigmatising disease treated with antibiotics and wound care, and sometimes surgical intervention is necessary. Permanent limitations in daily activities are a common long term consequence. It is unknown to what extent patients perceive problems in participation in social activities. The psychometric properties of the Participation Scale used in other disabling diseases, such as leprosy, was assessed for use in former Buruli ulcer patients.

Methods

Former Buruli ulcer patients in Ghana and Benin, their relatives, and healthy community controls were interviewed using the Participation Scale, Buruli Ulcer Functional Limitation Score, and the Explanatory Model Interview Catalogue to measure stigma. The Participation Scale was tested for the following psychometric properties: discrimination, floor and ceiling effects, internal consistency, inter-item correlation, item-total correlation and construct validity.

Results

In total 386 participants (143 former Buruli ulcer patients with their relatives (137) and 106 community controls) were included in the study. The Participation Scale displayed good discrimination between former Buruli ulcer patients and healthy community controls. No floor and ceiling effects were found. Internal consistency (Cronbach''s alpha) was 0.88. In Ghana, mean inter-item correlation of 0.29 and item-total correlations ranging from 0.10 to 0.69 were found while in Benin, a mean inter-item correlation of 0.28 was reported with item-total correlations ranging from −0.08 to 0.79. With respect to construct validity, 4 out of 6 hypotheses were not rejected, though correlations between various constructs differed between countries.

Conclusion

The results indicate the Participation Scale has acceptable psychometric properties and can be used for Buruli ulcer patients in Ghana and Benin. Future studies can use this Participation Scale to evaluate the long term restrictions in participation in daily social activities of former BU patients.     

Development and Validation of the Pre-Hospital Stroke Symptoms Coping Test

Background and Purpose

Measures of specific knowledge of coping with pre-hospital stroke symptoms can help educate high-risk patients and family caregivers. This study aimed to develop and validate the Pre-hospital Stroke Symptoms Coping Test (PSSCT).

Materials and Methods

Reliability and validity were analyzed using multiple data sources. The Delphi expert consultation method was applied to assess the test’s surface validity and content validity index. The final edition of the 19-item PSSCT contained 3 sections assessing coping with typical symptoms and symptoms associated with vomiting and twitching. Its psychometric properties were investigated in a community sample of 300 high-risk patients and family members.

Results

The PSSCT was readily accepted by participants. It demonstrated adequate surface validity and content validity, and good internal consistency (KR₂₀ = 0.822) and test-retest reliability (0.769), with difficulty (P) and degree of differentiation (D) ranges of 0.28–0.83 and 0.15–0.66, respectively. It was also able to distinguish between individuals who had/had not experienced a stroke. Experienced individuals scored significantly higher overall and on coping with typical symptoms and twitching (P<0.01).

Conclusions

The PSSCT can practically and directly assess critical knowledge regarding coping with pre-hospital stroke symptoms and has good reliability and validity.     

Psychometric Evaluation of the HIV Stigma Scale in a Swedish Context

Background

HIV-related stigma has negative consequences for infected people''s lives and is a barrier to HIV prevention. Therefore valid and reliable instruments to measure stigma are needed to enable mapping of HIV stigma. This study aimed to evaluate the psychometric properties of the HIV stigma scale in a Swedish context with regard to construct validity, data quality, and reliability.

Methods

The HIV stigma scale, developed by Berger, Ferrans, and Lashley (2001), was distributed to a cross-sectional sample of people living with HIV in Sweden (n = 194). The psychometric evaluation included exploratory factor analysis together with an analysis of the distribution of scores, convergent validity by correlations between the HIV stigma scale and measures of emotional well-being, and an analysis of missing items and floor and ceiling effects. Reliability was assessed using Cronbach''s α.

Results

The exploratory factor analysis suggested a four-factor solution, similar to the original scale, with the dimensions personalised stigma, disclosure concerns, negative self-image, and concerns with public attitudes. One item had unacceptably low loadings and was excluded. Correlations between stigma dimensions and emotional well-being were all in the expected direction and ranged between −0.494 and −0.210. The instrument generated data of acceptable quality except for participants who had not disclosed their HIV status to anybody. In line with the original scale, all subscales demonstrated acceptable internal consistency with Cronbach''s α 0.87–0.96.

Conclusion

A 39-item version of the HIV stigma scale used in a Swedish context showed satisfactory construct validity and reliability. Response alternatives are suggested to be slightly revised for items assuming the disclosure of diagnosis to another person. We recommend that people that have not disclosed should skip all questions belonging to the dimension personalised stigma. Our analysis confirmed construct validity of the instrument even without this dimension.     

Quality of Life amongst Older Brazilians: A Cross-Cultural Validation of the CASP-19 into Brazilian-Portuguese

Introduction

As population ageing becomes a global phenomenon the need to understand the quality of life of older people around the world has become increasingly salient. The CASP-19 is a well established measure of quality of later life. The scale is composed of 19 items which map onto the four domains of control (C), Autonomy (A), Self-Realisation (S) and Pleasure (P). It has already been translated to 12 languages and has been used in a number of national and international studies. However use of the scale outside of Europe has been very limited. The objective of this study was to translate and evaluate the use of the CASP-19 amongst older Brazilians.

Methods

The CASP-19 was translated from English to Portuguese, back-translated and submitted to an analysis of equivalence by a committee of judges. The scale was then administered to a sample of community dwelling older people in Recife, Brazil (n = 87), and tested for psychometric properties. The Control and Pleasure domains exhibited good internal consistency. By removing one item from each of the Autonomy and Self Realisation domains their internal consistency was improved.

Results

The mean age of the sample was 75.6±0.7 years, subjects were mainly female (52.9%), white (52.9%), who lived without a partner (54%), and had a monthly income varying from USD 340.00 to USD 850.00. Translation and cross-cultural adaptation permitted good understanding and applicability of final version. Psychometric analyses revealed that the removal of two items improved the internal consistency of the Autonomy and Pleasure domains. Confirmatory factor analyses suggest that a 16 item, four factor, model best fits the data.

Conclusion

In this small exploratory study the CASP-19 Brazil demonstrated good psychometric properties. It was easy to use for both participants and researchers. Hopefully future studies in Brazil will employ the scale so that more direct cross national comparisons can be made with older people in Europe and the US.     

Relevance of Quality of Life Assessment for Multiple Sclerosis Patients with Memory Impairment

Background

Memory disturbances, in particular episodic verbal memory dysfunction, are the most frequent cognitive impairment observed in multiple sclerosis (MS) patients. The use of self-reported outcomes for evaluating treatment and managing care of these subjects has been questioned. The aim of this study was to provide new evidence about the suitability of self-reported outcomes for use in this impaired population by exploring the internal structure, reliability and external validity of a specific quality of life (QoL) instrument, the Multiple Sclerosis International Quality of Life questionnaire (MusiQoL).

Methods

Design: cross-sectional study. Inclusion criteria: MS patients of any disease subtype. Data collection: sociodemographic (age, gender, marital status, education level, and occupational activity) and clinical data (MS subtype, Expanded Disability Status Scale, disease duration); QoL (MusiQoL and SF36); and memory performance (Grober and Buschke test). In accordance with the French norms of the memory test, non-impaired and impaired populations were defined for short- and long-delay free composites and for short- and long-delay total composites. For the 8 populations, psychometric properties were compared to those reported from the reference population assessed in the validation study.

Principal Findings

One hundred and twenty-four consecutive patients were enrolled. The analysis performed in the impaired populations showed that the questionnaire structure adequately matched the initial structure of the MusiQoL. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the reference population.

Conclusions/Significance

Our study suggests that memory dysfunction did not compromise the reliability or validity of the self-reported QoL questionnaires.     

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents

Objectives

Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain.

Methods

The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2).

Results

Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency.

Conclusions

Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided.     

Structure of the Children's Revised Impact of Event Scale (CRIES) with Children and Adolescents Exposed to Debris Flood

Aim

PTSD symptoms were pervasive among children and adolescents after experiencing or exposure to traumatic events. Screening and diagnosis of PTSD symptoms is crucial in trauma-related research and practice. The 13-item Children''s Revised Impact of Event Scale (CRIES) has been demonstrated to be a valid and reliable tool to achieve this goal. This study was designed to examine the psychometric properties of the 13-item CRIES in a sample of Chinese debris flood victims.

Methods

A total of 268 participants (145 girls, 123 boys) aged 8–18 years were recruited from an integral part of a service oriented project, supported by the Institute of Psychology, Chinese Academy of Sciences following the debris flood. The participants were given the 13-item CRIES 3 months after the debris flood.

Results

The results of confirmatory factor analysis indicated that a two-factor structure (intrusion+arousal vs avoidance) emerged as the model best fit in total sample, boys and girls subsamples, respectively. The scale was also demonstrated to have good internal consistency (Cronbach''s alpha = 0.83).

Conclusion

The study confirmed the good psychometric properties of the CRIES and its'' applicability to Chinese children and adolescents. Moreover, these findings imply that the CRIES factor structure is stable across age, gender, and different types of trauma.     

Mixed emotional experience is associated with and precedes improvements in psychological well-being

Background

The relationships between positive and negative emotional experience and physical and psychological well-being have been well-documented. The present study examines the prospective positive relationship between concurrent positive and negative emotional experience and psychological well-being in the context of psychotherapy.

Methods

47 adults undergoing psychotherapy completed measures of psychological well-being and wrote private narratives that were coded by trained raters for emotional content.

Results

The specific concurrent experience of happiness and sadness was associated with improvements in psychological well-being above and beyond the impact of the passage of time, personality traits, or the independent effects of happiness and sadness. Changes in mixed emotional experience preceded improvements in well-being.

Conclusions

Experiencing happiness alongside sadness in psychotherapy may be a harbinger of improvement in psychological well-being.     

Comparison of the Web-Based and Digital Questionnaires of the Spanish and Catalan Versions of the KIDSCREEN-52

Background

The objectives of the study were to develop web-based Spanish and Catalan versions of the KIDSCREEN, and to compare scores and psychometric properties with the paper version.

Methods

Internet and paper Spanish and Catalan versions of the KIDSCREEN-52 were included in a cross-sectional study in school-age children. Web-based and paper Spanish or Catalan versions of the KIDSCREEN-52 were administered to students aged 8 to 18 years from primary and secondary schools in Palafolls (Barcelona, Spain, n = 923). All students completed both web-based and paper versions during school time with an interval of at least 2 hours between administrations. The order of administration was randomized. The KIDSCREEN-52, the Strengths and Difficulties Questionnaire (SDQ), and sociodemographic variables were collected. Missing values, floor and ceiling effects, and internal consistency were compared between both versions, as well as mean score differences, level of agreement, and known groups and construct validity.

Results

Participation rate was 77% (n = 715). Web-based and paper versions showed low percentage of missing values and similar high ceiling effect (range 0 to 44%). Mean score differences showed an effect size (ES) lower than 0.2 in all dimensions. Internal consistency ranged from 0.7 to 0.88, and degree of agreement was excellent (Intraclass correlation coefficient [ICC] range 0.75 to 0.87). Expected differences were seen by sex, age, socioeconomic status and mental health status.

Conclusions

The web-based KIDSCREEN-52 showed similar scale score and reliability and validity than the paper version. It will incorporate the child population in the assessment of quality of life providing a more attractive format.     

Body Awareness: Construct and Self-Report Measures

Objectives

Heightened body awareness can be adaptive and maladaptive. Improving body awareness has been suggested as an approach for treating patients with conditions such as chronic pain, obesity and post-traumatic stress disorder. We assessed the psychometric quality of selected self-report measures and examined their items for underlying definitions of the construct.

Data sources

PubMed, PsychINFO, HaPI, Embase, Digital Dissertations Database.

Review methods

Abstracts were screened; potentially relevant instruments were obtained and systematically reviewed. Instruments were excluded if they exclusively measured anxiety, covered emotions without related physical sensations, used observer ratings only, or were unobtainable. We restricted our study to the proprioceptive and interoceptive channels of body awareness. The psychometric properties of each scale were rated using a structured evaluation according to the method of McDowell. Following a working definition of the multi-dimensional construct, an inter-disciplinary team systematically examined the items of existing body awareness instruments, identified the dimensions queried and used an iterative qualitative process to refine the dimensions of the construct.

Results

From 1,825 abstracts, 39 instruments were screened. 12 were included for psychometric evaluation. Only two were rated as high standard for reliability, four for validity. Four domains of body awareness with 11 sub-domains emerged. Neither a single nor a compilation of several instruments covered all dimensions. Key domains that might potentially differentiate adaptive and maladaptive aspects of body awareness were missing in the reviewed instruments.

Conclusion

Existing self-report instruments do not address important domains of the construct of body awareness, are unable to discern between adaptive and maladaptive aspects of body awareness, or exhibit other psychometric limitations. Restricting the construct to its proprio- and interoceptive channels, we explore the current understanding of the multi-dimensional construct and suggest next steps for further research.     

Evaluation of the London Measure of Unplanned Pregnancy in a United States population of women

Objective

To evaluate the reliability and validity of the London Measure of Unplanned Pregnancy (a U.K.-developed measure of pregnancy intention), in English and Spanish translation, in a U.S. population of women.

Methods

A psychometric evaluation study of the London Measure of Unplanned Pregnancy (LMUP), a six-item, self-completion paper measure was conducted with 346 women aged 15–45 who presented to San Francisco General Hospital for termination of pregnancy or antenatal care. Analyses of the two language versions were carried out separately. Reliability (internal consistency) was assessed using Cronbach''s alpha and item-total correlations. Test-retest reliability (stability) was assessed using weighted Kappa. Construct validity was assessed using principal components analysis and hypothesis testing.

Results

Psychometric testing demonstrated that the LMUP was reliable and valid in both U.S. English (alpha = 0.78, all item-total correlations >0.20, weighted Kappa = 0.72, unidimensionality confirmed, hypotheses met) and Spanish translation (alpha = 0.84, all item-total correlations >0.20, weighted Kappa = 0.77, unidimensionality confirmed, hypotheses met).

Conclusion

The LMUP was reliable and valid in U.S. English and Spanish translation and therefore may now be used with U.S. women.     

Comparison of Three Quality of Life Instruments in Lymphatic Filariasis: DLQI,WHODAS 2.0, and LFSQQ

Background

The Global Program to Eliminate Lymphatic Filariasis aims to interrupt transmission of lymphatic filariasis and manage morbidity in people currently living with the disease. A component of morbidity management is improving health-related quality of life (HRQoL) in patients. Measurement of HRQoL in current management programs is varied because of the lack of a standard HRQoL tool for use in the lymphatic filariasis population.

Methodology/Principal Findings

In this study, the psychometric properties of three health status measures were compared when used in a group of lymphatic filariasis patients and healthy controls. The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0), the Dermatology Life Quality Index (DLQI), and the Lymphatic Filariasis Quality of Life Questionnaire (LFSQQ) were administered to 36 stage II and stage III lymphatic filariasis subjects and 36 age and sex matched controls in Kerala, India. All three tools yielded missing value rates lower than 10%, suggesting high feasibility. Highest internal consistency was seen in the LFSQQ (α = 0.97). Discriminant validity analysis demonstrated that HRQoL was significantly lower in the LF group than in controls for the WHODAS 2.0, DLQI, and LFSQQ, but total HRQoL scores did not differ between stage II and stage III lymphedema subjects. The LFSQQ total score correlated most strongly with the WHODAS 2.0 (r = 0.91, p<0.001) and DLQI (r = 0.81, p<0.001).

Conclusions/Significance

The WHODAS 2.0, DLQI, and LFSQQ demonstrate acceptable feasibility, internal consistency, discriminate validity, and construct validity. Based on our psychometric analyses, the LFSQQ performs the best and is recommended for use in the lymphatic filariasis population.     

Multi-Dimensional Health Assessment Questionnaire in China: Reliability,Validity and Clinical Value in Patients with Rheumatoid Arthritis

Objective

To evaluate the psychometric properties and clinical utility of Chinese Multidimensional Health Assessment Questionnaire (MDHAQ-C) in patients with rheumatoid arthritis (RA) in China.

Methods

162 RA patients were recruited in the evaluation process. The reliability of the questionnaire was tested by internal consistency and item analysis. Convergent validity was assessed by correlations of MDHAQ-C with Health Assessment Questionnaire (HAQ), the 36-item Short-Form Health Survey (SF-36) and the Hospital anxiety and depression scales (HAD). Discriminant validity was tested in groups of patients with varied disease activities and functional classes. To evaluate the clinical values, correlations were calculated between MDHAQ-C and indices of clinical relevance and disease activity. Agreement with the Disease Activity Score (DAS28) and Clinical Disease Activity Index (CDAI) was estimated.

Results

The Cronbach''s alpha was 0.944 in the Function scale (FN) and 0.768 in the scale of psychological status (PS). The item analysis indicated all the items of FN and PS are correlated at an acceptable level. MDHAQ-C correlated with the questionnaires significantly in most scales and scores of scales differed significantly in groups of different disease activity and functional status. MDHAQ-C has moderate to high correlation with most clinical indices and high correlation with a spearman coefficient of 0.701 for DAS 28 and 0.843 for CDAI. The overall agreement of categories was satisfying.

Conclusion

MDHAQ-C is a reliable, valid instrument for functional measurement and a feasible, informative quantitative index for busy clinical settings in Chinese RA patients.     

A New Method to Facilitate Valid and Consistent Grading Cardiac Events in Childhood Cancer Survivors Using Medical Records

Background

Cardiac events (CEs) are among the most serious late effects following childhood cancer treatment. To establish accurate risk estimates for the occurrence of CEs it is essential that they are graded in a valid and consistent manner, especially for international studies. We therefore developed a data-extraction form and a set of flowcharts to grade CEs and tested the validity and consistency of this approach in a series of patients.

Methods

The Common Terminology Criteria for Adverse Events version 3.0 and 4.0 were used to define the CEs. Forty patients were randomly selected from a cohort of 72 subjects with known CEs that had been graded by a physician for an earlier study. To establish whether the new method was valid for appropriate grading, a non-physician graded the CEs by using the new method. To evaluate consistency of the grading, the same charts were graded again by two other non-physicians, one with receiving brief introduction and one with receiving extensive training on the new method. We calculated weighted Kappa statistics to quantify inter-observer agreement.

Results

The inter-observer agreement was 0.92 (95% CI 0.80–1.00) for validity, and 0.88 (0.79–0.98) and 0.99 (0.96–1.00) for consistency with the outcome assessors who had the brief introduction and the extensive training, respectively.

Conclusions

The newly developed standardized method to grade CEs using data from medical records has shown excellent validity and consistency. The study showed that the method can be correctly applied by researchers without a medical background, provided that they receive adequate training.     

Psychometric properties of the Nurses Work Functioning Questionnaire (NWFQ)

Objectives

The Nurses Work Functioning Questionnaire (NWFQ) is a 50-item self-report questionnaire specifically developed for nurses and allied health professionals. Its seven subscales measure impairments in the work functioning due to common mental disorders. Aim of this study is to evaluate the psychometric properties of the NWFQ, by assessing reproducibility and construct validity.

Methods

The questionnaire was administered to 314 nurses and allied health professionals with a re-test in 112 subjects. Reproducibility was assessed by the intraclass correlations coefficients (ICC) and the standard error of measurement (SEM). For construct validity, correlations were calculated with a general work functioning scale, the Endicott Work Productivity Scale (EWPS) (convergent validity) and with a physical functioning scale (divergent validity). For discriminative validity, a Mann Whitney U test was performed testing for significant differences between subjects with mental health complaints and without.

Results

All subscales showed good reliability (ICC: 0.72–0.86), except for one (ICC = 0.16). Convergent validity was good in six subscales, correlations ranged from 0.38–0.62. However, in one subscale the correlation with the EWPS was too low (0.22). Divergent validity was good in all subscales based on correlations ranged from (−0.06)–(−0.23). Discriminative validity was good in all subscales, based on significant differences between subjects with and without mental health complaints (p<0.001–p = 0.003).

Conclusion

The NWFQ demonstrates good psychometric properties, for six of the seven subscales. Subscale “impaired decision making” needs improvement before further use.