Reliability and Validity of the Self- and Interviewer-Administered Versions of the Global Physical Activity Questionnaire (GPAQ)

Objective

The Global Physical Activity Questionnaire (GPAQ) was originally designed to be interviewer-administered by the World Health Organization in assessing physical activity. The main aim of this study was to compare the psychometric properties of a self-administered GPAQ with the original interviewer-administered approach. Additionally, this study explored whether using different accelerometry-based physical activity bout definitions might affect the questionnaire’s validity.

Methods

A total of 110 participants were recruited and randomly allocated to an interviewer- (n = 56) or a self-administered (n = 54) group for test-retest reliability, of which 108 participants who met the wear time criteria were included in the validity study. Reliability was assessed by administration of questionnaires twice with a one-week interval. Criterion validity was assessed by comparing against seven-day accelerometer measures. Two definitions for accelerometry-data scoring were employed: (1) total-min of activity, and (2) 10-min bout.

Results

Participants had similar baseline characteristics in both administration groups and no significant difference was found between the two formats in terms of validity (correlations between the GPAQ and accelerometer). For validity, the GPAQ demonstrated fair-to-moderate correlations for moderate-to-vigorous physical activity (MVPA) for self-administration (r _s = 0.30) and interviewer-administration (r _s = 0.46). Findings were similar when considering 10-min activity bouts in the accelerometer analysis for MVPA (r _s = 0.29 vs. 0.42 for self vs. interviewer). Within each mode of administration, the strongest correlations were observed for vigorous-intensity activity. However, Bland-Altman plots illustrated bias toward overestimation for higher levels of MVPA, vigorous- and moderate-intensity activities, and underestimation for lower levels of these measures. Reliability for MVPA revealed moderate correlations (r _s = 0.61 vs. 0.63 for self vs. interviewer).

Conclusions

Our findings showed comparability between both self- and interviewer-administration modes of the GPAQ. The GPAQ in general but especially the self-administered version may offer a relatively inexpensive method for measuring physical activity of various types and at different domains. However, there may be bias in the GPAQ measurements depending on the overall physical activity. It is advisable to incorporate accelerometers in future studies, particularly when measuring different intensities of physical activity.     

Comparison of the Physical Activity and Sedentary Behaviour Assessment Questionnaire and the Short-Form International Physical Activity Questionnaire: An Analysis of Health Survey for England Data

Background

The Physical Activity and Sedentary Behaviour Assessment Questionnaire (PASBAQ), used within the Health Survey for England (HSE) at 5-yearly intervals, is not included annually due to funding and interview-length constraints. Policy-makers and data-users are keen to consider shorter instruments such as the Short-form International Physical Activity Questionnaire (IPAQ) for the annual survey. Both questionnaires were administered in HSE 2012, enabling comparative assessment in a random sample of 1252 adults.

Methods

Relative agreement using prevalence-adjusted bias-adjusted Kappa (PABAK) statistics was estimated for: sufficient aerobic activity (moderate-to-vigorous physical activity [MVPA] ≥150minutes/week); inactivity (MVPA<30minutes/week); and excessive sitting (≥540minutes/weekday). Cross-sectional associations with health outcomes were compared across tertiles of MVPA and tertiles of sitting time using logistic regression with tests for linear trend.

Results

Compared with PASBAQ data, IPAQ-assessed estimates of sufficient aerobic activity and inactivity were higher and lower, respectively; estimates of excessive sitting were higher. Demographic patterns in prevalence were similar. Agreement using PABAK statistics was fair-to-moderate for sufficient aerobic activity (0.32–0.49), moderate-to-substantial for inactivity (0.42–0.74), and moderate-to-substantial for excessive sitting (0.49–0.75). As with the PASBAQ, IPAQ-assessed MVPA and sitting each showed graded associations with mental well-being (women: P for trend = 0.003 and 0.004, respectively) and obesity (women: P for trend = 0.007 and 0.014, respectively).

Conclusions

Capturing habitual physical activity and sedentary behaviour through brief questionnaires is complex. Differences in prevalence estimates can reflect differences in questionnaire structure and content rather than differences in reported behaviour. Treating all IPAQ-assessed walking as moderate-intensity contributed to the differences in prevalence estimates. PASBAQ data will be used for population surveillance every 4 to 5 years. The current version of the Short-form IPAQ was included in HSE 2013–14 to enable more frequent assessment of physical activity and sedentary behaviour; a modified version with different item-ordering and additional questions on walking-pace and effort was included in HSE 2015.     

Screening Physical Activity in Family Practice: Validity of the Spanish Version of a Brief Physical Activity Questionnaire

Objectives

The use of brief screening tools to identify inactive patients is essential to improve the efficiency of primary care-based physical activity (PA) programs. However, the current employment of short PA questionnaires within the Spanish primary care pathway is unclear. This study evaluated the validity of the Spanish version of a Brief Physical Activity Assessment Tool (SBPAAT).

Methods

A validation study was carried out within the EVIDENT project. A convenience sample of patients (n = 1,184; age 58.9±13.7 years; 60.5% female) completed the SBPAAT and the 7-day Physical Activity Recall (7DPAR) and, in addition, wore an accelerometer (ActiGraph GT3X) for seven consecutive days. Validity was evaluated by measuring agreement, Kappa correlation coefficients, sensitivity and specificity in achieving current PA recommendations with the 7DPAR. Pearson correlation coefficients with the number of daily minutes engaged in moderate and vigorous intensity PA according to the accelerometer were also assessed. Comparison with accelerometer counts, daily minutes engaged in sedentary, light, moderate, and vigorous intensity PA, total daily kilocalories, and total PA and leisure time expenditure (METs-hour-week) between the sufficiently and insufficiently active groups identified by SBPAAT were reported.

Results

The SBPAAT identified 41.3% sufficiently active (n = 489) and 58.7% insufficiently active (n = 695) patients; it showed moderate validity (k = 0.454, 95% CI: 0.402–0.505) and a specificity and sensitivity of 74.3% and 74.6%, respectively. Validity was fair for identifying daily minutes engaged in moderate (r = 0.215, 95% CI:0.156 to 0.272) and vigorous PA (r = 0.282, 95% CI:0.165 to 0.391). Insufficiently active patients according to the SBPAAT significantly reported fewer counts/minute (-22%), fewer minutes/day of moderate (-11.38) and vigorous PA (-2.69), spent fewer total kilocalories/day (-753), and reported a lower energy cost (METs-hour-week) of physical activities globally (-26.82) and during leisure time (-19.62).

Conclusions

The SBPAAT is a valid tool to identify Spanish-speaking patients who are insufficiently active to achieve health benefits.     

Validity and Reliability of the Dutch Adaptation of the Psoriatic Arthritis Quality of Life (PsAQoL) Questionnaire

Objective

The Psoriatic Arthritis Quality of Life (PsAQoL) questionnaire is a disease- specific instrument developed to measure quality of life (QoL) in patients with psoriatic arthritis (PsA). The aim of this study was to translate the measure into Dutch and to determine its psychometric properties.

Method

Translation of the original English PsAQoL into Dutch was performed by bilingual and lay panel. Ten field-test interviews with PsA patients were performed to assess face and content validity. In total, 211 PsA patients were included in a test-retest postal survey to investigate the reliability and construct validity of the Dutch adaptation of the PsAQoL. The PsAQoL, Health Assessment Questionnaire (HAQ) and Skindex-17 were administered on two different occasions approximately two weeks apart.

Results

The Dutch version of the PsAQoL was found to be relevant, understandable and easy to complete in only a few minutes. It correlated as expected with the HAQ (Spearman’s ρ = 0.72) and the 2 subscales of the Skindex-17 (ρ = 0.40 for the psychosocial and ρ = 0.46 for the symptom scale). Furthermore, the measure had good internal consistency (Cronbach’s α = 0.92) and test-retest reliability (ρ = 0.89). The PsAQoL was able to define groups of patients based on self-reported general health status, self-reported severity of PsA and flare of arthritis. Duration of PsA did not influence PsAQoL scores.

Conclusions

The Dutch version of the PsAQoL is a valid and reliable questionnaire suitable for use in clinical or research settings to asses PsA-specific QoL.     

Testing the Validity and Reliability of the Shame Questionnaire among Sexually Abused Girls in Zambia

Purpose

The aim of the current study is to test the validity and reliability of the Shame Questionnaire among traumatized girls in Lusaka, Zambia.

Methods

The Shame Questionnaire was validated through both classical test and item response theory methods. Internal reliability, criterion validity and construct validity were examined among a sample of 325 female children living in Zambia. Sub-analyses were conducted to examine differences in construct validity among girls who reported sexual abuse and girls who did not.

Results

All girls in the sample were sexually abused, but only 61.5% endorsed or reported that sexual abuse had occurred. Internal consistency was very good among the sample with alpha = .87. Criterion validity was demonstrated through a significant difference of mean Shame Questionnaire scores between girls who experienced 0–1 trauma events and more than one traumatic event, with higher mean Shame Questionnaire scores among girls who had more than one traumatic event (p = .004 for 0–1 compared to 2 and 3 events and p = .016 for 0–1 compared to 4+ events). Girls who reported a history of witnessing or experiencing physical abuse had a significantly higher mean Shame Questionnaire score than girls who did not report a history of witnessing or experiencing physical abuse (p<.0001). There was no significant difference in mean Shame Questionnaire score between girls who reported a sexual abuse history and girls who did not. Exploratory factor analysis indicated a two-factor model of the Shame Questionnaire, with an experience of shame dimension and an active outcomes of shame dimension. Item response theory analysis indicated adequate overall item fit. Results also indicate potential differences in construct validity between girls who did and did not endorse sexual abuse.

Conclusions

This study suggests the general utility of the Shame Questionnaire among Zambian girls and demonstrates the need for more psychometric studies in low and middle income countries.     

Accelerometer-Determined Physical Activity and Its Comparison with the International Physical Activity Questionnaire in a Sample of Nigerian Adults

Introduction

Accurate assessment of physical activity to identify current levels and changes within the population is dependent on the precision of the measurement tools. The aim of this study was to compare components of physical activity measured with an adapted version of the International Physical Activity Questionnaire (Hausa IPAQ-SF) and the accelerometer in a sample of Nigeria adults.

Methods

One hundred and forty-four participants (Mean age = 32.6±9.9 years, 40.3% women) in a cross-sectional study wore an accelerometer for seven consecutive days and completed the Hausa IPAQ-SF questionnaire on the eighth day. Total physical activity, time spent in moderate-to-vigorous activity (MVPA) and sedentary time assessed by Hausa IPAQ-SF and accelerometer were compared. The absolute and criterion- related validity of the Hausa IPAQ-SF was assessed by Bland-Altman analysis and Spearman Correlation Coefficients, respectively. Specificity and sensitivity were calculated to classify individuals according to the global standard guideline for sufficient physical activity.

Results

Compared with the accelerometer, higher time in MVPA and total physical activity were reported on the Hausa IPAQ-SF (p<0.001), while low to moderate correlations (Rs = 0.03–0.38) were found between the two methods. The 95% limits of agreement were wide between methods for total physical activity (−23019 to 20375 METmin.d⁻¹) and sedentary time (−510 to 150 min.d⁻¹). The sensitivity (76.2%) of Hausa IPAQ-SF to identify insufficiently active people was good, but its specificity (33.3%) to correctly classify sufficiently active people was low.

Conclusions

The Hausa IPAQ-SF overestimated components of physical activity among Nigerian adults, and demonstrated poor to moderate evidence of absolute and criterion validity. Further evaluation of IPAQ and other self-report physical activity instruments in other Africa populations could enhance accurate evaluation of physical activity data in the region countries.     

Physical Activity Characteristics across GOLD Quadrants Depend on the Questionnaire Used

Background

The GOLD multidimensional classification of COPD severity combines the exacerbation risk with the symptom experience, for which 3 different questionnaires are permitted. This study investigated differences in physical activity (PA) in the different GOLD quadrants and patient’s distribution in relation to the questionnaire used.

Methods

136 COPD patients (58±21% FEV₁ predicted, 34F/102M) completed COPD assessment test (CAT), clinical COPD questionnaire (CCQ) and modified Medical Research Council (mMRC) questionnaire. Exacerbation history, spirometry and 6MWD were collected. PA was objectively measured for 2 periods of 1 week, 6 months apart, in 5 European centres; to minimise seasonal and clinical variation the average of these two periods was used for analysis.

Results

GOLD quadrants C+D had reduced PA compared with A+B (3824 [2976] vs. 5508 [4671] steps.d-1, p<0.0001). The choice of questionnaire yielded different patient distributions (agreement mMRC-CAT κ = 0.57; CCQ-mMRC κ = 0.71; CCQ-CAT κ = 0.72) with different clinical characteristics. PA was notably lower in patients with an mMRC score ≥2 (3430 [2537] vs. 5443 [3776] steps.d^-1, p <0.001) in both the low and high risk quadrants.

Conclusions

Using different questionnaires changes the patient distribution and results in different clinical characteristics. Therefore, standardization of the questionnaire used for classification is critical to allow comparison of different studies using this as an entry criterion.

Clinical Trial Registration

ClinicalTrials.gov {"type":"clinical-trial","attrs":{"text":"NCT01388218","term_id":"NCT01388218"}}NCT01388218     

Reliability and Validity of the Multimedia Activity Recall in Children and Adults (MARCA) in People with Chronic Obstructive Pulmonary Disease

Objective

To determine the reliability and validity of the Multimedia Activity Recall for Children and Adults (MARCA) in people with chronic obstructive pulmonary disease (COPD).

Design

People with COPD and their carers completed the Multimedia Activity Recall for Children and Adults (MARCA) for four, 24-hour periods (including test-retest of 2 days) while wearing a triaxial accelerometer (Actigraph GT3X+®), a multi-sensor armband (Sensewear Pro3®) and a pedometer (New Lifestyles 1000®).

Setting

Self reported activity recalls (MARCA) and objective activity monitoring (Accelerometry) were recorded under free-living conditions.

Participants

24 couples were included in the analysis (COPD; age 74.4±7.9 yrs, FEV₁ 54±13% Carer; age 69.6±10.9 yrs, FEV₁ 99±24%).

Interventions

Not applicable.

Main Outcome Measure(s)

Test-retest reliability was compared for MARCA activity domains and different energy expenditure zones. Validity was assessed between MARCA-derived physical activity level (in metabolic equivalent of task (MET) per minute), duration of moderate to vigorous physical activity (min) and related data from the objective measurement devices. Analysis included intra-class correlation coefficients (ICC), Bland-Altman analyses, paired t-tests (p) and Spearman''s rank correlation coefficients (r_s).

Results

Reliability between occasions of recall for all activity domains was uniformly high, with test-retest correlations consistently >0.9. Validity correlations were moderate to strong (r_s = 0.43–0.80) across all comparisons. The MARCA yields comparable PAL estimates and slightly higher moderate to vigorous physical activity (MVPA) estimates.

Conclusion

In older adults with chronic illness, the MARCA is a valid and reliable tool for capturing not only the time and energy expenditure associated with physical and sedentary activities but also information on the types of activities.     

A Reliability and Validity Study of the Bergen Shift Work Sleep Questionnaire in Nurses Working Three-Shift Rotations

The “Bergen Shift Work Sleep Questionnaire” (BSWSQ) was developed to systematically assess discrete sleep problems related to different work shifts (day, evening, night shifts) and rest days. In this study, we assessed the psychometric properties of the BSWSQ using a sample of 760 nurses, all working in a three-shift rotation schedule: day, evening, and night shifts. BSWSQ measures insomnia symptoms using seven questions: >30-min sleep onset latency, >30-min wake after sleep onset, >30-min premature awakenings, nonrestorative sleep, being tired/sleepy at work, during free time on work days, and when not working/on vacation. Symptoms are assessed separately for each work shift and rest days, as “never,” “rarely,” “sometimes,” “often,” “always,” or “not applicable.” We investigated the BSWSQ model fit, reliability (test-retest of a subsample, n?=?234), and convergent and discriminant validity between the BSWSQ and Epworth Sleepiness Scale, Fatigue Questionnaire, and Hospital Anxiety Depression Scale. We also investigated differences in mean scores between the different insomnia symptoms with respect to different work shifts and rest days. BSWSQ demonstrated an adequate model fit using structural equation modeling: root mean square error of approximation?=?.071 (90% confidence interval [CI]?=?.066–.076), comparative fit index?=?.91, and chi-square/degrees of freedom?=?4.41. The BSWSQ demonstrated good reliability (test-retest coefficients p?<?.001). We found good convergent and discriminant validity between BSWSQ and the other scales (all coefficients p?<?.001). There were significant differences between the overall/composite scores of the various work shifts. Night shift showed the highest score compared to day and evening shifts as well as to rest days (all post hoc comparisons p?<?.001). Mean scores of different symptoms also varied significantly within the individual work shifts. We conclude that the BSWSQ meets the necessary psychometric standards, enabling systematic study of discrete insomnia symptoms in different work shifts. (Author correspondence: elisabeth.flo@psykp.uib.no)     

Determination of Antibodies to Endogenous Bioregulators for Assessing the Physical Activity of Figure Skaters

Human Physiology - The determination of biochemical and immunological indicators reflecting the state of regulatory systems of the organism involved in adaptation to physical activity was carried...     

Testing for Validity and Reliability in Cross-Cultural Research

A set of procedures is offered for assessing interraler reliability and certain aspects of validity of codes in cross-cultural studies. The method assumes that at least two independent raters have coded more than one trait. Each trait coded by one rater is correlated with each trait coded by a second, and all the codings by a single rater are intercorrelated with each other. The results are presented in a multitrait-multi-rater matrix. From this matrix it is possible to determine the interrater reliability and discriminant validity of trails in addition to a higher order concept based on pairs of traits.     

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity

Objective

Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity.

Methods

Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures.

Results

The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version’s factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations.

Conclusions

The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research.     

Validity of the reduced version of the Morningness-Eveningness Questionnaire

Sleep and Biological Rhythms - The aim of the present work was to validate the reduced version of the Morningness-Eveningness Questionnaire (MEQr) using circadian motor activity as external...     

Assessing the Construct Validity and Internal Reliability of the Screening Tool Test Your Memory in Patients with Chronic Pain

Patients with chronic pain often complain about cognitive difficulties, and since these symptoms represent an additional source of suffering and distress, evaluating the cognitive status of these patients with valid and reliable tests should be an important part of their overall assessment. Although cognitive impairment is a critical characteristic of pain, there is no specific measure designed to detect these effects in this population. The objective was to analyze the psychometric properties of the “Test Your Memory” (TYM) test in patients with chronic pain of three different origins. A cross-sectional study was carried out on 72 subjects free of pain and 254 patients suffering from different types of chronic pain: neuropathic pain (104), musculoskeletal pain (99) and fibromyalgia (51). The construct validity of the TYM was assessed using the Mini-Mental State Examination (MMSE), Hospital Anxiety and Depression Scale (HADs), Index-9 from MOS-sleep, SF-12, and through the intensity (Visual Analogical Scale) and duration of pain. An exploratory factor analysis was also performed and internal reliability was assessed using Cronbach’s alpha. After adjusting for potential confounders the TYM could distinguish between pain and pain-free patients, and it was correlated with the: MMSE (0.89, p<0.001); HAD-anxiety (-0.50, p<0.001) and HAD-depression scales (-0.52, p<0.001); MOS-sleep Index-9 (-0.49, p<0.001); and the physical (0.49, p < .001) and mental components (0.55, p < .001) of SF-12. The exploratory structure of the TYM showed an 8-factor solution that explained 53% of the variance, and Cronbach’s alpha was 0.66. The TYM is a valid and reliable screening instrument to assess cognitive function in chronic pain patients that will be of particular value in clinical situations.     

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

Objective

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism.

Methods

We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability.

Results

Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains.

Conclusion

The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.     

Multi-Dimensional Health Assessment Questionnaire in China: Reliability,Validity and Clinical Value in Patients with Rheumatoid Arthritis

Objective

To evaluate the psychometric properties and clinical utility of Chinese Multidimensional Health Assessment Questionnaire (MDHAQ-C) in patients with rheumatoid arthritis (RA) in China.

Methods

162 RA patients were recruited in the evaluation process. The reliability of the questionnaire was tested by internal consistency and item analysis. Convergent validity was assessed by correlations of MDHAQ-C with Health Assessment Questionnaire (HAQ), the 36-item Short-Form Health Survey (SF-36) and the Hospital anxiety and depression scales (HAD). Discriminant validity was tested in groups of patients with varied disease activities and functional classes. To evaluate the clinical values, correlations were calculated between MDHAQ-C and indices of clinical relevance and disease activity. Agreement with the Disease Activity Score (DAS28) and Clinical Disease Activity Index (CDAI) was estimated.

Results

The Cronbach''s alpha was 0.944 in the Function scale (FN) and 0.768 in the scale of psychological status (PS). The item analysis indicated all the items of FN and PS are correlated at an acceptable level. MDHAQ-C correlated with the questionnaires significantly in most scales and scores of scales differed significantly in groups of different disease activity and functional status. MDHAQ-C has moderate to high correlation with most clinical indices and high correlation with a spearman coefficient of 0.701 for DAS 28 and 0.843 for CDAI. The overall agreement of categories was satisfying.

Conclusion

MDHAQ-C is a reliable, valid instrument for functional measurement and a feasible, informative quantitative index for busy clinical settings in Chinese RA patients.