Reliability and Validity of the Self- and Interviewer-Administered Versions of the Global Physical Activity Questionnaire (GPAQ)

Objective

The Global Physical Activity Questionnaire (GPAQ) was originally designed to be interviewer-administered by the World Health Organization in assessing physical activity. The main aim of this study was to compare the psychometric properties of a self-administered GPAQ with the original interviewer-administered approach. Additionally, this study explored whether using different accelerometry-based physical activity bout definitions might affect the questionnaire’s validity.

Methods

A total of 110 participants were recruited and randomly allocated to an interviewer- (n = 56) or a self-administered (n = 54) group for test-retest reliability, of which 108 participants who met the wear time criteria were included in the validity study. Reliability was assessed by administration of questionnaires twice with a one-week interval. Criterion validity was assessed by comparing against seven-day accelerometer measures. Two definitions for accelerometry-data scoring were employed: (1) total-min of activity, and (2) 10-min bout.

Results

Participants had similar baseline characteristics in both administration groups and no significant difference was found between the two formats in terms of validity (correlations between the GPAQ and accelerometer). For validity, the GPAQ demonstrated fair-to-moderate correlations for moderate-to-vigorous physical activity (MVPA) for self-administration (r _s = 0.30) and interviewer-administration (r _s = 0.46). Findings were similar when considering 10-min activity bouts in the accelerometer analysis for MVPA (r _s = 0.29 vs. 0.42 for self vs. interviewer). Within each mode of administration, the strongest correlations were observed for vigorous-intensity activity. However, Bland-Altman plots illustrated bias toward overestimation for higher levels of MVPA, vigorous- and moderate-intensity activities, and underestimation for lower levels of these measures. Reliability for MVPA revealed moderate correlations (r _s = 0.61 vs. 0.63 for self vs. interviewer).

Conclusions

Our findings showed comparability between both self- and interviewer-administration modes of the GPAQ. The GPAQ in general but especially the self-administered version may offer a relatively inexpensive method for measuring physical activity of various types and at different domains. However, there may be bias in the GPAQ measurements depending on the overall physical activity. It is advisable to incorporate accelerometers in future studies, particularly when measuring different intensities of physical activity.     

Comparison of the Physical Activity and Sedentary Behaviour Assessment Questionnaire and the Short-Form International Physical Activity Questionnaire: An Analysis of Health Survey for England Data

Background

The Physical Activity and Sedentary Behaviour Assessment Questionnaire (PASBAQ), used within the Health Survey for England (HSE) at 5-yearly intervals, is not included annually due to funding and interview-length constraints. Policy-makers and data-users are keen to consider shorter instruments such as the Short-form International Physical Activity Questionnaire (IPAQ) for the annual survey. Both questionnaires were administered in HSE 2012, enabling comparative assessment in a random sample of 1252 adults.

Methods

Relative agreement using prevalence-adjusted bias-adjusted Kappa (PABAK) statistics was estimated for: sufficient aerobic activity (moderate-to-vigorous physical activity [MVPA] ≥150minutes/week); inactivity (MVPA<30minutes/week); and excessive sitting (≥540minutes/weekday). Cross-sectional associations with health outcomes were compared across tertiles of MVPA and tertiles of sitting time using logistic regression with tests for linear trend.

Results

Compared with PASBAQ data, IPAQ-assessed estimates of sufficient aerobic activity and inactivity were higher and lower, respectively; estimates of excessive sitting were higher. Demographic patterns in prevalence were similar. Agreement using PABAK statistics was fair-to-moderate for sufficient aerobic activity (0.32–0.49), moderate-to-substantial for inactivity (0.42–0.74), and moderate-to-substantial for excessive sitting (0.49–0.75). As with the PASBAQ, IPAQ-assessed MVPA and sitting each showed graded associations with mental well-being (women: P for trend = 0.003 and 0.004, respectively) and obesity (women: P for trend = 0.007 and 0.014, respectively).

Conclusions

Capturing habitual physical activity and sedentary behaviour through brief questionnaires is complex. Differences in prevalence estimates can reflect differences in questionnaire structure and content rather than differences in reported behaviour. Treating all IPAQ-assessed walking as moderate-intensity contributed to the differences in prevalence estimates. PASBAQ data will be used for population surveillance every 4 to 5 years. The current version of the Short-form IPAQ was included in HSE 2013–14 to enable more frequent assessment of physical activity and sedentary behaviour; a modified version with different item-ordering and additional questions on walking-pace and effort was included in HSE 2015.     

Screening Physical Activity in Family Practice: Validity of the Spanish Version of a Brief Physical Activity Questionnaire

Objectives

The use of brief screening tools to identify inactive patients is essential to improve the efficiency of primary care-based physical activity (PA) programs. However, the current employment of short PA questionnaires within the Spanish primary care pathway is unclear. This study evaluated the validity of the Spanish version of a Brief Physical Activity Assessment Tool (SBPAAT).

Methods

A validation study was carried out within the EVIDENT project. A convenience sample of patients (n = 1,184; age 58.9±13.7 years; 60.5% female) completed the SBPAAT and the 7-day Physical Activity Recall (7DPAR) and, in addition, wore an accelerometer (ActiGraph GT3X) for seven consecutive days. Validity was evaluated by measuring agreement, Kappa correlation coefficients, sensitivity and specificity in achieving current PA recommendations with the 7DPAR. Pearson correlation coefficients with the number of daily minutes engaged in moderate and vigorous intensity PA according to the accelerometer were also assessed. Comparison with accelerometer counts, daily minutes engaged in sedentary, light, moderate, and vigorous intensity PA, total daily kilocalories, and total PA and leisure time expenditure (METs-hour-week) between the sufficiently and insufficiently active groups identified by SBPAAT were reported.

Results

The SBPAAT identified 41.3% sufficiently active (n = 489) and 58.7% insufficiently active (n = 695) patients; it showed moderate validity (k = 0.454, 95% CI: 0.402–0.505) and a specificity and sensitivity of 74.3% and 74.6%, respectively. Validity was fair for identifying daily minutes engaged in moderate (r = 0.215, 95% CI:0.156 to 0.272) and vigorous PA (r = 0.282, 95% CI:0.165 to 0.391). Insufficiently active patients according to the SBPAAT significantly reported fewer counts/minute (-22%), fewer minutes/day of moderate (-11.38) and vigorous PA (-2.69), spent fewer total kilocalories/day (-753), and reported a lower energy cost (METs-hour-week) of physical activities globally (-26.82) and during leisure time (-19.62).

Conclusions

The SBPAAT is a valid tool to identify Spanish-speaking patients who are insufficiently active to achieve health benefits.     

Validity and Reliability of the Dutch Adaptation of the Psoriatic Arthritis Quality of Life (PsAQoL) Questionnaire

Objective

The Psoriatic Arthritis Quality of Life (PsAQoL) questionnaire is a disease- specific instrument developed to measure quality of life (QoL) in patients with psoriatic arthritis (PsA). The aim of this study was to translate the measure into Dutch and to determine its psychometric properties.

Method

Translation of the original English PsAQoL into Dutch was performed by bilingual and lay panel. Ten field-test interviews with PsA patients were performed to assess face and content validity. In total, 211 PsA patients were included in a test-retest postal survey to investigate the reliability and construct validity of the Dutch adaptation of the PsAQoL. The PsAQoL, Health Assessment Questionnaire (HAQ) and Skindex-17 were administered on two different occasions approximately two weeks apart.

Results

The Dutch version of the PsAQoL was found to be relevant, understandable and easy to complete in only a few minutes. It correlated as expected with the HAQ (Spearman’s ρ = 0.72) and the 2 subscales of the Skindex-17 (ρ = 0.40 for the psychosocial and ρ = 0.46 for the symptom scale). Furthermore, the measure had good internal consistency (Cronbach’s α = 0.92) and test-retest reliability (ρ = 0.89). The PsAQoL was able to define groups of patients based on self-reported general health status, self-reported severity of PsA and flare of arthritis. Duration of PsA did not influence PsAQoL scores.

Conclusions

The Dutch version of the PsAQoL is a valid and reliable questionnaire suitable for use in clinical or research settings to asses PsA-specific QoL.     

Testing the Validity and Reliability of the Shame Questionnaire among Sexually Abused Girls in Zambia

Purpose

The aim of the current study is to test the validity and reliability of the Shame Questionnaire among traumatized girls in Lusaka, Zambia.

Methods

The Shame Questionnaire was validated through both classical test and item response theory methods. Internal reliability, criterion validity and construct validity were examined among a sample of 325 female children living in Zambia. Sub-analyses were conducted to examine differences in construct validity among girls who reported sexual abuse and girls who did not.

Results

All girls in the sample were sexually abused, but only 61.5% endorsed or reported that sexual abuse had occurred. Internal consistency was very good among the sample with alpha = .87. Criterion validity was demonstrated through a significant difference of mean Shame Questionnaire scores between girls who experienced 0–1 trauma events and more than one traumatic event, with higher mean Shame Questionnaire scores among girls who had more than one traumatic event (p = .004 for 0–1 compared to 2 and 3 events and p = .016 for 0–1 compared to 4+ events). Girls who reported a history of witnessing or experiencing physical abuse had a significantly higher mean Shame Questionnaire score than girls who did not report a history of witnessing or experiencing physical abuse (p<.0001). There was no significant difference in mean Shame Questionnaire score between girls who reported a sexual abuse history and girls who did not. Exploratory factor analysis indicated a two-factor model of the Shame Questionnaire, with an experience of shame dimension and an active outcomes of shame dimension. Item response theory analysis indicated adequate overall item fit. Results also indicate potential differences in construct validity between girls who did and did not endorse sexual abuse.

Conclusions

This study suggests the general utility of the Shame Questionnaire among Zambian girls and demonstrates the need for more psychometric studies in low and middle income countries.     

Accelerometer-Determined Physical Activity and Its Comparison with the International Physical Activity Questionnaire in a Sample of Nigerian Adults

Introduction

Accurate assessment of physical activity to identify current levels and changes within the population is dependent on the precision of the measurement tools. The aim of this study was to compare components of physical activity measured with an adapted version of the International Physical Activity Questionnaire (Hausa IPAQ-SF) and the accelerometer in a sample of Nigeria adults.

Methods

One hundred and forty-four participants (Mean age = 32.6±9.9 years, 40.3% women) in a cross-sectional study wore an accelerometer for seven consecutive days and completed the Hausa IPAQ-SF questionnaire on the eighth day. Total physical activity, time spent in moderate-to-vigorous activity (MVPA) and sedentary time assessed by Hausa IPAQ-SF and accelerometer were compared. The absolute and criterion- related validity of the Hausa IPAQ-SF was assessed by Bland-Altman analysis and Spearman Correlation Coefficients, respectively. Specificity and sensitivity were calculated to classify individuals according to the global standard guideline for sufficient physical activity.

Results

Compared with the accelerometer, higher time in MVPA and total physical activity were reported on the Hausa IPAQ-SF (p<0.001), while low to moderate correlations (Rs = 0.03–0.38) were found between the two methods. The 95% limits of agreement were wide between methods for total physical activity (−23019 to 20375 METmin.d⁻¹) and sedentary time (−510 to 150 min.d⁻¹). The sensitivity (76.2%) of Hausa IPAQ-SF to identify insufficiently active people was good, but its specificity (33.3%) to correctly classify sufficiently active people was low.

Conclusions

The Hausa IPAQ-SF overestimated components of physical activity among Nigerian adults, and demonstrated poor to moderate evidence of absolute and criterion validity. Further evaluation of IPAQ and other self-report physical activity instruments in other Africa populations could enhance accurate evaluation of physical activity data in the region countries.     

Reliability and Validity of the Multimedia Activity Recall in Children and Adults (MARCA) in People with Chronic Obstructive Pulmonary Disease

Objective

To determine the reliability and validity of the Multimedia Activity Recall for Children and Adults (MARCA) in people with chronic obstructive pulmonary disease (COPD).

Design

People with COPD and their carers completed the Multimedia Activity Recall for Children and Adults (MARCA) for four, 24-hour periods (including test-retest of 2 days) while wearing a triaxial accelerometer (Actigraph GT3X+®), a multi-sensor armband (Sensewear Pro3®) and a pedometer (New Lifestyles 1000®).

Setting

Self reported activity recalls (MARCA) and objective activity monitoring (Accelerometry) were recorded under free-living conditions.

Participants

24 couples were included in the analysis (COPD; age 74.4±7.9 yrs, FEV₁ 54±13% Carer; age 69.6±10.9 yrs, FEV₁ 99±24%).

Interventions

Not applicable.

Main Outcome Measure(s)

Test-retest reliability was compared for MARCA activity domains and different energy expenditure zones. Validity was assessed between MARCA-derived physical activity level (in metabolic equivalent of task (MET) per minute), duration of moderate to vigorous physical activity (min) and related data from the objective measurement devices. Analysis included intra-class correlation coefficients (ICC), Bland-Altman analyses, paired t-tests (p) and Spearman''s rank correlation coefficients (r_s).

Results

Reliability between occasions of recall for all activity domains was uniformly high, with test-retest correlations consistently >0.9. Validity correlations were moderate to strong (r_s = 0.43–0.80) across all comparisons. The MARCA yields comparable PAL estimates and slightly higher moderate to vigorous physical activity (MVPA) estimates.

Conclusion

In older adults with chronic illness, the MARCA is a valid and reliable tool for capturing not only the time and energy expenditure associated with physical and sedentary activities but also information on the types of activities.     

Physical Activity Characteristics across GOLD Quadrants Depend on the Questionnaire Used

Background

The GOLD multidimensional classification of COPD severity combines the exacerbation risk with the symptom experience, for which 3 different questionnaires are permitted. This study investigated differences in physical activity (PA) in the different GOLD quadrants and patient’s distribution in relation to the questionnaire used.

Methods

136 COPD patients (58±21% FEV₁ predicted, 34F/102M) completed COPD assessment test (CAT), clinical COPD questionnaire (CCQ) and modified Medical Research Council (mMRC) questionnaire. Exacerbation history, spirometry and 6MWD were collected. PA was objectively measured for 2 periods of 1 week, 6 months apart, in 5 European centres; to minimise seasonal and clinical variation the average of these two periods was used for analysis.

Results

GOLD quadrants C+D had reduced PA compared with A+B (3824 [2976] vs. 5508 [4671] steps.d-1, p<0.0001). The choice of questionnaire yielded different patient distributions (agreement mMRC-CAT κ = 0.57; CCQ-mMRC κ = 0.71; CCQ-CAT κ = 0.72) with different clinical characteristics. PA was notably lower in patients with an mMRC score ≥2 (3430 [2537] vs. 5443 [3776] steps.d^-1, p <0.001) in both the low and high risk quadrants.

Conclusions

Using different questionnaires changes the patient distribution and results in different clinical characteristics. Therefore, standardization of the questionnaire used for classification is critical to allow comparison of different studies using this as an entry criterion.

Clinical Trial Registration

ClinicalTrials.gov {"type":"clinical-trial","attrs":{"text":"NCT01388218","term_id":"NCT01388218"}}NCT01388218     

A Reliability and Validity Study of the Bergen Shift Work Sleep Questionnaire in Nurses Working Three-Shift Rotations

The “Bergen Shift Work Sleep Questionnaire” (BSWSQ) was developed to systematically assess discrete sleep problems related to different work shifts (day, evening, night shifts) and rest days. In this study, we assessed the psychometric properties of the BSWSQ using a sample of 760 nurses, all working in a three-shift rotation schedule: day, evening, and night shifts. BSWSQ measures insomnia symptoms using seven questions: >30-min sleep onset latency, >30-min wake after sleep onset, >30-min premature awakenings, nonrestorative sleep, being tired/sleepy at work, during free time on work days, and when not working/on vacation. Symptoms are assessed separately for each work shift and rest days, as “never,” “rarely,” “sometimes,” “often,” “always,” or “not applicable.” We investigated the BSWSQ model fit, reliability (test-retest of a subsample, n?=?234), and convergent and discriminant validity between the BSWSQ and Epworth Sleepiness Scale, Fatigue Questionnaire, and Hospital Anxiety Depression Scale. We also investigated differences in mean scores between the different insomnia symptoms with respect to different work shifts and rest days. BSWSQ demonstrated an adequate model fit using structural equation modeling: root mean square error of approximation?=?.071 (90% confidence interval [CI]?=?.066–.076), comparative fit index?=?.91, and chi-square/degrees of freedom?=?4.41. The BSWSQ demonstrated good reliability (test-retest coefficients p?<?.001). We found good convergent and discriminant validity between BSWSQ and the other scales (all coefficients p?<?.001). There were significant differences between the overall/composite scores of the various work shifts. Night shift showed the highest score compared to day and evening shifts as well as to rest days (all post hoc comparisons p?<?.001). Mean scores of different symptoms also varied significantly within the individual work shifts. We conclude that the BSWSQ meets the necessary psychometric standards, enabling systematic study of discrete insomnia symptoms in different work shifts. (Author correspondence: elisabeth.flo@psykp.uib.no)     

Reliability and Validity of Instruments for Assessing Perinatal Depression in African Settings: Systematic Review and Meta-Analysis

Background

A major barrier to improving perinatal mental health in Africa is the lack of locally validated tools for identifying probable cases of perinatal depression or for measuring changes in depression symptom severity. We systematically reviewed the evidence on the reliability and validity of instruments to assess perinatal depression in African settings.

Methods and Findings

Of 1,027 records identified through searching 7 electronic databases, we reviewed 126 full-text reports. We included 25 unique studies, which were disseminated in 26 journal articles and 1 doctoral dissertation. These enrolled 12,544 women living in nine different North and sub-Saharan African countries. Only three studies (12%) used instruments developed specifically for use in a given cultural setting. Most studies provided evidence of criterion-related validity (20 [80%]) or reliability (15 [60%]), while fewer studies provided evidence of construct validity, content validity, or internal structure. The Edinburgh postnatal depression scale (EPDS), assessed in 16 studies (64%), was the most frequently used instrument in our sample. Ten studies estimated the internal consistency of the EPDS (median estimated coefficient alpha, 0.84; interquartile range, 0.71-0.87). For the 14 studies that estimated sensitivity and specificity for the EPDS, we constructed 2 x 2 tables for each cut-off score. Using a bivariate random-effects model, we estimated a pooled sensitivity of 0.94 (95% confidence interval [CI], 0.68-0.99) and a pooled specificity of 0.77 (95% CI, 0.59-0.88) at a cut-off score of ≥9, with higher cut-off scores yielding greater specificity at the cost of lower sensitivity.

Conclusions

The EPDS can reliably and validly measure perinatal depression symptom severity or screen for probable postnatal depression in African countries, but more validation studies on other instruments are needed. In addition, more qualitative research is needed to adequately characterize local understandings of perinatal depression-like syndromes in different African contexts.     

Determination of Antibodies to Endogenous Bioregulators for Assessing the Physical Activity of Figure Skaters

Human Physiology - The determination of biochemical and immunological indicators reflecting the state of regulatory systems of the organism involved in adaptation to physical activity was carried...     

Dietary Behaviour and Socioeconomic Position: The Role of Physical Activity Patterns

Background

The positive association between education level and health outcomes can be partly explained by dietary behaviour. We investigated the associations between education and several indices of food intake and potential influencing factors, placing special emphasis on physical-activity patterns, using a representative sample of the German adult population.

Methods

The German National Health Interview and Examination Survey 1998 (GNHIES98) involved 7,124 participants aged between 18 and 79. Complete information on the exposure (education) and outcome (nutrition) variables was available for 6,767 persons. The associations between ‘education’ and indices of ‘sugar-rich food’, ‘fat-rich food’, ‘fruit-and-vegetable’ and ‘alcohol’ intake were analysed separately for men and women using multivariate logistic regression analysis. Odds ratios (OR) of education level on nutrition outcomes were calculated and adjusted for age, region (former East/West Germany), occupation, income and other influencing factors such as physical activity indicators.

Results

Men and women with only a primary education had a more frequent intake of sugar-rich and fat-rich foods and a less frequent intake of fruit and vegetables and alcohol than people with a tertiary education. ‘Physical work activity’ partly explained the associations between education and sugar-rich food intake. The interference with physical work activity was stronger among men than women. No significant associations between education and energy-dense food intake were observed in the retirement-age group of persons aged 65+ and among persons with low energy expenditure.

Conclusions

In Germany, adults with a low level of education report that they consume energy-dense foods more frequently – and fruit and vegetables and alcohol less frequently – than adults with a high education level. High levels of physical work activity among adults with a low education level may partly explain why they consume more energy-dense foods.     

The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity

Objective

Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity.

Methods

Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures.

Results

The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version’s factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations.

Conclusions

The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research.     

Interactive Multimedia for Promoting Physical Activity (IMPACT) in Children

Objective: To develop and examine the efficacy of a computer‐based interactive multimedia curriculum for promoting physical activity in fourth grade children. Research Methods and Procedures: The participants were 209 fourth grade children (mean age of 9.5 ± 0.4 years) from four schools. Two schools received an 8‐week multimedia intervention delivered by interactive CD‐ROM, supplemented by four classroom and four homework assignments. Two control schools received educational CD‐ROMS not related to health outcomes. Measures conducted before and after intervention included height, weight, percentage body fat (bioimpedance analysis), physical activity (5‐day accelerometry), and psychosocial aspects of physical activity by questionnaire. All outcomes were examined using general linear models. Results: There was a significant treatment effect for obesity reduction in girls but not in boys. There were no significant treatment effects on total physical activity by accelerometry (total counts per minute), but there was an overall treatment effect on reducing percent of time in moderate‐intensity activity (16.5% to 15% of the time) and significant sex‐by‐ treatment interactions for light‐intensity activities (reduction in boys from 78% to 75% of the time and an increase in girls from 78% to 81% of the time). There were marginal/significant treatment effects for improvements in behavioral outcomes, including self‐efficacy (p = 0.06), social norms (p = 0.07), and outcome expectancies (p = 0.049). Discussion: The interactive multimedia curriculum favored an improvement in obesity indices in girls and was associated with subtle changes in physical activity in girls and general improvement in psychosocial outcomes related to physical activity.     

Validity of the reduced version of the Morningness-Eveningness Questionnaire

Sleep and Biological Rhythms - The aim of the present work was to validate the reduced version of the Morningness-Eveningness Questionnaire (MEQr) using circadian motor activity as external...     

Testing for Validity and Reliability in Cross-Cultural Research

A set of procedures is offered for assessing interraler reliability and certain aspects of validity of codes in cross-cultural studies. The method assumes that at least two independent raters have coded more than one trait. Each trait coded by one rater is correlated with each trait coded by a second, and all the codings by a single rater are intercorrelated with each other. The results are presented in a multitrait-multi-rater matrix. From this matrix it is possible to determine the interrater reliability and discriminant validity of trails in addition to a higher order concept based on pairs of traits.