Reliability and Validity of Selected PROMIS Measures in People with Rheumatoid Arthritis

Purpose

To evaluate the reliability and validity of 11 PROMIS measures to assess symptoms and impacts identified as important by people with rheumatoid arthritis (RA).

Methods

Consecutive patients (N = 177) in an observational study completed PROMIS computer adapted tests (CATs) and a short form (SF) assessing pain, fatigue, physical function, mood, sleep, and participation. We assessed test-test reliability and internal consistency using correlation and Cronbach’s alpha. We assessed convergent validity by examining Pearson correlations between PROMIS measures and existing measures of similar domains and known groups validity by comparing scores across disease activity levels using ANOVA.

Results

Participants were mostly female (82%) and white (83%) with mean (SD) age of 56 (13) years; 24% had ≤ high school, 29% had RA ≤ 5 years with 13% ≤ 2 years, and 22% were disabled. PROMIS Physical Function, Pain Interference and Fatigue instruments correlated moderately to strongly (rho’s ≥ 0.68) with corresponding PROs. Test-retest reliability ranged from .725–.883, and Cronbach’s alpha from .906–.991. A dose-response relationship with disease activity was evident in Physical Function with similar trends in other scales except Anger.

Conclusions

These data provide preliminary evidence of reliability and construct validity of PROMIS CATs to assess RA symptoms and impacts, and feasibility of use in clinical care. PROMIS instruments captured the experiences of RA patients across the broad continuum of RA symptoms and function, especially at low disease activity levels. Future research is needed to evaluate performance in relevant subgroups, assess responsiveness and identify clinically meaningful changes.     

Development and assessment of floor and ceiling items for the PROMIS physical function item bank

Introduction

Disability and Physical Function (PF) outcome assessment has had limited ability to measure functional status at the floor (very poor functional abilities) or the ceiling (very high functional abilities). We sought to identify, develop and evaluate new floor and ceiling items to enable broader and more precise assessment of PF outcomes for the NIH Patient-Reported-Outcomes Measurement Information System (PROMIS).

Methods

We conducted two cross-sectional studies using NIH PROMIS item improvement protocols with expert review, participant survey and focus group methods. In Study 1, respondents with low PF abilities evaluated new floor items, and those with high PF abilities evaluated new ceiling items for clarity, importance and relevance. In Study 2, we compared difficulty ratings of new floor items by low functioning respondents and ceiling items by high functioning respondents to reference PROMIS PF-10 items. We used frequencies, percentages, means and standard deviations to analyze the data.

Results

In Study 1, low (n = 84) and high (n = 90) functioning respondents were mostly White, women, 70 years old, with some college, and disability scores of 0.62 and 0.30. More than 90% of the 31 new floor and 31 new ceiling items were rated as clear, important and relevant, leaving 26 ceiling and 30 floor items for Study 2. Low (n = 246) and high (n = 637) functioning Study 2 respondents were mostly White, women, 70 years old, with some college, and Health Assessment Questionnaire (HAQ) scores of 1.62 and 0.003. Compared to difficulty ratings of reference items, ceiling items were rated to be 10% more to greater than 40% more difficult to do, and floor items were rated to be about 12% to nearly 90% less difficult to do.

Conclusions

These new floor and ceiling items considerably extend the measurable range of physical function at either extreme. They will help improve instrument performance in populations with broad functional ranges and those concentrated at one or the other extreme ends of functioning. Optimal use of these new items will be assisted by computerized adaptive testing (CAT), reducing questionnaire burden and insuring item administration to appropriate individuals.     

Better assessment of physical function: item improvement is neglected but essential

Introduction  

Physical function is a key component of patient-reported outcome (PRO) assessment in rheumatology. Modern psychometric methods, such as Item Response Theory (IRT) and Computerized Adaptive Testing, can materially improve measurement precision at the item level. We present the qualitative and quantitative item-evaluation process for developing the Patient Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank.     

Establishing the Thematic Framework for a Diabetes-Specific Health-Related Quality of Life Item Bank for Use in an English-Speaking Asian Population

Aims

To establish a thematic framework for a Diabetes Mellitus (DM)-specific health-related quality of life (HRQoL) item bank by identifying important HRQoL themes and content gaps in existing DM-specific HRQoL measures and determining whether Patient-Reported Outcomes Measurement Information System (PROMIS) item banks are useful as a starting point.

Methodology

English-speaking Type 2 DM patients were recruited from an outpatient specialist clinic in Singapore. Thematic analysis was performed through open coding and axial coding. Items from four existing DM-specific measures and PROMIS Version 1.0 and 2.0 item banks were compared with identified themes and sub-themes.

Results

42 patients participated (25 men and 17 women; 28 Chinese, 4 Malay, 8 Indians, 2 other ethnicities). Median age was 53.70 years (IQR45.82–56.97) and the median disease duration was 11.13 (SD9.77) years. 10 subthemes (neutral emotions, coping emotions, empowered to help others, support from family, spend more time with family, relationships, financial burden on family, improved relationship, social support and religion/spirituality) were not covered by existing DM-specific measures. PROMIS covered 5 of 6 themes, 15 of 30 subthemes and 19 of 35 codes identified. Emotional distress (frustration, fear and anxiety) was most frequently mentioned (200 times).

Conclusions

We had developed a thematic framework for assessing DM-specific HRQoL in a multi-ethnic Asian population, identified new items that needed to be written and confirmed that PROMIS was a useful starting point. We hope that better understanding and measurement of HRQoL of Asian DM patients will translate to better quality of care for them.     

Patient-orientated longitudinal study of multiple sclerosis in south west England (The South West Impact of Multiple Sclerosis Project,SWIMS) 1: protocol and baseline characteristics of cohort

Background  

There is a need for greater understanding of the impact of multiple sclerosis (MS) from the perspective of individuals with the condition. The South West Impact of MS Project (SWIMS) has been designed to improve understanding of disease impact using a patient-centred approach. The purpose is to (1) develop improved measurement instruments for clinical trials, (2) evaluate longitudinal performance of a variety of patient-reported outcome measures, (3) develop prognostic predictors for use in individualising drug treatment for patients, particularly early on in the disease course.     

Dutch translation and cross-cultural adaptation of the PROMIS? physical function item bank and cognitive pre-test in Dutch arthritis patients

Introduction

Patient-reported physical function is an established outcome domain in clinical studies in rheumatology. To overcome the limitations of the current generation of questionnaires, the Patient-Reported Outcomes Measurement Information System (PROMIS^®) project in the USA has developed calibrated item banks for measuring several domains of health status in people with a wide range of chronic diseases. The aim of this study was to translate and cross-culturally adapt the PROMIS physical function item bank to the Dutch language and to pretest it in a sample of patients with arthritis.

Methods

The items of the PROMIS physical function item bank were translated using rigorous forward-backward protocols and the translated version was subsequently cognitively pretested in a sample of Dutch patients with rheumatoid arthritis.

Results

Few issues were encountered in the forward-backward translation. Only 5 of the 124 items to be translated had to be rewritten because of culturally inappropriate content. Subsequent pretesting showed that overall, questions of the Dutch version were understood as they were intended, while only one item required rewriting.

Conclusions

Results suggest that the translated version of the PROMIS physical function item bank is semantically and conceptually equivalent to the original. Future work will be directed at creating a Dutch-Flemish final version of the item bank to be used in research with Dutch speaking populations.     

McMaster-Toronto Arthritis Patient Preference Disability Questionnaire sensitivity to change in low back pain: influence of shifts in priorities

Objective

To assess the sensitivity to change of the McMaster Toronto Arthritis Patient Preference Disability Questionnaire (MACTAR) in chronic low back pain (CLBP) and shifts in patients'' priorities of disabling activities over time.

Methods

A prospective longitudinal survey of 100 patients (38 males) with CLBP in a tertiary care teaching hospital. Evaluation at baseline and 6 months by the MACTAR, Quebec Back Pain Disability Questionnaire (QUEBEC), Hospital Anxiety and Depression scale (HAD), Fear-Avoidance Beliefs Questionnaire (FABQ), Coping Strategies Questionnaire (CSQ), and pain and handicap visual analogue scales (VASs). Patients'' perceived improvement or worsening of condition was assessed at 6 months. Effect size (ES) and Standardized response mean (SRM) and effect size (ES) were used to evaluate sensitivity to change of the MACTAR.

Results

The MACTAR SRM and ES values (SRM = 0.25; ES = 0.37) were among the highest for the instruments evaluated. For patients considering their condition as improved, the SRM was 0.66 and the ES 1. The 3 disability domains, classified by the International Classification of Functioning, Disability and Health (ICF), most often cited as priorities at baseline remained the most cited at follow-up: mobility (40.9% of patients); community, social and civic life (22.7%); and domestic life (22.4%). At 6 months, 48 patients shifted their priorities, for a decrease in MACTAR SRM and ES values for patients considering their condition improved and an increase in these values for those considering their condition deteriorated.

Conclusions

Although the MACTAR has similar sensitivity to change as other outcome measures widely used in CLBP, shifts in patient priorities over time are common and influence scores and sensitivity to change.     

A high-throughput <Emphasis Type="Italic">de novo</Emphasis> sequencing approach for shotgun proteomics using high-resolution tandem mass spectrometry

Background  

High-resolution tandem mass spectra can now be readily acquired with hybrid instruments, such as LTQ-Orbitrap and LTQ-FT, in high-throughput shotgun proteomics workflows. The improved spectral quality enables more accurate de novo sequencing for identification of post-translational modifications and amino acid polymorphisms.     

Comprehensibility, reliability, validity, and responsiveness of the Thai version of the Health Assessment Questionnaire in Thai patients with rheumatoid arthritis

Introduction  

The Health Assessment Questionnaire Disability Index (HAQ-DI) is a commonly used instrument to assess functional status of patients with rheumatoid arthritis (RA). Translations and adaptations of the HAQ-DI have been carried out for use with RA patients in several countries. The objective of this study was to evaluate the psychometric properties of the Thai version of the HAQ-DI (Thai HAQ) in Thai patients with RA.     

Assessment of factors influencing morale in the elderly

Background

We examined the relationship between morale measured by the Philadelphia Geriatric Morale Scale (PGC) and disability, social support, religiosity, and personality traits. Instruments predicting morale were then tested against PGC domains.

Methods

The study utilized a cross-sectional survey with a multistage cluster sampling design. Instruments used were disability (disease burden; WHO Disability Score-II, WHODAS-II), social support (Duke Social Support Scale, DUSOCS; Lubben Social Network Scale, LSNS-6; Medical Outcomes Study Social Support Survey, MOS-SSS), religiosity (Revised Intrinsic-Extrinsic Religious Orientation Scale, I/E-R), and personality (Ten-Item Personality Inventory, TIPI). These were plotted as bar charts against PGC, resolved with one-way ANOVA and Kruskal-Wallis tests, then corrected for multiple comparisons. This process was repeated with PGC domains. Contribution of factors was modeled using population attributable risk (PAR) and odds ratios. Effect of confounders such as gender, age, and ethnicity were checked using binary logistic regression.

Results

All instruments showed clear relationships with PGC, with WHODAS-II and DUSOCS performing well (ANOVA p<0.001). For PGC domains, attitude toward aging and lonely dissatisfaction trended together, while agitation did not. PAR, odds ratios, and Exp(β) were disability (WHODAS-II: 28.5%, 3.8, 2.8), social support (DUSOCS: 28.0%, 3.4, 2.2), religiosity (I/E-R: 21.6%, 3.2, 2.1), and personality (TIPI: 27.9%, 3.6, 2.4). Combined PAR was 70.9%.

Conclusions

Disability, social support, religiosity, and personality strongly influence morale in the elderly. WHODAS-II and DUSOCS perform best in measuring disability and social support respectively.     

Health outcome measures in atopic dermatitis: a systematic review of trends in disease severity and quality-of-life instruments 1985-2010

Background

A number of disease-severity and quality-of-life (QoL) instruments have emerged in atopic dermatitis (AD) in the last decade.

Objectives

To identify trends in outcomes instruments used in AD clinical trials and to provide a useful summary of the dimensions and validation studies for the most commonly used measures.

Method

All randomized control trials (RCTs) from 1985 to 2010 in the treatment of AD were examined.

Results

Among the 791 RCTs reviewed, we identified 20 disease-severity and 14 QoL instruments. Of these outcomes instruments, few have been validated. SCORAD, EASI, IGA and SASSAD were the most commonly used disease-severity instruments and CDLQI, DFI, DLQI and IDQOL were the most frequently used QoL measures.

Limitations

The small number of RCTs using QoL scales makes identifying trends for QoL instruments difficult.

Conclusion

Overall, there is an increase in the use of disease-severity and QoL instruments in AD clinical trials.     

PROMIS Versus Legacy Patient-Reported Outcome Measures for Sports Medicine Patients Undergoing Arthroscopic Knee,Shoulder, and Hip Interventions: A Systematic Review

BackgroundThe Patient-Reported Outcomes Measurement Information System (PROMIS®)^ǂ was designed to monitor the global wellbeing of patients, with the Physical Function Computer-Adaptive Test (PF-CAT) component focused specifically on functional outcome. PROMIS aims for increased item-bank accuracy, lower administrative burden, and decreased floor and ceiling effects compared to legacy patient-reported outcome measures (PROMs). Our primary research outcomes focused on sports medicine surgical populations, which may skew younger or have wide-ranging functional statuses. Specifically, for this population, we questioned if PROMIS PF-CAT was equal to legacy PROMs in (1) construct validity and (2) convergent/divergent validities; and superior to legacy PROMs with respect to (3) survey burden and (4) floor and ceiling effects.MethodsSearches were performed in April 2019 in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, utilizing PubMed, Cochrane Central, and Embase databases for Level I-III evidence. This resulted in 541 records, yielding 12 studies for inclusion. PROM data was available for patients undergoing arthroscopic orthopaedic procedures of the knee, shoulder, and hip. Measures of construct validity, convergent/divergent validity, survey burden, and floor/ceiling effects were evaluated for PROMIS PF-CAT versus legacy PROMs.ResultsPROMIS PF-CAT demonstrated excellent or excellent-good correlation with legacy PROMS for physical function and quality of life for patients undergoing arthroscopic interventions of the knee, shoulder, and hip. Compared to legacy PROM instruments, PROMIS PF-CAT demonstrated the lowest overall survey burden and had the lowest overall number of floor or ceiling effects across participants.ConclusionPROMIS PF-CAT is an accurate, efficient evaluation tool for sports medicine surgical patients. PROMIS PF-CAT strongly correlates with legacy physical function PROMs while having a lower test burden and less incidence of floor and ceiling effects. PROMIS PF-CAT may be an optimal alternative for traditional physical function PROMs in sports medicine patients undergoing arthroscopic procedures. Further studies are required to extend the generalizability of these findings to patients during postoperative timepoints after shoulder and hip interventionsLevel of Evidence: III     

Modified constraint-induced movement therapy or bimanual occupational therapy following injection of Botulinum toxin-A to improve bimanual performance in young children with hemiplegic cerebral palsy: a randomised controlled trial methods paper

Background  

Use of Botulinum toxin-A (BoNT-A) for treatment of upper limb spasticity in children with cerebral palsy has become routine clinical practice in many paediatric treatment centres worldwide. There is now high-level evidence that upper limb BoNT-A injection, in combination with occupational therapy, improves outcomes in children with cerebral palsy at both the body function/structure and activity level domains of the International Classification of Functioning, Disability and Health. Investigation is now required to establish what amount and specific type of occupational therapy will further enhance functional outcomes and prolong the beneficial effects of BoNT-A.     

The Thai version of the PSS-10: An Investigation of its psychometric properties

Background  

Among the stress instruments that measure the degree to which life events are perceived as stressful, the Perceived Stress Scale (PSS) is widely used. The goal of this study was to examine the psychometric properties of a Thai version of the PSS-10 (T-PSS-10) with a clinical and non-clinical sample. Internal consistency, test-retest reliability, concurrent validity, and the factorial structure of the scale were tested.     

Validation of the International Classification of Functioning, Disability and Health Core Set for chronic widespread pain from the perspective of fibromyalgia patients

Introduction  

Functioning is recognized as an important study outcome in chronic widespread pain (CWP). The Comprehensive ICF Core Set for CWP is an application of the International Classification of Functioning, Disability and Health (ICF) with the purpose of representing the typical spectrum of functioning of patients with CWP. The objective of the study was to add evidence to the validation of the Comprehensive ICF Core Set for CWP from the patient perspective. The specific aims were to explore the aspects of functioning and health important to patients with fibromyalgia, and to examine to what extent these aspects are represented by the current version of the Comprehensive ICF Core Set for CWP.     

Evaluation of genomic high-throughput sequencing data generated on Illumina HiSeq and Genome Analyzer systems

Background  

The generation and analysis of high-throughput sequencing data are becoming a major component of many studies in molecular biology and medical research. Illumina's Genome Analyzer (GA) and HiSeq instruments are currently the most widely used sequencing devices. Here, we comprehensively evaluate properties of genomic HiSeq and GAIIx data derived from two plant genomes and one virus, with read lengths of 95 to 150 bases.     

Magnetic resonance spectroscopy of normal appearing white matter in early relapsing-remitting multiple sclerosis: correlations between disability and spectroscopy

Background  

What currently appears to be irreversible axonal loss in normal appearing white matter, measured by proton magnetic resonance spectroscopy is of great interest in the study of Multiple Sclerosis. Our aim is to determine the axonal damage in normal appearing white matter measured by magnetic resonance spectroscopy and to correlate this with the functional disability measured by Multiple Sclerosis Functional Composite scale, Neurological Rating Scale, Ambulation Index scale, and Expanded Disability Scale Score.     

Bilateral C1–C2 Transarticular Screw and C1 Laminar Hook Fixation and Bone Graft Fusion for Reducible Atlantoaxial Dislocation: A Seven-Year Analysis of Outcome

Background

Bilateral C1-2 transarticular screw and C1 laminar hook fixation was developed on the basis of transarticular screws fixation. The modified technique has showed a better biomechanical stability than established techniques in previous study. However, long-term (minimum follow-up 7 years) outcomes of patients with reducible atlantoaxial dislocation who underwent this modified fixation technique have not still been reported.

Methods

A retrospective study was conducted to evaluate the outcome of 36 patients who underwent this modified technique. Myelopathy was assessed using the Ranawat myelopathy score and Myelopathy Disability Index. Pain scores were assessed using Visual Analogue Scale. Radiological imaging was assessed and the following data were extracted: the atlantodental intervals, the space available for cord, presence of spinal cord signal change on T2 weighted image, C1–C2 angle, C2–C7 angle and fusion rates.

Findings

All patients achieved a minimum seven-year follow up. 95% patients with neck and suboccipital pain improved after surgery; in their Visual Analogue pain scores, there was a greater than 50% improvement in their VAS scores with a drop of 5 points on the VAS (P<0.05). 92% of patients improved in the Ranawat myelopathy grade; the Myelopathy Disability Index assessment showed a preoperative mean score of 35.62 with postoperative mean 12.75(P<0.05). There was not any significant atlantoaxial instability at each follow-up time. The space available for cord increased in all patients. Postoperative sagittal kyphosis of the subaxial spine was not observed. After six months after surgery, bone grafts of all patients were fused. No complications related to surgery were found in the period of follow-up.

Conclusions

The long-term outcomes of this case series demonstrate that under the condition of thorough preoperative preparations, bilateral C1–C2 transarticular screw and C1 laminar hook fixation and bone graft fusion is a reliable posterior atlantoaxial fusion technique for reducible atlantoaxial dislocation.     

Why do we treat adolescent idiopathic scoliosis? What we want to obtain and to avoid for our patients. SOSORT 2005 Consensus paper

Background

Medicine is a scientific art: once science is not clear, choices are made according to individual and collective beliefs that should be better understood. This is particularly true in a field like adolescent idiopathic scoliosis, where currently does not exist definitive scientific evidence on the efficacy either of conservative or of surgical treatments.

Aim of the study

To verify the philosophical choices on the final outcome of a group of people believing and engaged in a conservative treatment of idiopathic scoliosis.

Methods

We performed a multifaceted study that included a bibliometric analysis, a questionnaire, and a careful Consensus reaching procedure between experts in the conservative treatment of scoliosis (SOSORT members).

Results

The Consensus reaching procedure has shown to be useful: answers changed in a statistically significant way, and 9 new outcome criteria were included. The most important final outcomes were considered Aesthetics (100%), Quality of life and Disability (more than 90%), while more than 80% of preferences went to Back Pain, Psychological well-being, Progression in adulthood, Breathing function, Scoliosis Cobb degrees (radiographic lateral flexion), Needs of further treatments in adulthood.

Discussion

In the literature prevail outcome criteria driven by the contingent treatment needs or the possibility to have measurement systems (even if it seems that usual clinical and radiographic methods are given much more importance than more complex Disability or Quality of Life instruments). SOSORT members give importance to a wide range of outcome criteria, in which clinical and radiographic issues have the lowest importance.

Conclusion

We treat our patients for what they need for their future (Breathing function, Needs of further treatments in adulthood, Progression in adulthood), and their present too (Aesthetics, Disability, Quality of life). Technical matters, such as rib hump or radiographic lateral alignment and rotation, but not lateral flexion, are secondary outcomes and only instrumental to previously reported primary outcomes. We advocate a multidimensional, comprehensive evaluation of scoliosis patients, to gather all necessary data for a complete therapeutic approach, that goes beyond x-rays to reach the person and the family.     

Estimates of probable dementia prevalence from population-based surveys compared with dementia prevalence estimates based on meta-analyses

Background  

National data on dementia prevalence are not always available, yet it may be possible to obtain estimates from large surveys that include dementia screening instruments. In Australia, many of the dementia prevalence estimates are based on European data collected between 15 and 50 years ago. We derived population-based estimates of probable dementia and possible cognitive impairment in Australian studies using the Mini-Mental State Examination (MMSE), and compared these to estimates of dementia prevalence from meta-analyses of European studies.