Cognitive behavioural therapy versus supportive therapy for persistent positive symptoms in psychotic disorders: The POSITIVE Study, a multicenter, prospective, single-blind, randomised controlled clinical trial

Background

It has been demonstrated that cognitive behavioural therapy (CBT) has a moderate effect on symptom reduction and on general well being of patients suffering from psychosis. However, questions regarding the specific efficacy of CBT, the treatment safety, the cost-effectiveness, and the moderators and mediators of treatment effects are still a major issue. The major objective of this trial is to investigate whether CBT is specifically efficacious in reducing positive symptoms when compared with non-specific supportive therapy (ST) which does not implement CBT-techniques but provides comparable therapeutic attention.

Methods/Design

The POSITIVE study is a multicenter, prospective, single-blind, parallel group, randomised clinical trial, comparing CBT and ST with respect to the efficacy in reducing positive symptoms in psychotic disorders. CBT as well as ST consist of 20 sessions altogether, 165 participants receiving CBT and 165 participants receiving ST. Major methodological aspects of the study are systematic recruitment, explicit inclusion criteria, reliability checks of assessments with control for rater shift, analysis by intention to treat, data management using remote data entry, measures of quality assurance (e.g. on-site monitoring with source data verification, regular query process), advanced statistical analysis, manualized treatment, checks of adherence and competence of therapists. Research relating the psychotherapy process with outcome, neurobiological research addressing basic questions of delusion formation using fMRI and neuropsychological assessment and treatment research investigating adaptations of CBT for adolescents is combined in this network. Problems of transfer into routine clinical care will be identified and addressed by a project focusing on cost efficiency.

Discussion

This clinical trial is part of efforts to intensify psychotherapy research in the field of psychosis in Germany, to contribute to the international discussion on psychotherapy in psychotic disorders, and to help implement psychotherapy in routine care. Furthermore, the study will allow drawing conclusions about the mediators of treatment effects of CBT of psychotic disorders.

Trial Registration

Current Controlled Trials ISRCTN29242879     

Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes

Background

Health care organizations exert significant influence on the manner in which clinicians practice and the processes and outcomes of care that patients experience. A greater understanding of the organizational milieu into which innovations will be introduced, as well as the organizational factors that are likely to foster or hinder the adoption and use of new technologies, care arrangements and quality improvement (QI) strategies are central to the effective implementation of research into practice. Unfortunately, much implementation research seems to not recognize or adequately address the influence and importance of organizations. Using examples from the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI), we describe the role of organizational research in advancing the implementation of evidence-based practice into routine care settings.

Methods

Using the six-step QUERI process as a foundation, we present an organizational research framework designed to improve and accelerate the implementation of evidence-based practice into routine care. Specific QUERI-related organizational research applications are reviewed, with discussion of the measures and methods used to apply them. We describe these applications in the context of a continuum of organizational research activities to be conducted before, during and after implementation.

Results

Since QUERI's inception, various approaches to organizational research have been employed to foster progress through QUERI's six-step process. We report on how explicit integration of the evaluation of organizational factors into QUERI planning has informed the design of more effective care delivery system interventions and enabled their improved "fit" to individual VA facilities or practices. We examine the value and challenges in conducting organizational research, and briefly describe the contributions of organizational theory and environmental context to the research framework.

Conclusion

Understanding the organizational context of delivering evidence-based practice is a critical adjunct to efforts to systematically improve quality. Given the size and diversity of VA practices, coupled with unique organizational data sources, QUERI is well-positioned to make valuable contributions to the field of implementation science. More explicit accommodation of organizational inquiry into implementation research agendas has helped QUERI researchers to better frame and extend their work as they move toward regional and national spread activities.     

Implementing an innovative consent form: the PREDICT experience

Background

This article describes the process used by the authors in developing an implementation intervention to assist VA substance use disorder clinics in adopting guideline-based practices for treating depression. This article is one in a Series of articles documenting implementation science frameworks and tools developed by the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI).

Methods

The process involves two steps: 1) diagnosis of site-specific implementation needs, barriers, and facilitators (i.e., formative evaluation); and 2) the use of multi-disciplinary teams of local staff, implementation experts, and clinical experts to interpret diagnostic data and develop site-specific interventions. In the current project, data were collected via observations of program activities and key informant interviews with clinic staff and patients. The assessment investigated a wide range of macro- and micro-level determinants of organizational and provider behavior.

Conclusion

The implementation development process described here is presented as an optional method (or series of steps) to consider when designing a small scale, multi-site implementation study. The process grew from an evidence-based quality improvement strategy developed for – and proven efficacious in – primary care settings. The authors are currently studying the efficacy of the process across a spectrum of specialty care treatment settings.     

Ethical issues in implementation research: a discussion of the problems in achieving informed consent

Background

Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project.

Methods

This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers.

Results

Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers.

Conclusion

Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions.     

Audit and feedback and clinical practice guideline adherence: Making feedback actionable

Background

Effective interventions prepare patients for making values-sensitive health decisions by helping them become informed and clarifying their values for each of the options. However, patient decision support interventions have not been widely implemented and little is known about effective models for delivering them to patients. The purpose of this study was to describe call centre nurses' adoption of a decision support protocol into practice following exposure to an implementation intervention and to identify factors influencing sustainable nursing practice changes.

Methods

Exploratory case study at a Canadian province-wide call centre guided by the Ottawa Model of Research Use. Data sources included a survey of nurses who participated in an implementation intervention (n = 31), 2 focus groups with nurses, interviews with 4 administrators, and a document review.

Results

Twenty-five of 31 nurses responded to the survey measuring adoption of decision support in practice. Of the 25 nurses, 11 had used the decision support protocol in their practice within one month of the intervention. Twenty-two of the 25 intended to use it within the next three months. Although some nurses found it challenging to begin using the protocol, most nurses reported that it: a) helped them recognize callers needing decision support; b) changed their approach to handling these calls; and c) was a positive enhancement to their practice. Strategies identified to promote sustainability of practice changes included integration of the decision support protocol in the call centre database, streamlining the patient decision aids for easier use via telephone, clarifying the administrative direction for the call centre's program, creating a call length guideline specific for these calls, incorporating decision support training in the staff development plan, and informing the public of this enhanced service.

Conclusion

Although most nurses adopted the decision support protocol for coaching callers facing values-sensitive decisions, to sustain practice changes, interventions are required to manage barriers in the practice environment and integrate decision support into the organization's policies, resources, and routine activities.     

Enablers and barriers to implementing collaborative care for anxiety and depression: a systematic qualitative review

Background

Collaborative care is an increasingly popular approach for improving quality of care for people with mental health problems through an intensified and structured collaboration between primary care providers and health professionals with specialized psychiatric expertise. Trials have shown significant positive effects for patients suffering from depression, but since collaborative care is a complex intervention, it is important to understand the factors which affect its implementation. We present a qualitative systematic review of the enablers and barriers to implementing collaborative care for patients with anxiety and depression.

Methods

We developed a comprehensive search strategy in cooperation with a research librarian and performed a search in five databases (EMBASE, PubMed, PsycINFO, ProQuest, and CINAHL). All authors independently screened titles and abstracts and reviewed full-text articles. Studies were included if they were published in English and based on the original qualitative data on the implementation of a collaborative care intervention targeted at depression or anxiety in an adult patient population in a high-income country. Our subsequent analysis employed the normalization process theory (NPT).

Results

We included 17 studies in our review of which 11 were conducted in the USA, five in the UK, and one in Canada. We identified several barriers and enablers within the four major analytical dimensions of NPT. Securing buy-in among primary care providers was found to be critical but sometimes difficult. Enablers included physician champions, reimbursement for extra work, and feedback on the effectiveness of collaborative care. The social and professional skills of the care managers seemed critical for integrating collaborative care in the primary health care clinic. Day-to-day implementation was also found to be facilitated by the care managers being located in the clinic since this supports regular face-to-face interactions between physicians and care managers.

Conclusions

The following areas require special attention when planning collaborative care interventions: effective educational programs, especially for care managers; issues of reimbursement in relation to primary care providers; good systems for communication and monitoring; and promoting face-to-face interaction between care managers and physicians, preferably through co-location. There is a need for well-sampled, in-depth qualitative studies on the implementation of collaborative care in settings outside the USA and the UK.

     

Effective continuing professional development for translating shared decision making in primary care: A study protocol

Background

There is growing interest in the use of cognitive, behavioural, and organisational theories in implementation research. However, the extent of use of theory in implementation research is uncertain.

Methods

We conducted a systematic review of use of theory in 235 rigorous evaluations of guideline dissemination and implementation studies published between 1966 and 1998. Use of theory was classified according to type of use (explicitly theory based, some conceptual basis, and theoretical construct used) and stage of use (choice/design of intervention, process/mediators/moderators, and post hoc/explanation).

Results

Fifty-three of 235 studies (22.5%) were judged to have employed theories, including 14 studies that explicitly used theory. The majority of studies (n = 42) used only one theory; the maximum number of theories employed by any study was three. Twenty-five different theories were used. A small number of theories accounted for the majority of theory use including PRECEDE (Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation), diffusion of innovations, information overload and social marketing (academic detailing).

Conclusions

There was poor justification of choice of intervention and use of theory in implementation research in the identified studies until at least 1998. Future research should explicitly identify the justification for the interventions. Greater use of explicit theory to understand barriers, design interventions, and explore mediating pathways and moderators is needed to advance the science of implementation research.     

Organizational factors and depression management in community-based primary care settings

Background

Evidence-based quality improvement models for depression have not been fully implemented in routine primary care settings. To date, few studies have examined the organizational factors associated with depression management in real-world primary care practice. To successfully implement quality improvement models for depression, there must be a better understanding of the relevant organizational structure and processes of the primary care setting. The objective of this study is to describe these organizational features of routine primary care practice, and the organization of depression care, using survey questions derived from an evidence-based framework.

Methods

We used this framework to implement a survey of 27 practices comprised of 49 unique offices within a large primary care practice network in western Pennsylvania. Survey questions addressed practice structure (e.g., human resources, leadership, information technology (IT) infrastructure, and external incentives) and process features (e.g., staff performance, degree of integrated depression care, and IT performance).

Results

The results of our survey demonstrated substantial variation across the practice network of organizational factors pertinent to implementation of evidence-based depression management. Notably, quality improvement capability and IT infrastructure were widespread, but specific application to depression care differed between practices, as did coordination and communication tasks surrounding depression treatment.

Conclusions

The primary care practices in the network that we surveyed are at differing stages in their organization and implementation of evidence-based depression management. Practical surveys such as this may serve to better direct implementation of these quality improvement strategies for depression by improving understanding of the organizational barriers and facilitators that exist within both practices and practice networks. In addition, survey information can inform efforts of individual primary care practices in customizing intervention strategies to improve depression management.

     

Difficulties implementing a mental health guideline: an exploratory investigation using psychological theory

Background

Monitoring and Messaging Devices (MMDs) are telehealth systems used by patients in their homes, and are designed to promote patient self-management, patient education, and clinical monitoring and follow-up activities. Although these systems have been widely promoted by health care systems, including the Veterans Health Administration, very little information is available on factors that facilitate use of the MMD system, or on barriers to use.

Methods

We conducted in-depth qualitative interviews with clinicians using MMD-based telehealth programs at two Veterans Affairs Medical Centers in the Midwestern United States.

Results

Findings suggest that MMD program enrollment is limited by both clinical and non-clinical factors, and that patients have varying levels of program participation and system use. Telehealth providers see MMDs as a useful tool for monitoring patients who are interested in working on management of their disease, but are concerned with technical challenges and the time commitment required to use MMDs.

Conclusion

Telehealth includes a rapidly evolving and potentially promising range of technologies for meeting the growing number of patients and clinicians who face the challenges of diabetes care, and future research should explore the most effective means of ensuring successful program implementation.     

Trends in publications regarding evidence-practice gaps: A literature review

Background

Well-designed trials of strategies to improve adherence to clinical practice guidelines are needed to close persistent evidence-practice gaps. We studied how the number of these trials is changing with time, and to what extent physicians are participating in such trials.

Methods

This is a literature-based study of trends in evidence-practice gap publications over 10 years and participation of clinicians in intervention trials to narrow evidence-practice gaps. We chose nine evidence-based guidelines and identified relevant publications in the PubMed database from January 1998 to December 2007. We coded these publications by study type (intervention versus non-intervention studies). We further subdivided intervention studies into those for clinicians and those for patients. Data were analyzed to determine if observed trends were statistically significant.

Results

We identified 1,151 publications that discussed evidence-practice gaps in nine topic areas. There were 169 intervention studies that were designed to improve adherence to well-established clinical guidelines, averaging 1.9 studies per year per topic area. Twenty-eight publications (34%; 95% CI: 24% - 45%) reported interventions intended for clinicians or health systems that met Effective Practice and Organization of Care (EPOC) criteria for adequate design. The median consent rate of physicians asked to participate in these well-designed studies was 60% (95% CI, 25% to 69%).

Conclusions

We evaluated research publications for nine evidence-practice gaps, and identified small numbers of well-designed intervention trials and low rates of physician participation in these trials.     

Occupational challenges of young adult patients with congenital heart disease

Background

Despite improved survival of adults with congenital heart disease (CHD), higher rates of unemployment and work-related problems are seen, especially among younger adults. This study was performed to gain insight into current barriers and facilitating experiences at work among young adult patients with CHD.

Methods

This qualitative study consisted of semi-structured face-to-face interviews, based on a self-constructed model from several existing models, which were held among outpatients with CHD from a large tertiary referral centre. Verbatim transcribed audio-taped data were analysed using a directed model-based content analysis approach.

Results

Fifteen patients had been interviewed when data saturation was reached. Work was important for all participants. Several barriers and facilitating factors were identified. Barriers were mostly on physical aspects and lack of opportunities for recovery. Important facilitating factors were good relationships with colleagues and employer and having sufficient opportunities for recovery. Most of these factors are also seen among patients with other chronic diseases, but with a different priority.

Conclusion

This is the first study that has identified qualitative factors at work of young adult CHD patients. Work is important to them. Challenges are dealing with the physical barriers and getting enough support from colleagues. Specific coaching or a tailored group intervention could thereby be helpful. Future research should aim at the aetiology of problems and identifying patients who would benefit most from specific coaching.     

Multifactorial day hospital intervention to reduce falls in high risk older people in primary care: a multi-centre randomised controlled trial [ISRCTN46584556]

Background

There are many barriers to patient participation in randomised controlled trials of cancer treatments. To increase participation in trials, strategies need to be identified to overcome these barriers. Our aim was to assess the effectiveness of interventions to overcome barriers to patient participation in randomised controlled trials (RCTs) of cancer treatments.

Methods

A systematic review was conducted. Published and unpublished studies in any language were searched for in fifteen electronic databases, including MEDLINE, EMBASE, CINAHL and PsycINFO, from inception to the end of 2004. Studies of any interventions to improve cancer patient participation in RCTs, which reported the change in recruitment rates, were eligible for inclusion. RCTs and non-randomised controlled trials as well as before and after studies reporting baseline rates specific to the population being investigated were included. Data were extracted by one reviewer into structured summary tables and checked for accuracy by a second reviewer. Each included study was assessed against a checklist for methodological quality by one reviewer and checked by a second reviewer. A narrative synthesis was conducted.

Results

Eight studies were identified that met the inclusion criteria: three RCTs, two non-randomised controlled trials and three observational studies. Six of the studies had an intervention that had some relevance to the UK. There was no robust evidence that any of the interventions investigated led to an increase in cancer patient participation in RCTs, though one good quality RCT found that urologists and nurses were equally effective at recruiting participants to a treatment trial for prostate cancer. Although there was no evidence of an effect in any of the studies, the evidence was not of sufficient quality to be able to conclude that these interventions therefore do not work.

Conclusion

There is not a strong evidence-base for interventions that increase cancer patient participation in randomised trials. Further research is required to evaluate the effectiveness of strategies to increase participation in cancer treatment trials.     

From recommendation to action: psychosocial factors influencing physician intention to use Health Technology Assessment (HTA) recommendations

Background

The Evidence-Based Practice (EBP) Project has been investigating the implementation of evidence-based mental health practices (Assertive Community Treatment, Family Psychoeducation, Integrated Dual Diagnosis Treatment, Illness Management and Recovery, and Supported Employment) in state public mental health systems in the United States since 2001. To date, Project findings have yielded valuable insights into implementation strategy characteristics and effectiveness. This paper reports results of an effort to identify and classify state-level implementation activities and strategies employed across the eight states participating in the Project.

Methods

Content analysis and Greenhalgh et al's (2004) definition of innovation were used to identify and classify state-level activities employed during three phases of EBP implementation: Pre-Implementation, Initial Implementation and Sustainability Planning. Activities were coded from site visit reports created from documents and notes from key informant interviews conducted during two periods, Fall 2002 – Spring 2003, and Spring 2004. Frequency counts and rank-order analyses were used to examine patterns of implementation activities and strategies employed across the three phases of implementation.

Results

One hundred and six discreet implementation activities and strategies were identified as innovative and were classified into five categories: 1) state infrastructure building and commitment, 2) stakeholder relationship building and communications, 3) financing, 4) continuous quality management, and 5) service delivery practices and training. Implementation activities from different categories were employed at different phases of implementation.

Conclusion

Insights into effective strategies for implementing EBPs in mental health and other health sectors require qualitative and quantitative research that seeks to: a) empirically test the effects of tools and methods used to implement EBPs, and b) establish a stronger evidence-base from which to plan, implement and sustain such efforts. This paper offers a classification scheme and list of innovative implementation activities and strategies. The classification scheme offers potential value for future studies that seek to assess the effects of various implementation processes, and helps establish widely accepted standards and criteria that can be used to assess the value of innovative activities and strategies.     

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review

Background

The potential barriers and facilitators to change should guide the choice of implementation strategy. Implementation researchers believe that existing methods for the evaluation of potential barriers and facilitators are not satisfactory. Discrete choice experiments (DCE) are relatively new in the health care sector to investigate preferences, and may be of value in the field of implementation research. The objective of our study was to investigate the complementary value of DCE for the evaluation of barriers and facilitators in implementation research.

Methods

Clinical subject was the implementation of the guideline for breast cancer surgery in day care. We identified 17 potential barriers and facilitators to the implementation of this guideline. We used a traditional questionnaire that was made up of statements about the potential barriers and facilitators. Respondents answered 17 statements on a five-point scale ranging from one (fully disagree) to five (fully agree). The potential barriers and facilitators were included in the DCE as decision attributes. Data were gathered among anaesthesiologists, surgical oncologists, and breast care nurses by means of a paper-and-pencil questionnaire.

Results

The overall response was 10%. The most striking finding was that the responses to the traditional questionnaire hardly differentiated between barriers. Forty-seven percent of the respondents thought that DCE is an inappropriate method. These respondents considered DCE too difficult and too time-consuming. Unlike the traditional questionnaire, the results of a DCE provide implementation researchers and clinicians with a relative attribute importance ranking that can be used to prioritize potential barriers and facilitators to change, and hence to better fine-tune the implementation strategies to the specific problems and challenges of a particular implementation process.

Conclusion

The results of our DCE and traditional questionnaire would probably lead to different implementation strategies. Although there is no 'gold standard' for prioritising potential barriers and facilitators to the implementation of change, theoretically, DCE would be the method of choice. However, the feasibility of using DCE was less favourable. Further empirical applications should investigate whether DCE can really make a valuable contribution to the implementation science.     

Implementation science in resource-poor countries and communities

Background

Implementation science in resource-poor countries and communities is arguably more important than implementation science in resource-rich settings, because resource poverty requires novel solutions to ensure that research results are translated into routine practice and benefit the largest possible number of people.

Methods

We reviewed the role of resources in the extant implementation science frameworks and literature. We analyzed opportunities for implementation science in resource-poor countries and communities, as well as threats to the realization of these opportunities.

Results

Many of the frameworks that provide theoretical guidance for implementation science view resources as contextual factors that are important to (i) predict the feasibility of implementation of research results in routine practice, (ii) explain implementation success and failure, (iii) adapt novel evidence-based practices to local constraints, and (iv) design the implementation process to account for local constraints. Implementation science for resource-poor settings shifts this view from “resources as context” to “resources as primary research object.” We find a growing body of implementation research aiming to discover and test novel approaches to generate resources for the delivery of evidence-based practice in routine care, including approaches to create higher-skilled health workers—through tele-education and telemedicine, freeing up higher-skilled health workers—through task-shifting and new technologies and models of care, and increasing laboratory capacity through new technologies and the availability of medicines through supply chain innovations. In contrast, only few studies have investigated approaches to change the behavior and utilization of healthcare resources in resource-poor settings. We identify three specific opportunities for implementation science in resource-poor settings. First, intervention and methods innovations thrive under constraints. Second, reverse innovation transferring novel approaches from resource-poor to research-rich settings will gain in importance. Third, policy makers in resource-poor countries tend to be open for close collaboration with scientists in implementation research projects aimed at informing national and local policy.

Conclusions

Implementation science in resource-poor countries and communities offers important opportunities for future discoveries and reverse innovation. To harness this potential, funders need to strongly support research projects in resource-poor settings, as well as the training of the next generation of implementation scientists working on new ways to create healthcare resources where they lack most and to ensure that those resources are utilized to deliver care that is based on the latest research results.

     

Utilization of the Behavior Change Wheel framework to develop a model to improve cardiometabolic screening for people with severe mental illness

Background

Individuals with severe mental illness (e.g., schizophrenia, bipolar disorder) die 10–25 years earlier than the general population, primarily from premature cardiovascular disease (CVD). Contributing factors are complex, but include systemic-related factors of poorly integrated primary care and mental health services. Although evidence-based models exist for integrating mental health care into primary care settings, the evidence base for integrating medical care into specialty mental health settings is limited. Such models are referred to as “reverse” integration. In this paper, we describe the application of an implementation science framework in designing a model to improve CVD outcomes for individuals with severe mental illness (SMI) who receive services in a community mental health setting.

Methods

Using principles from the theory of planned behavior, focus groups were conducted to understand stakeholder perspectives of barriers to CVD risk factor screening and treatment identify potential target behaviors. We then applied results to the overarching Behavior Change Wheel framework, a systematic and theory-driven approach that incorporates the COM-B model (capability, opportunity, motivation, and behavior), to build an intervention to improve CVD risk factor screening and treatment for people with SMI.

Results

Following a stepped approach from the Behavior Change Wheel framework, a model to deliver primary preventive care for people that use community mental health settings as their de facto health home was developed. The CRANIUM (cardiometabolic risk assessment and treatment through a novel integration model for underserved populations with mental illness) model focuses on engaging community psychiatrists to expand their scope of practice to become responsible for CVD risk, with significant clinical decision support.

Conclusion

The CRANIUM model was designed by integrating behavioral change theory and implementation theory. CRANIUM is feasible to implement, is highly acceptable to, and targets provider behavior change, and is replicable and efficient for helping to integrate primary preventive care services in community mental health settings. CRANIUM can be scaled up to increase CVD preventive care delivery and ultimately improve health outcomes among people with SMI served within a public mental health care system.