Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support,provider attitudes,and adoption of evidence-based practice

Background

The goal of this study is to extend research on evidence-based practice (EBP) implementation by examining the impact of organizational type (public versus private) and organizational support for EBP on provider attitudes toward EBP and EBP use. Both organization theory and theory of innovation uptake and individual adoption of EBP guide the approach and analyses in this study. We anticipated that private sector organizations would provide greater levels of organizational support for EBPs leading to more positive provider attitudes towards EBPs and EBP use. We also expected attitudes toward EBPs to mediate the association of organizational support and EBP use.

Methods

Participants were mental health service providers from 17 communities in 16 states in the United States (n = 170). Path analyses were conducted to compare three theoretical models of the impact of organization type on organizational support for EBP and of organizational support on provider attitudes toward EBP and EBP use.

Results

Consistent with our predictions, private agencies provided greater support for EBP implementation, and staff working for private agencies reported more positive attitudes toward adopting EBPs. Organizational support for EBP partially mediated the association of organization type on provider attitudes toward EBP. Organizational support was significantly positively associated with attitudes toward EBP and EBP use in practice.

Conclusion

This study offers further support for the importance of organizational context as an influence on organizational support for EBP and provider attitudes toward adopting EBP. The study demonstrates the role organizational support in provider use of EBP in practice. This study also suggests that organizational support for innovation is a malleable factor in supporting use of EBP. Greater attention should be paid to organizational influences that can facilitate the dissemination and implementation of EBPs in community settings.

     

Effective strategies for scaling up evidence-based practices in primary care: a systematic review

Background

While an extensive array of existing evidence-based practices (EBPs) have the potential to improve patient outcomes, little is known about how to implement EBPs on a larger scale. Therefore, we sought to identify effective strategies for scaling up EBPs in primary care.

Methods

We conducted a systematic review with the following inclusion criteria: (i) study design: randomized and non-randomized controlled trials, before-and-after (with/without control), and interrupted time series; (ii) participants: primary care-related units (e.g., clinical sites, patients); (iii) intervention: any strategy used to scale up an EBP; (iv) comparator: no restrictions; and (v) outcomes: no restrictions. We searched MEDLINE, Embase, PsycINFO, Web of Science, CINAHL, and the Cochrane Library from database inception to August 2016 and consulted clinical trial registries and gray literature. Two reviewers independently selected eligible studies, then extracted and analyzed data following the Cochrane methodology. We extracted components of scaling-up strategies and classified them into five categories: infrastructure, policy/regulation, financial, human resources-related, and patient involvement. We extracted scaling-up process outcomes, such as coverage, and provider/patient outcomes. We validated data extraction with study authors.

Results

We included 14 studies. They were published since 2003 and primarily conducted in low-/middle-income countries (n?=?11). Most were funded by governmental organizations (n?=?8). The clinical area most represented was infectious diseases (HIV, tuberculosis, and malaria, n?=?8), followed by newborn/child care (n?=?4), depression (n?=?1), and preventing seniors’ falls (n?=?1). Study designs were mostly before-and-after (without control, n?=?8). The most frequently targeted unit of scaling up was the clinical site (n?=?11). The component of a scaling-up strategy most frequently mentioned was human resource-related (n?=?12). All studies reported patient/provider outcomes. Three studies reported scaling-up coverage, but no study quantitatively reported achieving a coverage of 80% in combination with a favorable impact.

Conclusions

We found few studies assessing strategies for scaling up EBPs in primary care settings. It is uncertain whether any strategies were effective as most studies focused more on patient/provider outcomes and less on scaling-up process outcomes. Minimal consensus on the metrics of scaling up are needed for assessing the scaling up of EBPs in primary care.

Trial registration

This review is registered as PROSPERO CRD42016041461.

     

Institutionalizing evidence-based practice: an organizational case study using a model of strategic change

Background

There is a general expectation within healthcare that organizations should use evidence-based practice (EBP) as an approach to improving the quality of care. However, challenges exist regarding how to make EBP a reality, particularly at an organizational level and as a routine, sustained aspect of professional practice.

Methods

A mixed method explanatory case study was conducted to study context; i.e., in terms of the presence or absence of multiple, inter-related contextual elements and associated strategic approaches required for integrated, routine use of EBP ('institutionalization'). The Pettigrew et al. Content, Context, and Process model was used as the theoretical framework. Two sites in the US were purposively sampled to provide contrasting cases: i.e., a 'role model' site, widely recognized as demonstrating capacity to successfully implement and sustain EBP to a greater degree than others; and a 'beginner' site, self-perceived as early in the journey towards institutionalization.

Results

The two sites were clearly different in terms of their organizational context, level of EBP activity, and degree of institutionalization. For example, the role model site had a pervasive, integrated presence of EBP versus a sporadic, isolated presence in the beginner site. Within the inner context of the role model site, there was also a combination of the Pettigrew and colleagues' receptive elements that, together, appeared to enhance its ability to effectively implement EBP-related change at multiple levels. In contrast, the beginner site, which had been involved for a few years in EBP-related efforts, had primarily non-receptive conditions in several contextual elements and a fairly low overall level of EBP receptivity. The beginner site thus appeared, at the time of data collection, to lack an integrated context to either support or facilitate the institutionalization of EBP.

Conclusion

Our findings provide evidence of some of the key contextual elements that may require attention if institutionalization of EBP is to be realized. They also suggest the need for an integrated set of receptive contextual elements to achieve EBP institutionalization; and they further support the importance of specific interactions among these elements, including ways in which leadership affects other contextual elements positively or negatively.     

Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes

Background

Health care organizations exert significant influence on the manner in which clinicians practice and the processes and outcomes of care that patients experience. A greater understanding of the organizational milieu into which innovations will be introduced, as well as the organizational factors that are likely to foster or hinder the adoption and use of new technologies, care arrangements and quality improvement (QI) strategies are central to the effective implementation of research into practice. Unfortunately, much implementation research seems to not recognize or adequately address the influence and importance of organizations. Using examples from the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI), we describe the role of organizational research in advancing the implementation of evidence-based practice into routine care settings.

Methods

Using the six-step QUERI process as a foundation, we present an organizational research framework designed to improve and accelerate the implementation of evidence-based practice into routine care. Specific QUERI-related organizational research applications are reviewed, with discussion of the measures and methods used to apply them. We describe these applications in the context of a continuum of organizational research activities to be conducted before, during and after implementation.

Results

Since QUERI's inception, various approaches to organizational research have been employed to foster progress through QUERI's six-step process. We report on how explicit integration of the evaluation of organizational factors into QUERI planning has informed the design of more effective care delivery system interventions and enabled their improved "fit" to individual VA facilities or practices. We examine the value and challenges in conducting organizational research, and briefly describe the contributions of organizational theory and environmental context to the research framework.

Conclusion

Understanding the organizational context of delivering evidence-based practice is a critical adjunct to efforts to systematically improve quality. Given the size and diversity of VA practices, coupled with unique organizational data sources, QUERI is well-positioned to make valuable contributions to the field of implementation science. More explicit accommodation of organizational inquiry into implementation research agendas has helped QUERI researchers to better frame and extend their work as they move toward regional and national spread activities.     

Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration

Background

Facilitation has been identified in the literature as a potentially key component of successful implementation. It has not, however, either been well-defined or well-studied. Significant questions remain about the operational definition of facilitation and about the relationship of facilitation to other interventions, especially to other change agent roles when used in multi-faceted implementation projects. Researchers who are part of the Quality Enhancement Research Initiative (QUERI) are actively exploring various approaches and processes, including facilitation, to enable implementation of best practices in the Veterans Health Administration health care system – the largest integrated healthcare system in the United States. This paper describes a systematic, retrospective evaluation of implementation-related facilitation experiences within QUERI, a quality improvement program developed by the US Department of Veterans Affairs.

Methods

A post-hoc evaluation was conducted through a series of semi-structured interviews to examine the concept of facilitation across several multi-site QUERI implementation studies. The interview process is based on a technique developed in the field of education, which systematically enhances learning through experience by stimulating recall and reflection regarding past complex activities. An iterative content analysis approach relative to a set of conceptually-based interview questions was used for data analysis.

Findings

Findings suggest that facilitation, within an implementation study initiated by a central change agency, is a deliberate and valued process of interactive problem solving and support that occurs in the context of a recognized need for improvement and a supportive interpersonal relationship. Facilitation was described primarily as a distinct role with a number of potentially crucial behaviors and activities. Data further suggest that external facilitators were likely to use or integrate other implementation interventions, while performing this problem-solving and supportive role.

Preliminary Conclusions

This evaluation provides evidence to suggest that facilitation could be considered a distinct implementation intervention, just as audit and feedback, educational outreach, or similar methods are considered to be discrete interventions. As such, facilitation should be well-defined and explicitly evaluated for its perceived usefulness within multi-intervention implementation projects. Additionally, researchers should better define the specific contribution of facilitation to the success of implementation in different types of projects, different types of sites, and with evidence and innovations of varying levels of strength and complexity.     

Using Win-Win Strategies to Implement Health in All Policies: A Cross-Case Analysis

Background

In spite of increasing research into intersections of public policy and health, little evidence shows how policy processes impact the implementation of Health in All Policies (HiAP) initiatives. Our research sought to understand how and why strategies for engaging partners from diverse policy sectors in the implementation of HiAP succeed or fail in order to uncover the underlying social mechanisms contributing to sustainable implementation of HiAP.

Methods

In this explanatory multiple case study, we analyzed grey and peer-review literature and key informant interviews to identify mechanisms leading to implementation successes and failures in relation to different strategies for engagement across three case studies (Sweden, Quebec and South Australia), after accounting for the role of different contextual conditions.

Findings

Our results yielded no support for the use of awareness-raising or directive strategies as standalone approaches for engaging partners to implement HiAP. However, we found strong evidence that mechanisms related to “win-win” strategies facilitated implementation by increasing perceived acceptability (or buy-in) and feasibility of HiAP implementation across sectors. Win-win strategies were facilitated by mechanisms related to several activities, including: the development of a shared language to facilitate communication between actors from different sectors; integrating health into other policy agendas (eg., sustainability) and use of dual outcomes to appeal to the interests of diverse policy sectors; use of scientific evidence to demonstrate the effectiveness of HiAP; and using health impact assessment to make policy coordination for public health outcomes more feasible and to give credibility to policies being developed by diverse policy sectors.

Conclusion

Our findings enrich theoretical understanding in an under-unexplored area of intersectoral action. They also provide policy makers with examples of HiAP across wealthy welfare regimes, and improve understanding of successful HiAP implementation practices, including the win-win approach.     

Ethical issues in implementation research: a discussion of the problems in achieving informed consent

Background

Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project.

Methods

This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers.

Results

Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers.

Conclusion

Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions.     

Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review

Background

One of the key strategies to successful implementation of effective health-related interventions is targeting improvements in stakeholder engagement. The discrete choice experiment (DCE) is a stated preference technique for eliciting individual preferences over hypothetical alternative scenarios that is increasingly being used in health-related applications. DCEs are a dynamic approach to systematically measure health preferences which can be applied in enhancing stakeholder engagement. However, a knowledge gap exists in characterizing the extent to which DCEs are used in implementation science.

Methods

We conducted a systematic literature search (up to December 2016) of the English literature to identify and describe the use of DCEs in engaging stakeholders as an implementation strategy. We searched the following electronic databases: MEDLINE, Econlit, PsychINFO, and the CINAHL using mesh terms. Studies were categorized according to application type, stakeholder(s), healthcare setting, and implementation outcome.

Results

Seventy-five publications were selected for analysis in this systematic review. Studies were categorized by application type: (1) characterizing demand for therapies and treatment technologies (n?=?32), (2) comparing implementation strategies (n?=?22), (3) incentivizing workforce participation (n?=?11), and (4) prioritizing interventions (n?=?10). Stakeholders included providers (n?=?27), patients (n?=?25), caregivers (n?=?5), and administrators (n?=?2). The remaining studies (n?=?16) engaged multiple stakeholders (i.e., combination of patients, caregivers, providers, and/or administrators). The following implementation outcomes were discussed: acceptability (n?=?75), appropriateness (n?=?34), adoption (n?=?19), feasibility (n?=?16), and fidelity (n?=?3).

Conclusions

The number of DCE studies engaging stakeholders as an implementation strategy has been increasing over the past decade. As DCEs are more widely used as a healthcare assessment tool, there is a wide range of applications for them in stakeholder engagement. The DCE approach could serve as a tool for engaging stakeholders in implementation science.

     

Training community resource center and clinic personnel to prompt patients in listing questions for doctors: Follow-up interviews about barriers and facilitators to the implementation of consultation planning

Background

Behavioral health services for children and adolescents in the U.S. are lacking in accessibility, availability and quality. Evidence-based interventions for emotional and behavioral disorders can improve quality, yet few studies have systematically examined their implementation in routine care settings.

Methods

Using quantitative and qualitative data, we evaluated a multi-faceted implementation strategy to implement cognitive-behavioral therapy (CBT) for depressed adolescents into two publicly-funded mental healthcare centers. Extent of implementation during the study's duration and variables influencing implementation were explored.

Results

Of the 35 clinicians eligible to participate, 25 (71%) were randomized into intervention (n = 11) or usual care (n = 14). Nine intervention clinicians completed the CBT training. Sixteen adolescents were enrolled in CBT with six of the intervention clinicians; half of these received at least six CBT manually-based sessions. Multiple barriers to CBT adoption and sustained use were identified by clinicians in qualitative interviews.

Conclusion

Strategies to implement evidence-based interventions into routine clinical settings should include multi-method, pre-implementation assessments of the clinical environment and address multiple barriers to initial uptake as well as long-term sustainability.     

Fitting hidden Markov models of protein domains to a target species: application to Plasmodium falciparum

Background

The identification of gene sets that are significantly impacted in a given condition based on microarray data is a crucial step in current life science research. Most gene set analysis methods treat genes equally, regardless how specific they are to a given gene set.

Results

In this work we propose a new gene set analysis method that computes a gene set score as the mean of absolute values of weighted moderated gene t-scores. The gene weights are designed to emphasize the genes appearing in few gene sets, versus genes that appear in many gene sets. We demonstrate the usefulness of the method when analyzing gene sets that correspond to the KEGG pathways, and hence we called our method P athway A nalysis with D own-weighting of O verlapping G enes (PADOG). Unlike most gene set analysis methods which are validated through the analysis of 2-3 data sets followed by a human interpretation of the results, the validation employed here uses 24 different data sets and a completely objective assessment scheme that makes minimal assumptions and eliminates the need for possibly biased human assessments of the analysis results.

Conclusions

PADOG significantly improves gene set ranking and boosts sensitivity of analysis using information already available in the gene expression profiles and the collection of gene sets to be analyzed. The advantages of PADOG over other existing approaches are shown to be stable to changes in the database of gene sets to be analyzed. PADOG was implemented as an R package available at: http://bioinformaticsprb.med.wayne.edu/PADOG/or http://www.bioconductor.org.     

A KT intervention including the evidence alert system to improve clinician’s evidence-based practice behavior—a cluster randomized controlled trial

Background

It is difficult to foster research utilization among allied health professionals (AHPs). Tailored, multifaceted knowledge translation (KT) strategies are now recommended but are resource intensive to implement. Employers need effective KT solutions but little is known about; the impact and viability of multifaceted KT strategies using an online KT tool, their effectiveness with AHPs and their effect on evidence-based practice (EBP) decision-making behavior. The study aim was to measure the effectiveness of a multifaceted KT intervention including a customized KT tool, to change EBP behavior, knowledge, and attitudes of AHPs.

Methods

This is an evaluator-blinded, cluster randomized controlled trial conducted in an Australian community-based cerebral palsy service. 135 AHPs (physiotherapists, occupational therapists, speech pathologists, psychologists and social workers) from four regions were cluster randomized (n?=?4), to either the KT intervention group (n?=?73 AHPs) or the control group (n?=?62 AHPs), using computer-generated random numbers, concealed in opaque envelopes, by an independent officer. The KT intervention included three-day skills training workshop and multifaceted workplace supports to redress barriers (paid EBP time, mentoring, system changes and access to an online research synthesis tool). Primary outcome (self- and peer-rated EBP behavior) was measured using the Goal Attainment Scale (individual level). Secondary outcomes (knowledge and attitudes) were measured using exams and the Evidence Based Practice Attitude Scale.

Results

The intervention group’s primary outcome scores improved relative to the control group, however when clustering was taken into account, the findings were non-significant: self-rated EBP behavior [effect size 4.97 (95% CI -10.47, 20.41) (p?=?0.52)]; peer-rated EBP behavior [effect size 5.86 (95% CI -17.77, 29.50) (p?=?0.62)]. Statistically significant improvements in EBP knowledge were detected [effect size 2.97 (95% CI 1.97, 3.97 (p?<?0.0001)]. Change in EBP attitudes was not statistically significant.

Conclusions

Improvement in EBP behavior was not statistically significant after adjusting for cluster effect, however similar improvements from peer-ratings suggest behaviorally meaningful gains. The large variability in behavior observed between clusters suggests barrier assessments and subsequent KT interventions may need to target subgroups within an organization.

Trial registration

Registered on the Australian New Zealand Clinical Trials Registry (ACTRN12611000529943).

     

Using a multi-state Learning Community as an implementation strategy for immediate postpartum long-acting reversible contraception

Background

Implementation strategies are imperative for the successful adoption and sustainability of complex evidence-based public health practices. Creating a learning collaborative is one strategy that was part of a recently published compilation of implementation strategy terms and definitions. In partnership with the Centers for Disease Control and Prevention and other partner agencies, the Association of State and Territorial Health Officials recently convened a multi-state Learning Community to support cross-state collaboration and provide technical assistance for improving state capacity to increase access to long-acting reversible contraception (LARC) in the immediate postpartum period, an evidence-based practice with the potential for reducing unintended pregnancy and improving maternal and child health outcomes. During 2015–2016, the Learning Community included multi-disciplinary, multi-agency teams of state health officials, payers, clinicians, and health department staff from 13 states. This qualitative study was conducted to better understand the successes, challenges, and strategies that the 13 US states in the Learning Community used for increasing access to immediate postpartum LARC.

Methods

We conducted telephone interviews with each team in the Learning Community. Interviews were semi-structured and organized by the eight domains of the Learning Community. We coded transcribed interviews for facilitators, barriers, and implementation strategies, using a recent compilation of expert-defined implementation strategies as a foundation for coding the latter.

Results

Data analysis showed three ways that the activities of the Learning Community helped in policy implementation work: structure and accountability, validity, and preparing for potential challenges and opportunities. Further, the qualitative data demonstrated that the Learning Community integrated six other implementation strategies from the literature: organize clinician implementation team meetings, conduct educational meetings, facilitation, promote network weaving, provide ongoing consultation, and distribute educational materials.

Conclusions

Convening a multi-state learning collaborative is a promising approach for facilitating the implementation of new reimbursement policies for evidence-based practices complicated by systems challenges. By integrating several implementation strategies, the Learning Community serves as a meta-strategy for supporting implementation.

     

Feasibility and acceptability of two incentive-based implementation strategies for mental health therapists implementing cognitive-behavioral therapy: a pilot study to inform a randomized controlled trial

Background

Informed by our prior work indicating that therapists do not feel recognized or rewarded for implementation of evidence-based practices, we tested the feasibility and acceptability of two incentive-based implementation strategies that seek to improve therapist adherence to cognitive-behavioral therapy for youth, an evidence-based practice.

Methods

This study was conducted over 6 weeks in two community mental health agencies with therapists (n?=?11) and leaders (n?=?4). Therapists were randomized to receive either a financial or social incentive if they achieved a predetermined criterion on adherence to cognitive-behavioral therapy. In the first intervention period (block 1; 2 weeks), therapists received the reward they were initially randomized to if they achieved criterion. In the second intervention period (block 2; 2 weeks), therapists received both rewards if they achieved criterion. Therapists recorded 41 sessions across 15 unique clients over the project period. Primary outcomes included feasibility and acceptability. Feasibility was assessed quantitatively. Fifteen semi-structured interviews were conducted with therapists and leaders to assess acceptability. Difference in therapist adherence by condition was examined as an exploratory outcome. Adherence ratings were ascertained using an established and validated observational coding system of cognitive-behavioral therapy.

Results

Both implementation strategies were feasible and acceptable—however, modifications to study design for the larger trial will be necessary based on participant feedback. With respect to our exploratory analysis, we found a trend suggesting the financial reward may have had a more robust effect on therapist adherence than the social reward.

Conclusions

Incentive-based implementation strategies can be feasibly administered in community mental health agencies with good acceptability, although iterative pilot work is essential. Larger, fully powered trials are needed to compare the effectiveness of implementation strategies to incentivize and enhance therapists’ adherence to evidence-based practices such as cognitive-behavioral therapy.

     

Implementing academic detailing for breast cancer screening in underserved communities

Background

Canadian funding agencies are no longer content to support research that solely advances scientific knowledge, and key directives are now in place to promote research transfer to policy- and decision-makers. Therefore, it is necessary to improve our understanding of how researchers are trained and supported to facilitate knowledge translation activities. In this study, we investigated differences in health researcher characteristics and knowledge translation activities.

Methods

Our sample consisted of 240 health researchers from three Alberta universities. Respondents were classified by research domain [basic (n = 72) or applied (n = 168)] and faculty [medical school (n = 128) or other health science (n = 112)]. We examined our findings using Mode I and Mode II archetypes of knowledge production, which allowed us to consider the scholarly and social contexts of knowledge production and translation.

Results

Differences among health researcher professional characteristics were not statistically significant. There was a significant gender difference in the applied researcher faculty group, which was predominantly female (p <.05). Research domain was linked to translation activities. Applied researchers reported engaging in significantly more Mode II activities than basic researchers (p <.001), and scored higher than basic researchers regarding the perceived importance of translation activities (Mode I, p =.01; Mode II, p <.001). Main effects of faculty were limited to engaged dissemination (medical school < other faculties; p =.025) and number of publications (medical school > other faculties; p =.004). There was an interaction effect for research domain and faculty group for number of publications (p =.01), in that applied researchers in medical faculties published more than their peers in other faculty groups.

Conclusion

Our findings illustrate important differences between health researchers and provide beginning insights into their professional characteristics and engagement in Mode I and Mode II activities. A future study designed to examine these dimensions in greater detail, including potential covariates across more varied institutions, would yield richer insights and enable an examination of relative influences, needs and costs of each mode of activity.