Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes

Background

Health care organizations exert significant influence on the manner in which clinicians practice and the processes and outcomes of care that patients experience. A greater understanding of the organizational milieu into which innovations will be introduced, as well as the organizational factors that are likely to foster or hinder the adoption and use of new technologies, care arrangements and quality improvement (QI) strategies are central to the effective implementation of research into practice. Unfortunately, much implementation research seems to not recognize or adequately address the influence and importance of organizations. Using examples from the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI), we describe the role of organizational research in advancing the implementation of evidence-based practice into routine care settings.

Methods

Using the six-step QUERI process as a foundation, we present an organizational research framework designed to improve and accelerate the implementation of evidence-based practice into routine care. Specific QUERI-related organizational research applications are reviewed, with discussion of the measures and methods used to apply them. We describe these applications in the context of a continuum of organizational research activities to be conducted before, during and after implementation.

Results

Since QUERI's inception, various approaches to organizational research have been employed to foster progress through QUERI's six-step process. We report on how explicit integration of the evaluation of organizational factors into QUERI planning has informed the design of more effective care delivery system interventions and enabled their improved "fit" to individual VA facilities or practices. We examine the value and challenges in conducting organizational research, and briefly describe the contributions of organizational theory and environmental context to the research framework.

Conclusion

Understanding the organizational context of delivering evidence-based practice is a critical adjunct to efforts to systematically improve quality. Given the size and diversity of VA practices, coupled with unique organizational data sources, QUERI is well-positioned to make valuable contributions to the field of implementation science. More explicit accommodation of organizational inquiry into implementation research agendas has helped QUERI researchers to better frame and extend their work as they move toward regional and national spread activities.     

Using patient and physician perspectives to develop a shared decision-making framework for colorectal cancer

The Quality Enhancement Research Initiative (QUERI) program and implementation research have both come of age in the 10 years since QUERI was established. Looking forward, if QUERI and the field of implementation science are to mature successfully, we will need to address a series of challenges. First, we need to more clearly demonstrate how applying principles of implementation science leads to more effective implementation and communicate those lessons to our partners and funders. Second, we will need to engage in the ongoing debate over methodological standards in quality improvement and implementation research. Third, a program like QUERI needs to become more relevant to the daily decisions of key stakeholders. Fourth, if we hope to sustain interest in implementation science, we will need to demonstrate the business case for more effective implementation. Fifth, we need to think creatively about how to nurture the next generations of implementation researchers and front-line "connectors," who are critical for accelerating implementation. Finally, we need to strengthen the connections between implementation research and the other operational and research activities that influence change in healthcare systems. The excitement of entering adulthood is tempered by the challenge of new responsibilities and expectations. What is essential is that we continue to learn and move forward. For implementation science and for QUERI, the next decade looks to be one filled with exciting possibilities, new partnerships, increasing relevance, and real accomplishment.     

Ethical issues in implementation research: a discussion of the problems in achieving informed consent

Background

Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project.

Methods

This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers.

Results

Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers.

Conclusion

Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions.     

Lessons for non-VA care delivery systems from the U.S. Department of Veterans Affairs Quality Enhancement Research Initiative: QUERI Series

The U.S. Veterans Health Administration (VHA) may have a very different structure and function from the organizations and practices that provide medical care to most Americans, but those organizations and practices could learn a lot from the VHA's Quality Enhancement Research Initiative (QUERI). There are at least six topics of increasing importance for implementation research where QUERI experience should be of value to other non-VHA organizations, both within and external to the United States: 1) Researcher-clinical leader partnerships for care improvement; 2) Attention to culture, capacity, leadership, and a supportive infrastructure; 3) Practical economic evaluation of quality implementation efforts; 4) Human subject protection problems; 5) Sustainability of improvements; and 6) Scale-up and spread of improvements. The articles in Implementation Science's QUERI Series provide the details of those lessons for others who are willing to invest the time to translate them into their different settings.     

Understanding the performance and impact of public knowledge translation funding interventions: Protocol for an evaluation of Canadian institutes of health research knowledge translation funding programs

ABSTRACT: BACKGROUND: The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. DESIGN: The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. DISCUSSION: The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated.     

Measuring persistence of implementation: QUERI Series

Background

We describe how we used the framework of the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) to develop a program to improve rates of diagnostic testing for the Human Immunodeficiency Virus (HIV). This venture was prompted by the observation by the CDC that 25% of HIV-infected patients do not know their diagnosis – a point of substantial importance to the VA, which is the largest provider of HIV care in the United States.

Methods

Following the QUERI steps (or process), we evaluated: 1) whether undiagnosed HIV infection is a high-risk, high-volume clinical issue within the VA, 2) whether there are evidence-based recommendations for HIV testing, 3) whether there are gaps in the performance of VA HIV testing, and 4) the barriers and facilitators to improving current practice in the VA. Based on our findings, we developed and initiated a QUERI step 4/phase 1 pilot project using the precepts of the Chronic Care Model. Our improvement strategy relies upon electronic clinical reminders to provide decision support; audit/feedback as a clinical information system, and appropriate changes in delivery system design. These activities are complemented by academic detailing and social marketing interventions to achieve provider activation.

Results

Our preliminary formative evaluation indicates the need to ensure leadership and team buy-in, address facility-specific barriers, refine the reminder, and address factors that contribute to inter-clinic variances in HIV testing rates. Preliminary unadjusted data from the first seven months of our program show 3–5 fold increases in the proportion of at-risk patients who are offered HIV testing at the VA sites (stations) where the pilot project has been undertaken; no change was seen at control stations.

Discussion

This project demonstrates the early success of the application of the QUERI process to the development of a program to improve HIV testing rates. Preliminary unadjusted results show that the coordinated use of audit/feedback, provider activation, and organizational change can increase HIV testing rates for at-risk patients. We are refining our program prior to extending our work to a small-scale, multi-site evaluation (QUERI step 4/phase 2). We also plan to evaluate the durability/sustainability of the intervention effect, the costs of HIV testing, and the number of newly identified HIV-infected patients. Ultimately, we will evaluate this program in other geographically dispersed stations (QUERI step 4/phases 3 and 4).     

Adjuncts or adversaries to shared decision-making? Applying the Integrative Model of behavior to the role and design of decision support interventions in healthcare interactions

Background

Clinical practice guidelines have been a popular tool for the improvement of health care through the implementation of evidence from systematic research. Yet, it is increasingly clear that knowledge alone is insufficient to change practice. The social, cultural, and material contexts within which practice occurs may invite or reject innovation, complement or inhibit the activities required for success, and sustain or alter adherence to entrenched practices. However, knowledge translation (KT) models are limited in providing insight about how and why contextual contingencies interact, the causal mechanisms linking structural aspects of context and individual agency, and how these mechanisms influence KT. Another limitation of KT models is the neglect of methods to engage potential adopters of the innovation in critical reflection about aspects of context that influence practice, the relevance and meaning of innovation in the context of practice, and the identification of strategies for bringing about meaningful change.

Discussion

This paper presents a KT model, the Critical Realism and the Arts Research Utilization Model (CRARUM), that combines critical realism and arts-based methodologies. Critical realism facilitates understanding of clinical settings by providing insight into the interrelationship between its structures and potentials, and individual action. The arts nurture empathy, and can foster reflection on the ways in which contextual factors influence and shape clinical practice, and how they may facilitate or impede change. The combination of critical realism and the arts within the CRARUM model promotes the successful embedding of interventions, and greater impact and sustainability.

Conclusion

CRARUM has the potential to strengthen the science of implementation research by addressing the complexities of practice settings, and engaging potential adopters to critically reflect on existing and proposed practices and strategies for sustaining change.     

Implementing an innovative consent form: the PREDICT experience

Background

This article describes the process used by the authors in developing an implementation intervention to assist VA substance use disorder clinics in adopting guideline-based practices for treating depression. This article is one in a Series of articles documenting implementation science frameworks and tools developed by the U.S. Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI).

Methods

The process involves two steps: 1) diagnosis of site-specific implementation needs, barriers, and facilitators (i.e., formative evaluation); and 2) the use of multi-disciplinary teams of local staff, implementation experts, and clinical experts to interpret diagnostic data and develop site-specific interventions. In the current project, data were collected via observations of program activities and key informant interviews with clinic staff and patients. The assessment investigated a wide range of macro- and micro-level determinants of organizational and provider behavior.

Conclusion

The implementation development process described here is presented as an optional method (or series of steps) to consider when designing a small scale, multi-site implementation study. The process grew from an evidence-based quality improvement strategy developed for – and proven efficacious in – primary care settings. The authors are currently studying the efficacy of the process across a spectrum of specialty care treatment settings.     

Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration

Background

Facilitation has been identified in the literature as a potentially key component of successful implementation. It has not, however, either been well-defined or well-studied. Significant questions remain about the operational definition of facilitation and about the relationship of facilitation to other interventions, especially to other change agent roles when used in multi-faceted implementation projects. Researchers who are part of the Quality Enhancement Research Initiative (QUERI) are actively exploring various approaches and processes, including facilitation, to enable implementation of best practices in the Veterans Health Administration health care system – the largest integrated healthcare system in the United States. This paper describes a systematic, retrospective evaluation of implementation-related facilitation experiences within QUERI, a quality improvement program developed by the US Department of Veterans Affairs.

Methods

A post-hoc evaluation was conducted through a series of semi-structured interviews to examine the concept of facilitation across several multi-site QUERI implementation studies. The interview process is based on a technique developed in the field of education, which systematically enhances learning through experience by stimulating recall and reflection regarding past complex activities. An iterative content analysis approach relative to a set of conceptually-based interview questions was used for data analysis.

Findings

Findings suggest that facilitation, within an implementation study initiated by a central change agency, is a deliberate and valued process of interactive problem solving and support that occurs in the context of a recognized need for improvement and a supportive interpersonal relationship. Facilitation was described primarily as a distinct role with a number of potentially crucial behaviors and activities. Data further suggest that external facilitators were likely to use or integrate other implementation interventions, while performing this problem-solving and supportive role.

Preliminary Conclusions

This evaluation provides evidence to suggest that facilitation could be considered a distinct implementation intervention, just as audit and feedback, educational outreach, or similar methods are considered to be discrete interventions. As such, facilitation should be well-defined and explicitly evaluated for its perceived usefulness within multi-intervention implementation projects. Additionally, researchers should better define the specific contribution of facilitation to the success of implementation in different types of projects, different types of sites, and with evidence and innovations of varying levels of strength and complexity.     

Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge

Background

Better use of research evidence (one form of “knowledge”) in health systems requires partnerships between researchers and those who contend with the real-world needs and constraints of health systems. Community-based participatory research (CBPR) and integrated knowledge translation (IKT) are research approaches that emphasize the importance of creating partnerships between researchers and the people for whom the research is ultimately meant to be of use (“knowledge users”). There exist poor understandings of the ways in which these approaches converge and diverge. Better understanding of the similarities and differences between CBPR and IKT will enable researchers to use these approaches appropriately and to leverage best practices and knowledge from each. The co-creation of knowledge conveys promise of significant social impacts, and further understandings of how to engage and involve knowledge users in research are needed.

Main text

We examine the histories and traditions of CBPR and IKT, as well as their points of convergence and divergence. We critically evaluate the ways in which both have the potential to contribute to the development and integration of knowledge in health systems. As distinct research traditions, the underlying drivers and rationale for CBPR and IKT have similarities and differences across the areas of motivation, social location, and ethics; nevertheless, the practices of CBPR and IKT converge upon a common aim: the co-creation of knowledge that is the result of knowledge user and researcher expertise. We argue that while CBPR and IKT both have the potential to contribute evidence to implementation science and practices for collaborative research, clarity for the purpose of the research—social change or application—is a critical feature in the selection of an appropriate collaborative approach to build knowledge.

Conclusion

CBPR and IKT bring distinct strengths to a common aim: to foster democratic processes in the co-creation of knowledge. As research approaches, they create opportunities to challenge assumptions about for whom, how, and what is defined as knowledge, and to develop and integrate research findings into health systems. When used appropriately, CBPR and IKT both have the potential to contribute to and advance implementation science about the conduct of collaborative health systems research.

     

Characterization of aromatic acid/proton symporters in Pseudomonas putida KT2440 toward efficient microbial conversion of lignin-related aromatics

Pseudomonas putida KT2440 (hereafter KT2440) is a well-studied platform bacterium for the production of industrially valuable chemicals from heterogeneous mixtures of aromatic compounds obtained from lignin depolymerization. KT2440 can grow on lignin-related monomers, such as ferulate (FA), 4-coumarate (4CA), vanillate (VA), 4-hydroxybenzoate (4HBA), and protocatechuate (PCA). Genes associated with their catabolism are known, but knowledge about the uptake systems remains limited. In this work, we studied the KT2440 transporters of lignin-related monomers and their substrate selectivity. Based on the inhibition by protonophores, we focused on five genes encoding aromatic acid/H⁺ symporter family transporters categorized into major facilitator superfamily that uses the proton motive force. The mutants of PP_1376 (pcaK) and PP_3349 (hcnK) exhibited significantly reduced growth on PCA/4HBA and FA/4CA, respectively, while no change was observed on VA for any of the five gene mutants. At pH 9.0, the conversion of these compounds by hcnK mutant (FA/4CA) and vanK mutant (VA) was dramatically reduced, revealing that these transporters are crucial for the uptake of the anionic substrates at high pH. Uptake assays using ¹⁴C-labeled substrates in Escherichia coli and biosensor-based assays confirmed that PcaK, HcnK, and VanK have ability to take up PCA, FA/4CA, and VA/PCA, respectively. Additionally, analyses of the predicted protein structures suggest that the size and hydropathic properties of the substrate-binding sites of these transporters determine their substrate preferences. Overall, this study reveals that at physiological pH, PcaK and HcnK have a major role in the uptake of PCA/4HBA and FA/4CA, respectively, and VanK is a VA/PCA transporter. This information can contribute to the engineering of strains for the efficient conversion of lignin-related monomers to value-added chemicals.     

A multi-faceted knowledge translation approach to support persons with stroke and cognitive impairment: evaluation protocol

Background

Patients with cognitive impairments following a stroke are often denied access to inpatient rehabilitation. The few patients with cognitive impairment admitted to rehabilitation generally receive services based on outdated impairment-reduction models, rather than recommended function-based approaches. Both reduced access to rehabilitation and the knowledge-to-practice gap stem from a reported lack of skills and knowledge regarding cognitive rehabilitation on the part of inpatient rehabilitation team members. To address these issues, a multi-faceted knowledge translation (KT) initiative will be implemented and evaluated. It will be targeted specifically at the inter-professional application of the cognitive orientation to daily occupational performance (CO-OP). CO-OP training combined with KT support is called CO-OP KT. The long-term objective of CO-OP KT is to optimize functional outcomes for individuals with stroke and cognitive impairments. Three research questions are posed:

1. 1.
   Is the implementation of CO-OP KT associated with a change in the proportion of patients with cognitive impairment following a stroke accepted to inpatient rehabilitation?
    
2. 2.
   Is the implementation of CO-OP KT associated with a change in rehabilitation clinicians’ practice, knowledge, and self-efficacy related to implementing the CO-OP approach, immediately following and 1 year later?
    
3. 3.
   Is CO-OP KT associated with changes in activity, participation, and self-efficacy to perform daily activities in patients with cognitive impairment following stroke at discharge from inpatient rehabilitation and at 1-, 3-, and 6-month follow-ups?
    

Methods/Design

Three interrelated studies will be conducted. Study 1 will be a quasi-experimental, interrupted time series design measuring monthly summaries of stroke unit level data. Study 2, which relates to changes in health care professional practice and self-efficacy, will be a single group pre-post evaluation design incorporating chart audits and a self-report survey. Study 3 will assess patient functional outcomes using a non-randomized design with historical controls. Assessments will occur during admission and discharge from rehabilitation and at 1, 3, and 6 months following discharge from rehabilitation.

Discussion

This project will advance knowledge about the degree to which the implementation of a supported KT initiative can sustainably change health system, knowledge, and patient outcomes.

     

Using Health Care Utilization and Publication Patterns to Characterize the Research Portfolio and to Plan Future Research Investments

Objective

Government funders of biomedical research are under increasing pressure to demonstrate societal benefits of their investments. A number of published studies attempted to correlate research funding levels with the societal burden for various diseases, with mixed results. We examined whether research funded by the Department of Veterans Affairs (VA) is well aligned with current and projected veterans’ health needs. The organizational structure of the VA makes it a particularly suitable setting for examining these questions.

Methods

We used the publication patterns and dollar expenditures of VA-funded researchers to characterize the VA research portfolio by disease. We used health care utilization data from the VA for the same diseases to define veterans’ health needs. We then measured the level of correlation between the two and identified disease groups that were under- or over-represented in the research portfolio relative to disease expenditures. Finally, we used historic health care utilization trends combined with demographic projections to identify diseases and conditions that are increasing in costs and/or patient volume and consequently represent potential targets for future research investments.

Results

We found a significant correlation between research volume/expenditures and health utilization. Some disease groups were slightly under- or over-represented, but these deviations were relatively small. Diseases and conditions with the increasing utilization trend at the VA included hypertension, hypercholesterolemia, diabetes, hearing loss, sleeping disorders, complications of pregnancy, and several mental disorders.

Conclusions

Research investments at the VA are well aligned with veteran health needs. The VA can continue to meet these needs by supporting research on the diseases and conditions with a growing number of patients, costs of care, or both. Our approach can be used by other funders of disease research to characterize their portfolios and to plan research investments.     

Implementing academic detailing for breast cancer screening in underserved communities

Background

Canadian funding agencies are no longer content to support research that solely advances scientific knowledge, and key directives are now in place to promote research transfer to policy- and decision-makers. Therefore, it is necessary to improve our understanding of how researchers are trained and supported to facilitate knowledge translation activities. In this study, we investigated differences in health researcher characteristics and knowledge translation activities.

Methods

Our sample consisted of 240 health researchers from three Alberta universities. Respondents were classified by research domain [basic (n = 72) or applied (n = 168)] and faculty [medical school (n = 128) or other health science (n = 112)]. We examined our findings using Mode I and Mode II archetypes of knowledge production, which allowed us to consider the scholarly and social contexts of knowledge production and translation.

Results

Differences among health researcher professional characteristics were not statistically significant. There was a significant gender difference in the applied researcher faculty group, which was predominantly female (p <.05). Research domain was linked to translation activities. Applied researchers reported engaging in significantly more Mode II activities than basic researchers (p <.001), and scored higher than basic researchers regarding the perceived importance of translation activities (Mode I, p =.01; Mode II, p <.001). Main effects of faculty were limited to engaged dissemination (medical school < other faculties; p =.025) and number of publications (medical school > other faculties; p =.004). There was an interaction effect for research domain and faculty group for number of publications (p =.01), in that applied researchers in medical faculties published more than their peers in other faculty groups.

Conclusion

Our findings illustrate important differences between health researchers and provide beginning insights into their professional characteristics and engagement in Mode I and Mode II activities. A future study designed to examine these dimensions in greater detail, including potential covariates across more varied institutions, would yield richer insights and enable an examination of relative influences, needs and costs of each mode of activity.     

Barriers,Facilitators and Priorities for Implementation of WHO Maternal and Perinatal Health Guidelines in Four Lower-Income Countries: A GREAT Network Research Activity

BackgroundHealth systems often fail to use evidence in clinical practice. In maternal and perinatal health, the majority of maternal, fetal and newborn mortality is preventable through implementing effective interventions. To meet this challenge, WHO’s Department of Reproductive Health and Research partnered with the Knowledge Translation Program at St. Michael’s Hospital (SMH), University of Toronto, Canada to establish a collaboration on knowledge translation (KT) in maternal and perinatal health, called the GREAT Network (Guideline-driven, Research priorities, Evidence synthesis, Application of evidence, and Transfer of knowledge). We applied a systematic approach incorporating evidence and theory to identifying barriers and facilitators to implementation of WHO maternal heath recommendations in four lower-income countries and to identifying implementation strategies to address these.MethodsWe conducted a mixed-methods study in Myanmar, Uganda, Tanzania and Ethiopia. In each country, stakeholder surveys, focus group discussions and prioritization exercises were used, involving multiple groups of health system stakeholders (including administrators, policymakers, NGOs, professional associations, frontline healthcare providers and researchers).ResultsDespite differences in guideline priorities and contexts, barriers identified across countries were often similar. Health system level factors, including health workforce shortages, and need for strengthened drug and equipment procurement, distribution and management systems, were consistently highlighted as limiting the capacity of providers to deliver high-quality care. Evidence-based health policies to support implementation, and improve the knowledge and skills of healthcare providers were also identified. Stakeholders identified a range of tailored strategies to address local barriers and leverage facilitators.ConclusionThis approach to identifying barriers, facilitators and potential strategies for improving implementation proved feasible in these four lower-income country settings. Further evaluation of the impact of implementing these strategies is needed.     

A KT intervention including the evidence alert system to improve clinician’s evidence-based practice behavior—a cluster randomized controlled trial

Background

It is difficult to foster research utilization among allied health professionals (AHPs). Tailored, multifaceted knowledge translation (KT) strategies are now recommended but are resource intensive to implement. Employers need effective KT solutions but little is known about; the impact and viability of multifaceted KT strategies using an online KT tool, their effectiveness with AHPs and their effect on evidence-based practice (EBP) decision-making behavior. The study aim was to measure the effectiveness of a multifaceted KT intervention including a customized KT tool, to change EBP behavior, knowledge, and attitudes of AHPs.

Methods

This is an evaluator-blinded, cluster randomized controlled trial conducted in an Australian community-based cerebral palsy service. 135 AHPs (physiotherapists, occupational therapists, speech pathologists, psychologists and social workers) from four regions were cluster randomized (n?=?4), to either the KT intervention group (n?=?73 AHPs) or the control group (n?=?62 AHPs), using computer-generated random numbers, concealed in opaque envelopes, by an independent officer. The KT intervention included three-day skills training workshop and multifaceted workplace supports to redress barriers (paid EBP time, mentoring, system changes and access to an online research synthesis tool). Primary outcome (self- and peer-rated EBP behavior) was measured using the Goal Attainment Scale (individual level). Secondary outcomes (knowledge and attitudes) were measured using exams and the Evidence Based Practice Attitude Scale.

Results

The intervention group’s primary outcome scores improved relative to the control group, however when clustering was taken into account, the findings were non-significant: self-rated EBP behavior [effect size 4.97 (95% CI -10.47, 20.41) (p?=?0.52)]; peer-rated EBP behavior [effect size 5.86 (95% CI -17.77, 29.50) (p?=?0.62)]. Statistically significant improvements in EBP knowledge were detected [effect size 2.97 (95% CI 1.97, 3.97 (p?<?0.0001)]. Change in EBP attitudes was not statistically significant.

Conclusions

Improvement in EBP behavior was not statistically significant after adjusting for cluster effect, however similar improvements from peer-ratings suggest behaviorally meaningful gains. The large variability in behavior observed between clusters suggests barrier assessments and subsequent KT interventions may need to target subgroups within an organization.

Trial registration

Registered on the Australian New Zealand Clinical Trials Registry (ACTRN12611000529943).

     

Initial Results from the Survey of Organizational Research Climates (SOuRCe) in the U.S. Department of Veterans Affairs Healthcare System

Background

In service to its core mission of improving the health and well-being of veterans, Veterans Affairs (VA) leadership is committed to supporting research best practices in the VA. Recognizing that the behavior of researchers is influenced by the organizational climates in which they work, efforts to assess the integrity of research climates and share such information with research leadership in VA may be one way to support research best practices. The Survey of Organizational Research Climate (SOuRCe) is the first validated survey instrument specifically designed to assess the organizational climate of research integrity in academic research organizations. The current study reports on an initiative to use the SOuRCe in VA facilities to characterize the organizational research climates and pilot test the effectiveness of using SOuRCe data as a reporting and feedback intervention tool.

Methods

We administered the SOuRCe using a cross-sectional, online survey, with mailed follow-up to non-responders, of research-engaged employees in the research services of a random selection of 42 VA facilities (e.g., Hospitals/Stations) believed to employ 20 or more research staff. We attained a 51% participation rate, yielding more than 5,200 usable surveys.

Results

We found a general consistency in organizational research climates across a variety of sub-groups in this random sample of research services in the VA. We also observed similar SOuRCe scale score means, relative rankings of these scales and their internal reliability, in this VA-based sample as we have previously documented in more traditional academic research settings. Results also showed more substantial variability in research climate scores within than between facilities in the VA research service as reflected in meaningful subgroup differences. These findings suggest that the SOuRCe is suitable as an instrument for assessing the research integrity climates in VA and that the tool has similar patterns of results that have been observed in more traditional academic research settings.

Conclusions

The local and specific nature of organizational climates in VA research services, as reflected in variability across sub-groups within individual facilities, has important policy implications. Global, “one-size-fits-all” type initiatives are not likely to yield as much benefit as efforts targeted to specific organizational units or sub-groups and tailored to the specific strengths and weaknesses documented in those locations.     

The trainees' perspective on developing an end-of-grant knowledge translation plan

Background

Knowledge translation (KT) is a rapidly growing field that is becoming an integral part of research protocols.

Methods

This meeting report describes one group's experience at the 2009 KT Canada Summer Institute in developing an end-of-grant KT plan for a randomized control trial proposal.

Results

Included is a discussion of the process, challenges, and recommendations from the trainee's perspective in developing an end-of-grant KT plan.

Conclusion

New researchers should consider developing an end-of-grant KT plan with strategies that move beyond passive dissemination to incorporate innovative means of collaboration with the end user to craft the message, package the information, and share the research findings with end users.