Managing concerns about falls in older people: evaluation of the implementation of an evidence-based program

Introduction

A cognitive behavioral program reduced concerns about falling and related avoidance behavior among older community-dwelling adults in a randomized controlled trial. In the current study we examined the effects and acceptability of the program after nation-wide implementation into home care organizations in The Netherlands.

Methods

In a one-group pretest–posttest study with data collection before the start of the program and at 2 and 4 months, the effects and acceptability of the program were assessed in 125 community-dwelling older people. The outcomes of the effect evaluation included concerns about falls, related avoidance behavior, falls, fall-related medical attention, feelings of anxiety, symptoms of depression, and loneliness.

Results

Pretest-posttest analyses with the Wilcoxon signed-rank test and the paired t-test showed significant improvements at 4 months for concerns about falls, activity avoidance, number of falls in the past 2 months, feelings of anxiety, and symptoms of depression. No significant differences were shown for the other outcomes.

Discussion

After implementation in home care organizations, the outcomes indicate positive program effects on concerns about falls, avoidance behavior, and falls in community-dwelling older people. Given the similarity in results, i.e. between those of the previously performed randomized controlled trial and those of the current pretest-posttest study, we conclude that the program can be successfully implemented in practice. This article is an adjusted, Dutch version of Zijlstra GA, van Haastregt JC, Du Moulin MF, de Jonge MC, van der Poel A, Kempen GI. Effects of the implementation of an evidenc-based program to manage concerns about falls in older adults. The Gerontologist 2013;53(5):839–849; doi:10.1093/geront/gns142     

The transfer and implementation of an Aboriginal Australian wellbeing program: a grounded theory study

Background

The concepts and standard practices of implementation, largely originating in developed countries, cannot necessarily be simply transferred into diverse cultural contexts. There has been relative inattention in the implementation science literature paid to the implementation of interventions targeting minority Indigenous populations within developed countries. This suggests that the implementation literature may be bypassing population groups within developed countries who suffer some of the greatest disadvantage. Within the context of Aboriginal Australian health improvement, this study considers the impact of political and cultural issues by examining the transfer and implementation of the Family Wellbeing program across 56 places over a 20-year period.

Methods

A theoretical model of program transfer was developed using constructivist-grounded theory methods. Data were generated by conducting in-depth interviews with 18 Aboriginal and non-Aboriginal research respondents who had been active in transferring the program. Data were categorised into higher order abstract concepts and the core impetus for and process of program transfer were identified.

Results

Organizations transferred the program by using it as a vehicle for supporting inside-out empowerment. The impetus to support inside-out empowerment referred to support for Aboriginal people's participation, responsibility for and control of their own affairs, and the associated ripple effects to family members, organizations, communities, and ultimately reconciliation with Australian society at large. Program transfer occurred through a multi-levelled process of embracing relatedness which included relatedness with self, others, and structural conditions; all three were necessary at both individual and organizational levels.

Conclusions

Similar to international implementation models, the model of supporting inside-out empowerment by embracing relatedness involved individuals, organizations, and interpersonal and inter-organizational networks. However, the model suggests that for minority Indigenous populations within developed countries, implementation approaches may require greater attention to the empowering nature of the intervention and its implementation, and multiple levels of relatedness by individuals and organizations with self, others, and the structural conditions. Key elements of the theoretical model provide a useful blueprint to inform the transfer of other empowerment programs to minority Indigenous and other disadvantaged populations on a case-by-case basis.

     

Phase 1 trial of the oral AKT inhibitor MK-2206 plus carboplatin/paclitaxel, docetaxel, or erlotinib in patients with advanced solid tumors

Background

Inhibition of AKT with MK-2206 has demonstrated synergism with anticancer agents. This phase 1 study assessed the MTD, DLTs, PK, and efficacy of MK-2206 in combination with cytotoxic and targeted therapies.

Methods

Advanced solid tumor patients received oral MK-2206 45 or 60 mg (QOD) with either carboplatin (AUC 6.0) and paclitaxel 200 mg/m² (arm 1), docetaxel 75 mg/m² (arm 2), or erlotinib 100 or 150 mg daily (arm 3); alternative schedules of MK-2206 135-200 mg QW or 90-250 mg Q3W were also tested.

Results

MTD of MK-2206 (N?=?72) was 45 mg QOD or 200 mg Q3W (arm 1); MAD was 200 mg Q3W (arm 2) and 135 mg QW (arm 3). DLTs included skin rash (arms 1, 3), febrile neutropenia (QOD, arms 1, 2), tinnitus (Q3W, arm 2), and stomatitis (QOD, arm 3). Common drug-related toxicities included fatigue (68%), nausea (49%), and rash (47%). Two patients with squamous cell carcinoma of the head and neck (arm 1; Q3W) demonstrated a complete and partial response (PR); additional PRs were observed in patients (1 each) with melanoma, endometrial, neuroendocrine prostate, NSCLC, and cervical cancers. Six patients had stable disease ≥6 months.

Conclusion

MK-2206 plus carboplatin and paclitaxel, docetaxel, or erlotinib was well-tolerated, with early evidence of antitumor activity.

Trial registration

ClinicalTrials.gov: NCT00848718.     

Is increased fat content of hindmilk due to the size or the number of milk fat globules?

Background

The Baby-Friendly Hospital Initiative (BFHI) seeks to support breastfeeding initiation in maternity services. This study uses country-level data to examine the relationship between BFHI programming and trends in exclusive breastfeeding (EBF) in 14 developing countries.

Methods

Demographic and Health Surveys and UNICEF BFHI Reports provided EBF and BFHI data. Because country programs were initiated in different years, data points were realigned to the year that the first Baby-Friendly hospital was certified in that country. Pre-and post-implementation time periods were analyzed using fixed effects models to account for grouping of data by country, and compared to assess differences in trends.

Results

Statistically significant upward trends in EBF under two months and under six months, as assessed by whether fitted trends had slopes significantly different from 0, were observed only during the period following BFHI implementation, and not before. BFHI implementation was associated with average annual increases of 1.54 percentage points in the rate of EBF of infants under two months (p < 0.001) and 1.11-percentage points in the rate of EBF of infants under six months (p < 0.001); however, these rates were not statistically different from pre-BFHI trends.

Conclusion

BFHI implementation was associated with a statistically significant annual increase in rates of EBF in the countries under study; however, small sample sizes may have contributed to the fact that results do not demonstrate a significant difference from pre-BFHI trends. Further research is needed to consider trends according to the percentages of Baby-Friendly facilities, percent of all births occurring in these facilities, and continued compliance with the program.     

Invasion of Ureaplasma diversum in Hep-2 cells

Background

Mozambique is one of the countries with the highest burden of tuberculosis (TB) in Sub-Saharan Africa, and information on the predominant genotypes of Mycobacterium tuberculosis circulating in the country are important to better understand the epidemic. This study determined the predominant strain lineages that cause TB in Mozambique.

Results

A total of 445 M. tuberculosis isolates from seven different provinces of Mozambique were characterized by spoligotyping and resulting profiles were compared with the international spoligotyping database SITVIT2. The four most predominant lineages observed were: the Latin-American Mediterranean (LAM, n = 165 or 37%); the East African-Indian (EAI, n = 132 or 29.7%); an evolutionary recent but yet ill-defined T clade, (n = 52 or 11.6%); and the globally-emerging Beijing clone, (n = 31 or 7%). A high spoligotype diversity was found for the EAI, LAM and T lineages.

Conclusions

The TB epidemic in Mozambique is caused by a wide diversity of spoligotypes with predominance of LAM, EAI, T and Beijing lineages.     

An exploratory study of community factors relevant for participatory malaria control on Rusinga Island, western Kenya

Background

Capacity strengthening of rural communities, and the various actors that support them, is needed to enable them to lead their own malaria control programmes. Here the existing capacity of a rural community in western Kenya was evaluated in preparation for a larger intervention.

Methods

Focus group discussions and semi-structured individual interviews were carried out in 1,451 households to determine (1) demographics of respondent and household; (2) socio-economic status of the household; (3) knowledge and beliefs about malaria (symptoms, prevention methods, mosquito life cycle); (4) typical practices used for malaria prevention; (5) the treatment-seeking behaviour and household expenditure for malaria treatment; and (6) the willingness to prepare and implement community-based vector control.

Results

Malaria was considered a major threat to life but relevant knowledge was a chimera of scientific knowledge and traditional beliefs, which combined with socio-economic circumstances, leads to ineffective malaria prevention. The actual malaria prevention behaviour practiced by community members differed significantly from methods known to the respondents. Beside bednet use, the major interventions implemented were bush clearing and various hygienic measures, even though these are ineffective for malaria prevention. Encouragingly, most respondents believed malaria could be controlled and were willing to contribute to a community-based malaria control program but felt they needed outside assistance.

Conclusion

Culturally sensitive but evidence-based education interventions, utilizing participatory tools, are urgently required which consider traditional beliefs and enable understanding of causal connections between mosquito ecology, parasite transmission and the diagnosis, treatment and prevention of disease. Community-based organizations and schools need to be equipped with knowledge through partnerships with national and international research and tertiary education institutions so that evidence-based research can be applied at the grassroots level.     

Recruiting medical groups for research: relationships, reputation, requirements, rewards, reciprocity, resolution, and respect

Background

In order to conduct good implementation science research, it will be necessary to recruit and obtain good cooperation and comprehensive information from complete medical practice organizations. The goal of this paper is to report an effective example of such a recruitment effort for a study of the organizational aspects of depression care quality.

Methods

There were 41 medical groups in the Minnesota region that were eligible for participation in the study because they had sufficient numbers of patients with depression. We documented the steps required to both recruit their participation in this study and obtain their completion of two questionnaire surveys and two telephone interviews.

Results

All 41 medical groups agreed to participate and consented to our use of confidential data about their care quality. In addition, all 82 medical directors and quality improvement coordinators completed the necessary questionnaires and interviews. The key factors explaining this success can be summarized as the seven R's: Relationships, Reputation, Requirements, Rewards, Reciprocity, Resolution, and Respect.

Conclusion

While all studies will not have all of these factors in such good alignment, attention to them may be important to other efforts to add to our knowledge of implementation science.     

Implementation fidelity trajectories of a health promotion program in multidisciplinary settings: managing tensions in rehabilitation care

Background

Although the importance of evaluating implementation fidelity is acknowledged, little is known about heterogeneity in fidelity over time. This study aims to generate insight into the heterogeneity in implementation fidelity trajectories of a health promotion program in multidisciplinary settings and the relationship with changes in patients’ health behavior.

Methods

This study used longitudinal data from the nationwide implementation of an evidence-informed physical activity promotion program in Dutch rehabilitation care. Fidelity scores were calculated based on annual surveys filled in by involved professionals (n?=?±?70). Higher fidelity scores indicate a more complete implementation of the program’s core components. A hierarchical cluster analysis was conducted on the implementation fidelity scores of 17 organizations at three different time points. Quantitative and qualitative data were used to explore organizational and professional differences between identified trajectories. Regression analyses were conducted to determine differences in patient outcomes.

Results

Three trajectories were identified as the following: ‘stable high fidelity’ (n?=?9), ‘moderate and improving fidelity’ (n?=?6), and ‘unstable fidelity’ (n?=?2). The stable high fidelity organizations were generally smaller, started earlier, and implemented the program in a more structured way compared to moderate and improving fidelity organizations. At the implementation period’s start and end, support from physicians and physiotherapists, professionals’ appreciation, and program compatibility were rated more positively by professionals working in stable high fidelity organizations as compared to the moderate and improving fidelity organizations (p?<?.05). Qualitative data showed that the stable high fidelity organizations had often an explicit vision and strategy about the implementation of the program. Intriguingly, the trajectories were not associated with patients’ self-reported physical activity outcomes (adjusted model β?=???651.6, t(613)?=???1032, p?=?.303).

Conclusions

Differences in organizational-level implementation fidelity trajectories did not result in outcome differences at patient-level. This suggests that an effective implementation fidelity trajectory is contingent on the local organization’s conditions. More specifically, achieving stable high implementation fidelity required the management of tensions: realizing a localized change vision, while safeguarding the program’s standardized core components and engaging the scarce physicians throughout the process. When scaling up evidence-informed health promotion programs, we propose to tailor the management of implementation tensions to local organizations’ starting position, size, and circumstances.

Trial registration

The Netherlands National Trial Register NTR3961. Registered 18 April 2013.

     

Incidence and predictors of immediate complications following perioperative non-obstetric epidural punctures

Background

We made a survey among Finnish anesthesiologists concerning the current perioperative anesthetic practice of hip fracture patients for further development in patient care.

Methods

All members of the Finnish Society of Anesthesiologists with a known e-mail address (786) were invited to participate in an internet-based survey.

Results

The overall response rate was 55% (423 responses); 298 respondents participated in the care of hip fracture patients. Preoperative analgesia was mostly managed with oxycodone and paracetamol; every fifth respondent applied an epidural infusion. Most respondents (98%) employed a spinal block with or without an epidural catheter for intraoperative anesthesia. Midazolam, propofol and/or fentanyl were used for additional sedation. General anesthesia was used rarely. Postoperatively, paracetamol and non-steroidal anti-inflammatory drugs and occasionally peroral oxycodone, were prescribed in addition to epidural analgesia.

Conclusions

The survey suggests that the impact of more individualised analgesia regimens, both preoperatively and postoperatively, should be investigated in further studies.     

Ethical issues in implementation research: a discussion of the problems in achieving informed consent

Background

Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project.

Methods

This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers.

Results

Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers.

Conclusion

Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions.     

Advancing theory development: exploring the leadership–climate relationship as a mechanism of the implementation of cultural competence

Background

Leadership style and specific organizational climates have emerged as critical mechanisms to implement targeted practices in organizations. Drawing from relevant theories, we propose that climate for implementation of cultural competence reflects how transformational leadership may enhance the organizational implementation of culturally responsive practices in health care organizations.

Methods

Using multilevel data from 427 employees embedded in 112 addiction treatment programs collected in 2013, confirmatory factor analysis showed adequate fit statistics for our measure of climate for implementation of cultural competence (Cronbach’s alpha?=?.88) and three outcomes: knowledge (Cronbach’s alpha?=?.88), services (Cronbach’s alpha?=?.86), and personnel (Cronbach’s alpha?=?.86) practices.

Results

Results from multilevel path analyses indicate a positive relationship between employee perceptions of transformational leadership and climate for implementation of cultural competence (standardized indirect effect?=?.057, bootstrap p?<?.001). We also found a positive indirect effect between transformational leadership and each of the culturally competent practices: knowledge (standardized indirect effect?=?.006, bootstrap p?=?.004), services (standardized indirect effect?=?.019, bootstrap p?<?.001), and personnel (standardized indirect effect?=?.014, bootstrap p?=?.005).

Conclusions

Findings contribute to implementation science. They build on leadership theory and offer evidence of the mediating role of climate in the implementation of cultural competence in addiction health service organizations.

     

A WHO-HPH operational program versus usual routines for implementing clinical health promotion: an RCT in health promoting hospitals (HPH)

Background

Implementation of clinical health promotion (CHP) aiming at better health gain is slow despite its effect. CHP focuses on potentially modifiable lifestyle risks such as smoking, alcohol, diet, and physical inactivity. An operational program was created to improve implementation. It included patients, staff, and the organization, and it combined existing standards, indicators, documentation models, a performance recognition process, and a fast-track implementation model.The aim of this study was to evaluate if the operational program improved implementation of CHP in clinical hospital departments, as measured by health status of patients and staff, frequency of CHP service delivery, and standards compliance.

Methods

Forty-eight hospital departments were recruited via open call and stratified by country. Departments were assigned to the operational program (intervention) or usual routine (control group). Data for analyses included 36 of these departments and their 5285 patients (median 147 per department; range 29–201), 2529 staff members (70; 10–393), 1750 medical records (50; 50–50), and standards compliance assessments.Follow-up was measured after 1 year. The outcomes were health status, service delivery, and standards compliance.

Results

No health differences between groups were found, but the intervention group had higher identification of lifestyle risk (81% versus 60%, p?<?0.01), related information/short intervention and intensive intervention (54% versus 39%, p?<?0.01 and 43% versus 25%, p?<?0.01, respectively), and standards compliance (95% versus 80%, p?=?0.02).

Conclusions

The operational program improved implementation by way of lifestyle risk identification, CHP service delivery, and standards compliance. The unknown health effects, the bias, and the limitations should be considered in implementation efforts and further studies.

Trial registration

ClinicalTrials.gov: NCT01563575. Registered 27 March 2012. https://clinicaltrials.gov/ct2/show/NCT01563575

     

ETB receptor polymorphism is associated with airway obstruction

Background

Cardiopulmonary exercise testing (CPET) has become an important modality for the evaluation and management of patients with a diverse array of medical problems. However, interpreting these tests is often difficult and time consuming, requiring significant expertise.

Methods

We created a computer software program (XINT) that assists in CPET interpretation. The program uses an integrative approach as recommended in the Official Statement of the American Thoracic Society/American College of Chest Physicians (ATS/ACCP) on Cardiopulmonary Exercise Testing. In this paper we discuss the principles behind the software. We also provide the detailed logic in an accompanying file (Additional File 1). The actual program and the open source code are also available free over the Internet at http://www.xint.org. For convenience, the required download files can also be accessed from this article.

Results

To test the clinical usefulness of XINT, we present the computer generated interpretations of the case studies discussed in the ATS/ACCP document in another accompanying file (Additional File 2). We believe the interpretations are consistent with the document's criteria and the interpretations given by the expert panel.

Conclusion

Computers have become an integral part of modern life. Peer-reviewed scientific journals are now able to present not just medical concepts and experimental studies, but actual functioning medical interpretive software. This has enormous potential to improve medical diagnoses and patient care. We believe XINT is such a program that will give clinically useful interpretations when used by the medical community at large.     

Improved analysis of bacterial CGH data beyond the log-ratio paradigm

Background

While the theory of enzyme kinetics is fundamental to analyzing and simulating biochemical systems, the derivation of rate equations for complex mechanisms for enzyme-catalyzed reactions is cumbersome and error prone. Therefore, a number of algorithms and related computer programs have been developed to assist in such derivations. Yet although a number of algorithms, programs, and software packages are reported in the literature, one or more significant limitation is associated with each of these tools. Furthermore, none is freely available for download and use by the community.

Results

We have implemented an algorithm based on the schematic method of King and Altman (KA) that employs the topological theory of linear graphs for systematic generation of valid reaction patterns in a GUI-based stand-alone computer program called KAPattern. The underlying algorithm allows for the assumption steady-state, rapid equilibrium-binding, and/or irreversibility for individual steps in catalytic mechanisms. The program can automatically generate MathML and MATLAB output files that users can easily incorporate into simulation programs.

Conclusion

A computer program, called KAPattern, for generating rate equations for complex enzyme system is a freely available and can be accessed at http://www.biocoda.org.     

Absence of carious lesions at margins of glass-ionomer cement and amalgam restorations: An update of systematic review evidence

Background

A recent analysis of protein sequences deposited in the NCBI RefSeq database indicates that ~8.5 million protein sequences are encoded in prokaryotic and eukaryotic genomes, where ~30% are explicitly annotated as "hypothetical" or "uncharacterized" protein. Our Comparison of Protein Active-Site Structures (CPASS v.2) database and software compares the sequence and structural characteristics of experimentally determined ligand binding sites to infer a functional relationship in the absence of global sequence or structure similarity. CPASS is an important component of our Functional Annotation Screening Technology by NMR (FAST-NMR) protocol and has been successfully applied to aid the annotation of a number of proteins of unknown function.

Findings

We report a major upgrade to our CPASS software and database that significantly improves its broad utility. CPASS v.2 is designed with a layered architecture to increase flexibility and portability that also enables job distribution over the Open Science Grid (OSG) to increase speed. Similarly, the CPASS interface was enhanced to provide more user flexibility in submitting a CPASS query. CPASS v.2 now allows for both automatic and manual definition of ligand-binding sites and permits pair-wise, one versus all, one versus list, or list versus list comparisons. Solvent accessible surface area, ligand root-mean square difference, and Cβ distances have been incorporated into the CPASS similarity function to improve the quality of the results. The CPASS database has also been updated.

Conclusions

CPASS v.2 is more than an order of magnitude faster than the original implementation, and allows for multiple simultaneous job submissions. Similarly, the CPASS database of ligand-defined binding sites has increased in size by ~ 38%, dramatically increasing the likelihood of a positive search result. The modification to the CPASS similarity function is effective in reducing CPASS similarity scores for false positives by ~30%, while leaving true positives unaffected. Importantly, receiver operating characteristics (ROC) curves demonstrate the high correlation between CPASS similarity scores and an accurate functional assignment. As indicated by distribution curves, scores ≥ 30% infer a functional similarity. Software URL: http://cpass.unl.edu.     

Temporal bone bank: complying with European union directives on human tissue and cells

Background

Availability of allograft tympano-ossicular systems (ATOS) provides unique reconstructive capabilities, allowing more radical removal of middle ear pathology. To provide ATOS, the University of Antwerp Temporal Bone Bank (UATB) was established in 1988. ATOS use was stopped in many countries because of safety issues concerning human tissue transplantation. Our objective was to maintain an ATOS tissue bank complying with European Union (EU) directives on human tissues and cells.

Methods

The guidelines of the Belgian Superior Health Council, including EU directive requirements, were rigorously applied to UATB infrastructure, workflow protocols and activity. Workflow protocols were updated and an internal audit was performed to check and improve consistency with established quality systems and changing legislations. The Belgian Federal Agency of Medicines and Health Products performed an inspection to examine compliance with national legislatives and EU directives on human tissues and cells. A sample of important procedures was meticulously examined in its workflow setting next to assessment of the infrastructure and personnel.

Results

Results are reported on infrastructure, personnel, administrative workflow, procurement, preparation, processing, distribution, internal audit and inspection by the competent authority. Donors procured: 2006, 93 (45.1%); 2007, 64 (20.6%); 2008, 56 (13.1%); 2009, 79 (6.9%). The UATB was approved by the Minister of Health without critical or important shortcomings. The Ministry accords registration each time for 2?years.

Conclusions

An ATOS tissue bank complying with EU regulations on human allografts is feasible and critical to assure that the patient receives tissue, which is safe, individually checked and prepared in a suitable environment.     

Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration

Background

Facilitation has been identified in the literature as a potentially key component of successful implementation. It has not, however, either been well-defined or well-studied. Significant questions remain about the operational definition of facilitation and about the relationship of facilitation to other interventions, especially to other change agent roles when used in multi-faceted implementation projects. Researchers who are part of the Quality Enhancement Research Initiative (QUERI) are actively exploring various approaches and processes, including facilitation, to enable implementation of best practices in the Veterans Health Administration health care system – the largest integrated healthcare system in the United States. This paper describes a systematic, retrospective evaluation of implementation-related facilitation experiences within QUERI, a quality improvement program developed by the US Department of Veterans Affairs.

Methods

A post-hoc evaluation was conducted through a series of semi-structured interviews to examine the concept of facilitation across several multi-site QUERI implementation studies. The interview process is based on a technique developed in the field of education, which systematically enhances learning through experience by stimulating recall and reflection regarding past complex activities. An iterative content analysis approach relative to a set of conceptually-based interview questions was used for data analysis.

Findings

Findings suggest that facilitation, within an implementation study initiated by a central change agency, is a deliberate and valued process of interactive problem solving and support that occurs in the context of a recognized need for improvement and a supportive interpersonal relationship. Facilitation was described primarily as a distinct role with a number of potentially crucial behaviors and activities. Data further suggest that external facilitators were likely to use or integrate other implementation interventions, while performing this problem-solving and supportive role.

Preliminary Conclusions

This evaluation provides evidence to suggest that facilitation could be considered a distinct implementation intervention, just as audit and feedback, educational outreach, or similar methods are considered to be discrete interventions. As such, facilitation should be well-defined and explicitly evaluated for its perceived usefulness within multi-intervention implementation projects. Additionally, researchers should better define the specific contribution of facilitation to the success of implementation in different types of projects, different types of sites, and with evidence and innovations of varying levels of strength and complexity.