Applying modern measurement approaches to constructs relevant to evidence-based practice among Canadian physical and occupational therapists

Background

Evidence-based practice (EBP) is a complex process. To quantify it, one has to also consider individual and contextual factors using multiple measures. Modern measurement approaches are available to optimize the measurement of complex constructs. This study aimed to develop a robust measurement approach for constructs around EBP including practice, individual (e.g. knowledge, attitudes, confidence, behaviours), and contextual factors (e.g. resources).

Methods

One hundred eighty-one items arising from 5 validated EBP measures were subjected to an item analysis. Nominal group technique was used to arrive at a consensus about the content relevance of each item. Baseline questionnaire responses from a longitudinal study of the evolution of EBP in 128 new graduates of Canadian physical and occupational therapy programmes were analysed. Principles of Rasch Measurement Theory were applied to identify challenges with threshold ordering, item and person fit to the Rasch model, unidimensionality, local independence, and differential item functioning (DIF).

Results

The nominal group technique identified 70/181 items, and modified Delphi approach identified 68 items that fit a formative model (2 related EBP domains: self-use of EBP (9 items) and EBP activities (7 items)) or a reflective model (4 related EBP domains: attitudes towards EBP (17 items), self-efficacy (9 items), knowledge (11 items) and resources (15 items)). Rasch analysis provided a single score for reflective construct. Among attitudes items, 65% (11/17) fit the Rasch model, item difficulties ranged from ??7.51 to logits (least difficult) to +?5.04 logits (most difficult), and person separation index (PSI)?=?0.63. Among self-efficacy items, 89% (8/9) fit the Rasch model, item difficulties ranged from ??3.70 to +?4.91, and PSI?=?0.80. Among knowledge items, 82% (9/11) fit the Rasch model, item difficulties ranged from ??7.85 to 4.50, and PSI?=?0.81. Among resources items, 87% (13/15) fit the Rasch model, item difficulties ranged from ??3.38 to 2.86, and PSI?=?0.86. DIF occurred in 2 constructs: attitudes (1 by profession and 2 by language) and knowledge (1 by language and 2 by profession) arising from poor wording in the original version leading to poor translation.

Conclusions

Rasch Measurement Theory was applied to develop a valid and reliable measure of EBP. Further modifications to the items can be done for subsequent waves of the survey.

     

Improving guideline adherence for cardiac rehabilitation in the Netherlands

Background

In 2004, the Netherlands Society of Cardiology released the current guideline on cardiac rehabilitation. Given its complexity and the involvement of various healthcare disciplines, it was supplemented with a clinical algorithm, serving to facilitate its implementation in daily practice. Although the algorithm was shown to be effective for improving guideline adherence, several shortcomings and deficiencies were revealed. Based on these findings, the clinical algorithm has now been updated. This article describes the process and the changes that were made.

Methods

The revision consisted of three phases. First, the reliability of the measurement instruments included in the 2004 Clinical Algorithm was investigated by evaluating between-centre variations of the baseline assessment data. Second, based on the available evidence, a multidisciplinary expert advisory panel selected items needing revision and provided specific recommendations. Third, a guideline development group decided which revisions were finally included, also taking practical considerations into account.

Results

A total of nine items were revised: three because of new scientific insights and six because of the need for more objective measurement instruments. In all revised items, subjective assessment methods were replaced by more objective assessment tools (e.g. symptom-limited exercise instead of clinical judgement). In addition, four new key items were added: screening for anxiety/depression, stress, cardiovascular risk profile and alcohol consumption.

Conclusion

Based on previously determined shortcomings, the Clinical Algorithm for Cardiac Rehabilitation was thoroughly revised mainly by incorporating more objective assessment methods and by adding several new key areas.     

Institutionalizing evidence-based practice: an organizational case study using a model of strategic change

Background

There is a general expectation within healthcare that organizations should use evidence-based practice (EBP) as an approach to improving the quality of care. However, challenges exist regarding how to make EBP a reality, particularly at an organizational level and as a routine, sustained aspect of professional practice.

Methods

A mixed method explanatory case study was conducted to study context; i.e., in terms of the presence or absence of multiple, inter-related contextual elements and associated strategic approaches required for integrated, routine use of EBP ('institutionalization'). The Pettigrew et al. Content, Context, and Process model was used as the theoretical framework. Two sites in the US were purposively sampled to provide contrasting cases: i.e., a 'role model' site, widely recognized as demonstrating capacity to successfully implement and sustain EBP to a greater degree than others; and a 'beginner' site, self-perceived as early in the journey towards institutionalization.

Results

The two sites were clearly different in terms of their organizational context, level of EBP activity, and degree of institutionalization. For example, the role model site had a pervasive, integrated presence of EBP versus a sporadic, isolated presence in the beginner site. Within the inner context of the role model site, there was also a combination of the Pettigrew and colleagues' receptive elements that, together, appeared to enhance its ability to effectively implement EBP-related change at multiple levels. In contrast, the beginner site, which had been involved for a few years in EBP-related efforts, had primarily non-receptive conditions in several contextual elements and a fairly low overall level of EBP receptivity. The beginner site thus appeared, at the time of data collection, to lack an integrated context to either support or facilitate the institutionalization of EBP.

Conclusion

Our findings provide evidence of some of the key contextual elements that may require attention if institutionalization of EBP is to be realized. They also suggest the need for an integrated set of receptive contextual elements to achieve EBP institutionalization; and they further support the importance of specific interactions among these elements, including ways in which leadership affects other contextual elements positively or negatively.     

Tailored Implementation of Evidence-Based Practice for Patients with Chronic Diseases

Background

When designing interventions and policies to implement evidence based healthcare, tailoring strategies to the targeted individuals and organizations has been recommended. We aimed to gather insights into the ideas of a variety of people for implementing evidence-based practice for patients with chronic diseases, which were generated in five European countries.

Methods

A qualitative study in five countries (Germany, Netherlands, Norway, Poland, United Kingdom) was done, involving overall 115 individuals. A purposeful sample of four categories of stakeholders (healthcare professionals, quality improvement officers, healthcare purchasers and authorities, and health researchers) was involved in group interviews in each of the countries to generate items for improving healthcare in different chronic conditions per country: chronic obstructive pulmonary disease, cardiovascular disease, depression in elderly people, multi-morbidity, obesity. A disease-specific standardized list of determinants of practice in these conditions provided the starting point for these groups. The content of the suggested items was categorized in a pre-defined framework of 7 domains and specific themes in the items were identified within each domain.

Results

The 115 individuals involved in the study generated 812 items, of which 586 addressed determinants of practice. These largely mapped onto three domains: individual health professional factors, patient factors, and professional interactions. Few items addressed guideline factors, incentives and resources, capacity of organizational change, or social, political and legal factors. The relative numbers of items in the different domains were largely similar across stakeholder categories within each of the countries. The analysis identified 29 specific themes in the suggested items across countries.

Conclusion

The type of suggestions for improving healthcare practice was largely similar across different stakeholder groups, mainly addressing healthcare professionals, patient factors and professional interactions. As this study is one of the first of its kind, it is important that more research is done on tailored implementation strategies.     

Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care

Background

The implementation of new medical knowledge into general practice is a complex process. Blended learning may offer an effective and efficient educational intervention to reduce the knowledge-to-practice gap. The aim of this study was to compare knowledge acquisition about dementia management between a blended learning approach using online modules in addition to quality circles (QCs) and QCs alone.

Methods

In this cluster-randomised trial with QCs as clusters and general practitioners (GPs) as participants, 389 GPs from 26 QCs in the western part of Germany were invited to participate. Data on the GPs' knowledge were obtained at three points in time by means of a questionnaire survey. Primary outcome was the knowledge gain before and after the interventions. A subgroup analysis of the users of the online modules was performed.

Results

166 GPs were available for analysis and filled out a knowledge test at least two times. A significant increase of knowledge was found in both groups that indicated positive learning effects of both approaches. However, there was no significant difference between the groups. A subgroup analysis of the GPs who self-reported that they had actually used the online modules showed that they had a significant increase in their knowledge scores.

Conclusion

A blended learning approach was not superior to a QCs approach for improving knowledge about dementia management. However, a subgroup of GPs who were motivated to actually use the online modules had a gain in knowledge.

Trial registration

Current Controlled Trials ISRCTN36550981.     

Genome-scale identification of Caenorhabditis elegans regulatory elements by tiling-array mapping of DNase I hypersensitive sites

Background

High throughput techniques have generated a huge set of biological data, which are deposited in various databases. Efficient exploitation of these databases is often hampered by a lack of appropriate tools, which allow easy and reliable identification of genes that miss functional characterization but are correlated with specific biological conditions (e.g. organotypic expression).

Results

We have developed a simple algorithm (DGSA = Database-dependent Gene Selection and Analysis) to identify genes with unknown functions involved in organ development concentrating on the heart. Using our approach, we identified a large number of yet uncharacterized genes, which are expressed during heart development. An initial functional characterization of genes by loss-of-function analysis employing morpholino injections into zebrafish embryos disclosed severe developmental defects indicating a decisive function of selected genes for developmental processes.

Conclusion

We conclude that DGSA is a versatile tool for database mining allowing efficient selection of uncharacterized genes for functional analysis.     

FPGA accelerator for protein secondary structure prediction based on the GOR algorithm

Background

Orthology analysis is an important part of data analysis in many areas of bioinformatics such as comparative genomics and molecular phylogenetics. The ever-increasing flood of sequence data, and hence the rapidly increasing number of genomes that can be compared simultaneously, calls for efficient software tools as brute-force approaches with quadratic memory requirements become infeasible in practise. The rapid pace at which new data become available, furthermore, makes it desirable to compute genome-wide orthology relations for a given dataset rather than relying on relations listed in databases.

Results

The program Proteinortho described here is a stand-alone tool that is geared towards large datasets and makes use of distributed computing techniques when run on multi-core hardware. It implements an extended version of the reciprocal best alignment heuristic. We apply Proteinortho to compute orthologous proteins in the complete set of all 717 eubacterial genomes available at NCBI at the beginning of 2009. We identified thirty proteins present in 99% of all bacterial proteomes.

Conclusions

Proteinortho significantly reduces the required amount of memory for orthology analysis compared to existing tools, allowing such computations to be performed on off-the-shelf hardware.     

Activation of nuclear factor kappa B (NF-κB) by connective tissue growth factor (CCN2) is involved in sustaining the survival of primary rat hepatic stellate cells

Background

Secreted Frizzled related proteins (SFRPs) are extracellular regulators of Wnt signaling. These proteins contain an N-terminal cysteine rich domain (CRD) highly similar to the CRDs of the Frizzled family of seven-transmembrane proteins that act as Wnt receptors. SFRPs can bind to Wnts and prevent their interaction with the Frizzled receptor. Recently it has been reported that a splice variant of human Frizzled-4 (FZD4S) lacking the transmembrane and the cytoplasmic domains of Frizzled-4 can activate rather than inhibit Wnt-8 activity in Xenopus embryos. This indicates that secreted CRD containing proteins such as Frizzled ecto-domains and SFRPs may not always act as Wnt inhibitors. It is not known how FZD4S can activate Wnt/β-catenin signaling and what biological role this molecule plays in vivo.

Results

Here we report that the Xenopus frizzled-4 is alternatively spliced to give rise to a putative secreted protein that lacks the seven-transmembrane and the cytoplasmic domains. We performed functional experiments in Xenopus embryos to investigate how this novel splicing variant, Xfz4S, can modulate the Wnt/β-catenin pathway. We show that Xfz4S as well as the extracellular domain of Xfz8 (ECD8) can act as both activators and inhibitors of Wnt/β-catenin signaling dependent on the Wnt ligand presented. The positive regulation of Wnt/β-catenin signaling by the extracellular domains of Frizzled receptors is mediated by the members of low density lipoprotein receptor-related protein (LRP-5/6) that act as Wnt coreceptors.

Conclusion

This work provides evidence that the secreted extracellular domains of Frizzled receptors may act as both inhibitors and activators of Wnt signaling dependent on the Wnt ligand presented.     

Feedback reporting of survey data to healthcare aides

Background

Modifying the format and content of guidelines may facilitate their use and lead to improved quality of care. We reviewed the medical literature to identify features desired by different users and associated with guideline use to develop a framework of implementability and found that most guidelines do not contain these elements. Further research is needed to develop and evaluate implementability tools.

Methods

We are launching the Guideline Implementability Research and Application Network (GIRAnet) to enable the development and testing of implementability tools in three domains: Resource Implications, Implementation, and Evaluation. Partners include the Guidelines International Network (G-I-N) and its member guideline developers, implementers, and researchers. In phase one, international guidelines will be examined to identify and describe exemplar tools. Indication-specific and generic tools will populate a searchable repository. In phase two, qualitative analysis of cognitive interviews will be used to understand how developers can best integrate implementability tools in guidelines and how health professionals use them for interpreting and applying guidelines. In phase three, a small-scale pilot test will assess the impact of implementability tools based on quantitative analysis of chart-based behavioural outcomes and qualitative analysis of interviews with participants. The findings will be used to plan a more comprehensive future evaluation of implementability tools.

Discussion

Infrastructure funding to establish GIRAnet will be leveraged with the in-kind contributions of collaborating national and international guideline developers to advance our knowledge of implementation practice and science. Needs assessment and evaluation of GIRAnet will provide a greater understanding of how to develop and sustain such knowledge-exchange networks. Ultimately, by facilitating use of guidelines, this research may lead to improved delivery and outcomes of patient care.     

Insights into the impact and use of research results in a residential long-term care facility: a case study

Background

Quality improvement collaboratives (QICs) bring together groups of healthcare professionals to work in a structured manner to improve the quality of healthcare delivery within particular domains. We explored which characteristics of the composition, participation, functioning, and organization of these collaboratives related to changes in the healthcare for patients with anxiety disorders, dual diagnosis, or schizophrenia.

Methods

We studied three QICs involving 29 quality improvement (QI) teams representing a number of mental healthcare organizations in the Netherlands. The aims of the three QICs were the implementation of multidisciplinary practice guidelines in the domains of anxiety disorders, dual diagnosis, and schizophrenia, respectively. We used eight performance indicators to assess the impact of the QI teams on self-reported patient outcomes and process of care outcomes for 1,346 patients. The QI team members completed a questionnaire on the characteristics of the composition, participation in a national program, functioning, and organizational context for their teams. It was expected that an association would be found between these team characteristics and the quality of care for patients with anxiety disorders, dual diagnosis, and schizophrenia.

Results

No consistent patterns of association emerged. Theory-based factors did not perform better than practice-based factors. However, QI teams that received support from their management and both active and inspirational team leadership showed better results. Rather surprisingly, a lower average level of education among the team members was associated with better results, although less consistently than the management and leadership characteristics. Team views with regard to the QI goals of the team and attitudes towards multidisciplinary practice guidelines did not correlate with team success.

Conclusions

No general conclusions about the impact of the characteristics of QI teams on the quality of healthcare can be drawn, but support of the management and active, inspirational team leadership appear to be important. Not only patient outcomes but also the performance indicators of monitoring and screening/assessment showed improvement in many but not all of the QI teams with such characteristics. More studies are needed to identify factors associated with the impact of multidisciplinary practice guidelines in mental healthcare.     

A pragmatic cluster randomised trial evaluating three implementation interventions

Background

One of the most consistent findings from clinical and health services research is the failure to translate research into practice and policy. As a result of these evidence-practice and policy gaps, patients fail to benefit optimally from advances in healthcare and are exposed to unnecessary risks of iatrogenic harms, and healthcare systems are exposed to unnecessary expenditure resulting in significant opportunity costs. Over the last decade, there has been increasing international policy and research attention on how to reduce the evidence-practice and policy gap. In this paper, we summarise the current concepts and evidence to guide knowledge translation activities, defined as T2 research (the translation of new clinical knowledge into improved health). We structure the article around five key questions: what should be transferred; to whom should research knowledge be transferred; by whom should research knowledge be transferred; how should research knowledge be transferred; and, with what effect should research knowledge be transferred?

Discussion

We suggest that the basic unit of knowledge translation should usually be up-to-date systematic reviews or other syntheses of research findings. Knowledge translators need to identify the key messages for different target audiences and to fashion these in language and knowledge translation products that are easily assimilated by different audiences. The relative importance of knowledge translation to different target audiences will vary by the type of research and appropriate endpoints of knowledge translation may vary across different stakeholder groups. There are a large number of planned knowledge translation models, derived from different disciplinary, contextual (i.e., setting), and target audience viewpoints. Most of these suggest that planned knowledge translation for healthcare professionals and consumers is more likely to be successful if the choice of knowledge translation strategy is informed by an assessment of the likely barriers and facilitators. Although our evidence on the likely effectiveness of different strategies to overcome specific barriers remains incomplete, there is a range of informative systematic reviews of interventions aimed at healthcare professionals and consumers (i.e., patients, family members, and informal carers) and of factors important to research use by policy makers.

Summary

There is a substantial (if incomplete) evidence base to guide choice of knowledge translation activities targeting healthcare professionals and consumers. The evidence base on the effects of different knowledge translation approaches targeting healthcare policy makers and senior managers is much weaker but there are a profusion of innovative approaches that warrant further evaluation.     

Creating a knowledge translation trainee collaborative: from conceptualization to lessons learned in the first year

Background

Patient involvement in healthcare represents the means by which to achieve a healthcare system that is responsive to patient needs and values. Characterization and evaluation of strategies for involving patients in their healthcare may benefit from a knowledge translation (KT) approach. The purpose of this knowledge synthesis is to develop a conceptual framework for patient-mediated KT interventions.

Methods

A preliminary conceptual framework for patient-mediated KT interventions was compiled to describe intended purpose, recipients, delivery context, intervention, and outcomes. A realist review will be conducted in consultation with stakeholders from the arthritis and cancer fields to explore how these interventions work, for whom, and in what contexts. To identify patient-mediated KT interventions in these fields, we will search MEDLINE, the Cochrane Library, and EMBASE from 1995 to 2010; scan references of all eligible studies; and examine five years of tables of contents for journals likely to publish quantitative or qualitative studies that focus on developing, implementing, or evaluating patient-mediated KT interventions. Screening and data collection will be performed independently by two individuals.

Conclusions

The conceptual framework of patient-mediated KT options and outcomes could be used by healthcare providers, managers, educationalists, patient advocates, and policy makers to guide program planning, service delivery, and quality improvement and by us and other researchers to evaluate existing interventions or develop new interventions. By raising awareness of options for involving patients in improving their own care, outcomes based on using a KT approach may lead to greater patient-centred care delivery and improved healthcare outcomes.     

Regulation of Akt expression and phosphorylation by 17β-estradiol in the rat uterus during estrous cycle

Background

Ablation of the low-affinity receptor subunit for leukemia inhibitory factor (LIFR) causes multi-systemic defects in the late gestation fetus. Because corticosterone is known to have a broad range of effects and LIF function has been associated with the hypothalamo-pituitary-adrenal axis, this study was designed to determine the role for LIFR in the fetus when exposed to the elevated maternal glucocorticoid levels of late gestation. Uncovering a requirement for LIFR in appropriate glucocorticoid response will further understanding of control of glucocorticoid function.

Methods

Maternal adrenalectomy or RU486 administration were used to determine the impact of the maternal glucocorticoid surge on fetal development in the absence of LIFR. The mice were analyzed by a variety of histological techniques including immunolabeling and staining techniques (hematoxylin and eosin, Alizarin red S and alcian blue). Plasma corticosterone was assayed using radioimmunoassay.

Results

Maternal adrenalectomy does not improve the prognosis for LIFR null pups and exacerbates the effects of LIFR loss. RU486 noticeably improves many of the tissues affected by LIFR loss: bone density, skeletal muscle integrity and glial cell formation. LIFR null pups exposed during late gestation to RU486 in utero survive natural delivery, unlike LIFR null pups from untreated litters. But RU486 treated LIFR null pups succumb within the first day after birth, presumably due to neural deficit resulting in an inability to suckle.

Conclusion

LIFR plays an integral role in modulating the fetal response to elevated maternal glucocorticoids during late gestation. This role is likely to be mediated through the glucocorticoid receptor and has implications for adult homeostasis as a direct tie between immune, neural and hormone function.     

The MERG Suite: Tools for discovering competencies and associated learning resources

Background

As the demands for competency-based education grow, the need for standards-based tools to allow for publishing and discovery of competency-based learning content is more pressing. This project focused on developing federated discovery services for competency-based medical e-learning content.

Methods

We built a tool suite for authoring and discovery of medical e-learning metadata. The end-user usability of the tool suite was evaluated through a web-based survey.

Results

The suite, implemented as an open-source system, was evaluated to identify areas for improvement.

Conclusion

The MERG suite is a starting point for organizations implementing competency-based e-learning resources.     

Crop and non-crop productivity in a traditional maize agroecosystem of the highland of Mexico

Background

Haitian migrants played an important role shaping Cuban culture and traditional ethnobotanical knowledge. An ethnobotanical investigation was conducted to collect information on medicinal plant use by Haitian immigrants and their descendants in the Province of Camagüey, Cuba.

Methods

Information was obtained from semi-structured interviews with Haitian immigrants and their descendants, direct observations, and by reviewing reports of traditional Haitian medicine in the literature.

Results

Informants reported using 123 plant species belonging to 112 genera in 63 families. Haitian immigrants and their descendants mainly decoct or infuse aerial parts and ingest them, but medicinal baths are also relevant. Some 22 herbal mixtures are reported, including formulas for a preparation obtained using the fruit of Crescentia cujete. Cultural aspects related to traditional plant posology are addressed, as well as changes and adaptation of Haitian medicinal knowledge with emigration and integration over time.

Conclusion

The rapid disappearance of Haitian migrants' traditional culture due to integration and urbanization suggests that unrecorded ethnomedicinal information may be lost forever. Given this, as well as the poor availability of ethnobotanical data relating to traditional Haitian medicine, there is an urgent need to record this knowledge.