Evaluation of clinical practice guidelines.

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed.     

Translating guidelines into practice: a systematic review of theoretic concepts,practical experience and research evidence in the adoption of clinical practice guidelines

OBJECTIVE: To recommend effective strategies for implementing clinical practice guidelines (CPGs). DATA SOURCES: The Research and Development Resource Base in Continuing Medical Education, maintained by the University of Toronto, was searched, as was MEDLINE from January 1990 to June 1996, inclusive, with the use of the MeSH heading "practice guidelines" and relevant text words. STUDY SELECTION: Studies of CPG implementation strategies and reviews of such studies were selected. Randomized controlled trials and trials that objectively measured physicians'' performance or health care outcomes were emphasized. DATA EXTRACTION: Articles were reviewed to determine the effect of various factors on the adoption of guidelines. DATA SYNTHESIS: The articles showed that CPG dissemination or implementation processes have mixed results. Variables that affect the adoption of guidelines include qualities of the guidelines, characteristics of the health care professional, characteristics of the practice setting, incentives, regulation and patient factors. Specific strategies fell into 2 categories: primary strategies involving mailing or publication of the actual guidelines and secondary interventional strategies to reinforce the guidelines. The interventions were shown to be weak (didactic, traditional continuing medical education and mailings), moderately effective (audit and feedback, especially concurrent, targeted to specific providers and delivered by peers or opinion leaders) and relatively strong (reminder systems, academic detailing and multiple interventions). CONCLUSIONS: The evidence shows serious deficiencies in the adoption of CPGs in practice. Future implementation strategies must overcome this failure through an understanding of the forces and variables influencing practice and through the use of methods that are practice- and community-based rather than didactic.     

Drugs derived from phage display: From candidate identification to clinical practice

Phage display, one of today’s fundamental drug discovery technologies, allows identification of a broad range of biological drugs, including peptides, antibodies and other proteins, with the ability to tailor critical characteristics such as potency, specificity and cross-species binding. Further, unlike in vivo technologies, generating phage display-derived antibodies is not restricted by immunological tolerance. Although more than 20 phage display-derived antibody and peptides are currently in late-stage clinical trials or approved, there is little literature addressing the specific challenges and successes in the clinical development of phage-derived drugs. This review uses case studies, from candidate identification through clinical development, to illustrate the utility of phage display as a drug discovery tool, and offers a perspective for future developments of phage display technology.     

CXCL8 in thyroid disease: From basic notions to potential applications in clinical practice

CXCL8 was the first chemokine shown to be secreted by thyrocytes. Experimental data suggest that CXCL8 plays a role in thyroid homeostasis but its role in thyroid diseases remains poorly investigated. Clinical studies measuring the serum levels of CXCL8 in patients with autoimmune-thyroid-diseases reported conflicting results. Solid evidences support a role of CXCL8 as a tumor-promoting agent in several human cancers. Studies in thyroid cancer are still in their initial stage, but promising. Several evidences indicate that thyroid cancer may share with other human malignancies some of the effects of CXCL8 and highlight the possibility of using CXCL8 as a marker of aggressiveness. Basic and clinical evidences in favor or against a role for CXCL8 in thyroid diseases are discussed.     

Variability in adherence to clinical practice guidelines and recommendations in COPD outpatients: a multi-level,cross-sectional analysis of the EPOCONSUL study

Background

Clinical audits have reported considerable variability in COPD medical care and frequent inconsistencies with recommendations. The objectives of this study were to identify factors associated with a better adherence to clinical practice guidelines and to explore determinants of this variability at the the hospital level.

Methods

EPOCONSUL is a Spanish nationwide clinical audit that evaluates the outpatient management of COPD. Multilevel logistic regression with two levels was performed to assess the relationships between individual and disease-related factors, as well as hospital characteristics.

Results

A total of 4508 clinical records of COPD patients from 59 Spanish hospitals were evaluated. High variability was observed among hospitals in terms of medical care. Some of the patient’s characteristics (airflow obstruction, degree of dyspnea, exacerbation risk, presence of comorbidities), the hospital factors (size and respiratory nurses available) and treatment at a specialized COPD outpatient clinic were identified as factors associated with a better adherence to recommendations, although this only explains a small proportion of the total variance.

Conclusion

To be treated at a specialized COPD outpatient clinic and some intrinsic patient characteristics were factors associated with a better adherence to guideline recommendations, although these variables were only explaining part of the high variability observed among hospitals in terms of COPD medical care.

     

A critical appraisal of clinical practice guidelines for the treatment of lower-limb osteoarthritis

Clinical practice guidelines are important tools to assist clinical decision-making. Recently, several guidelines addressing the management of osteoarthritis (OA) have been published. Clinicians treating patients with OA must ensure that these guidelines are developed with consistency and methodological rigour. We undertook a qualitative summary and critical appraisal of six medical treatment guidelines for the management of lower-limb OA published in the medical literature within the past 5 years. A review of these six guidelines revealed that each possesses strengths and weakness. While most described the scope and intended patient populations, the guidelines varied considerably in the rigour of their development, coverage of implementation issues, and disclosure of conflicts of interest.     

A critical appraisal of clinical practice guidelines for the treatment of lower-limb osteoarthritis

Clinical practice guidelines are important tools to assist clinical decision-making. Recently, several guidelines addressing the management of osteoarthritis (OA) have been published. Clinicians treating patients with OA must ensure that these guidelines are developed with consistency and methodological rigour. We undertook a qualitative summary and critical appraisal of six medical treatment guidelines for the management of lower-limb OA published in the medical literature within the past 5 years. A review of these six guidelines revealed that each possesses strengths and weakness. While most described the scope and intended patient populations, the guidelines varied considerably in the rigour of their development, coverage of implementation issues, and disclosure of conflicts of interest.     

The power of local autonomy: expanding health care to unauthorized immigrants in San Francisco

Abstract

I analyse the mechanisms through which an inclusive local policy environment in the integrated city-county of San Francisco operates to improve unauthorized immigrants’ access to and utilization of health care. Within – but not outside – the bounds of this inclusive local context, committed providers reported being able to provide attention to unauthorized immigrants without worrying about the direct costs of doing so; to buffer, marshal resources, and advocate for individual unauthorized patients; and to exert substantial autonomy in deciding how to approach lack of legal status in their patient–provider interactions. These results highlight the potential and limitation of sub-national policies seeking to ameliorate unauthorized immigrants’ health vulnerability in a hostile US federal context.     

Choosing the best: against paternalistic practice guidelines

Isobel Ross rightly points out that providing information is not enough to guarantee that patients will choose the best course of action. She argues that to adequately protect patients' interests, we need practice guidelines to 'ensure that dangerous and unnecessarily risky procedures are excluded from practice'. What constitutes an 'unnecessarily risky procedure' is to be determined by a group of reasonable doctors. At one point, Ross suggests that such guidelines are 'presumptive' rather than 'absolute'. But this is really a concession to patient variability. She intends that certain procedures are ruled out on paternalistic grounds.
I will argue that practice guidelines are desirable but should not determine practice. We should not rule out procedures on paternalistic grounds.     

Developing a theory-based instrument to assess the impact of continuing professional development activities on clinical practice: a study protocol

Background

Continuing professional development (CPD) is one of the principal means by which health professionals (i.e. primary care physicians and specialists) maintain, improve, and broaden the knowledge and skills required for optimal patient care and safety. However, the lack of a widely accepted instrument to assess the impact of CPD activities on clinical practice thwarts researchers' comparisons of the effectiveness of CPD activities. Using an integrated model for the study of healthcare professionals' behaviour, our objective is to develop a theory-based, valid, reliable global instrument to assess the impact of accredited CPD activities on clinical practice.

Methods

Phase 1: We will analyze the instruments identified in a systematic review of factors influencing health professionals' behaviours using criteria that reflect the literature on measurement development and CPD decision makers' priorities. The outcome of this phase will be an inventory of instruments based on social cognitive theories. Phase 2: Working from this inventory, the most relevant instruments and their related items for assessing the concepts listed in the integrated model will be selected. Through an e-Delphi process, we will verify whether these instruments are acceptable, what aspects need revision, and whether important items are missing and should be added. The outcome of this phase will be a new global instrument integrating the most relevant tools to fit our integrated model of healthcare professionals' behaviour. Phase 3: Two data collections are planned: (1) a test-retest of the new instrument, including item analysis, to assess its reliability and (2) a study using the instrument before and after CPD activities with a randomly selected control group to explore the instrument's mere-measurement effect. Phase 4: We will conduct individual interviews and focus groups with key stakeholders to identify anticipated barriers and enablers for implementing the new instrument in CPD practice. Phase 5: Drawing on the results from the previous phases, we will use consensus-building methods to develop with the decision makers a plan to implement the new instrument.

Discussion

This project proposes to give stakeholders a theory-based global instrument to validly and reliably measure the impacts of CPD activities on clinical practice, thus laying the groundwork for more targeted and effective knowledge-translation interventions in the future.

     

The effects of clinical practice guidelines on patient outcomes in primary care: a systematic review

OBJECTIVE: To assess the evidence for the effectiveness of clinical practice guidelines (CPGs) in improving patient outcomes in primary care. DATA SOURCES: A search of the MEDLINE, HEALTHPLAN, CINAHL and FAMLI databases was conducted to identify studies published between Jan. 1, 1980, and Dec. 31, 1995, concerning the use of guidelines in primary medical care. The keywords used in the search were "clinical guidelines," "primary care," "clinical care," "intervention," "randomized controlled trial" and "effectiveness." STUDY SELECTION: Studies of the use of CPGs were selected if they involved a randomized experimental or quasi-experimental method, concerned primary care, were related to clinical care and examined patient outcomes. Of 91 trials of CPGs identified through the search, 13 met the criteria for inclusion in the critical appraisal. DATA EXTRACTION: The following data were extracted, when possible, from the 13 trials: country and setting, number of physicians, number of patients (and the proportion followed to completion), length of follow-up, study method (including random assignment method), type of intervention, medical condition treated and effect on patient outcomes (including clinical and statistical significance, with confidence intervals). DATA SYNTHESIS: The most common conditions studied were hypertension (7 studies), asthma (2 studies) and cigarette smoking (2 studies). Four of the studies followed nationally developed guidelines, and 9 used locally developed guidelines. Six studies involved computerized or automated reminder systems, whereas the others relied on small-group workshops and education sessions. Only 5 of the 13 trials (38%) produced statistically significant results. CONCLUSION: There is very little evidence that the use of CPGs improves patient outcomes in primary medical care, but most studies published to date have used older guidelines and methods, which may have been insensitive to small changes in outcomes. Research is needed to determine whether the newer, evidence-based CPGs have an effect on patient outcomes.