Evaluation of Spontaneous Reports of Adverse Reactions to Drugs

An adverse drug-reaction monitoring system based on spontaneous reporting to a central register of adverse reactions has been in operation for eight years. As a test of the validity of the reports and of the probability of causal relationship between drug and reaction a random sample of 82 cases were followed up in detail. The sample included 17 deaths, 26 serious reactions, and 39 reactions of moderate or only minor severity. Altogether 78% of the reactions were considered to be “probably” drug related and 13% “possibly” drug related. It is concluded that the reports are of value in the detection and evaluation of drug safety.     

Reliability and stability of mothers' reports about their pregnancies with twins.

The objective of this study was to determine if mothers' retrospective reports about events in their pregnancies with twins are reliable and stable. Six hundred and twenty-four mothers completed psychiatric interviews about their twins. These interviews also contained questions about the mothers' pregnancies, the perinatal period, and the child's early development. The mothers reported first on one twin and then on the other with interviews spaced from 3 days to 2 weeks apart. Thus mothers reported on the same pregnancy twice. Of these mothers, 47 were re-interviewed 6 to 18 months later by raters blind to the results of the initial interview. The twin design allowed us to compare the short-term reliability of the 624 mothers' reports of the same pregnancy. The re-interview of the 47 mothers enabled us to compare the stability of reports over a longer time period. Agreement between the reports was measured with the kappa statistic. Kappas were good to excellent for the short-term reports of pregnancy for each twin for the 624 mothers. Kappas were equally high for the 47 mothers that were re-interviewed 6 to 18 months later. Mothers show good reliability and stability of reporting about events during pregnancy.     

A UK scheme for reporting serious adverse events and reactions associated with ocular tissue transplantation

Reporting and investigation of serious adverse events and reactions associated with tissue and cell transplantation is a fundamental aspect of ensuring adequate levels of safety and quality and is a requirement of the European Union Directives on tissues and cells. In the UK, a system for the reporting and analysis of events and reactions associated with ocular tissue transplantation is well established. It is operated by a network of individuals and organisations, each with clearly defined roles and responsibilities, following written procedures for reporting and investigation. Analysis of reports indicates that the most important adverse reactions associated with this type of tissue transplantation are endophthalmitis (0.58%) and primary graft failure (0.3%). This system allows the analysis of all types of events and reactions by the professionals involved so that trends can be identified and services improved. Tools to evaluate the severity and imputability of individual events or reactions, such as those developed by the EUSTITE project, can be utilised to facilitate the selection of those cases meeting the criteria for reporting to the Competent Authority. This vigilance model has been shown to be effective and could be applied in other fields of tissue or cell transplantation.     

东莞市预防接种不良反应监测和处理控制系统的建立及评价

为了解东莞市各种疫苗预防接种不良反应的发生情况,建立预防接种不良反应(AEFI)监测和处理控制系统,评价其运行状况,提高预防接种工作质量。根据WHO对AEFI的定义和分类方法,确定了东莞市AEFI报告范围,报告人、报告程序、报告制度以及调查内容和方法,并对该系统2005年收集的AEFI病例进行描述性分析。全市共登记预防接种不良反应560例,其中疫苗反应占了95.36%。男性多于女性。在所使用的26种疫苗中有18种出现不良反应,以Hib和百白破(DPT)的发生率最高,且百白破的报告数最多,占57.5%。在报告的预防接种不良反应中,发热、局部红肿疼痛以及皮疹等过敏性反应占了94.1%。结果认为该系统在评价疫苗的安全性,发现不良反应发生的危险因素,改善预防接种服务质量起着重要作用。     

Drug surveillance data in a Canadian hospital.

Comparison of results of a Canadian hospital-based drug surveillance program with data from centres in the United States and Israel showed no important difference in the rate of drug exposures or adverse reactions. Drugs for symptomatic relief were frequently used in the Canadian centre. Women received more drugs and had more adverse reactions than men. Life-threatening and potentially fatal reactions were caused by commonly used drugs; autopsy findings may detect previously unsuspected relations between drug events and mechanisms of death. Voluntary reporting and intensive monitoring are both important in the field of adverse drug reactions.     

Designing adverse event forms for real-world reporting: participatory research in Uganda

The wide-scale roll-out of artemisinin combination therapies (ACTs) for the treatment of malaria should be accompanied by continued surveillance of their safety. Post-marketing pharmacovigilance (PV) relies on adverse event (AE) reporting by clinicians, but as a large proportion of treatments are provided by non-clinicians in low-resource settings, the effectiveness of such PV systems is limited. To facilitate reporting, AE forms should be easily completed; however, most are challenging for lower-level health workers and non-clinicians to complete. Through participatory research, we sought to develop user-friendly AE report forms to capture information on events associated with ACTs.Following situation analysis, we undertook workshops with community medicine distributors and health workers in Jinja, Uganda, to develop a reporting form based on experiences and needs of users, and communication and visual perception principles. Participants gave feedback for revisions of subsequent versions. We then conducted 8 pretesting sessions with 77 potential end users to test and refine passive and active versions of the form.The development process resulted in a form that included a pictorial storyboard to communicate the rationale for the information needed and facilitate rapport between the reporter and the respondent, and a diary format to record the drug administration and event details in chronological relation to each other. Successive rounds of pretesting used qualitative and quantitative feedback to refine the form, with the final round showing over 80% of the form completed correctly by potential end users.We developed novel AE report forms that can be used by non-clinicians to capture pharmacovigilance data for anti-malarial drugs. The participatory approach was effective for developing forms that are intuitive for reporters, and motivating for respondents. The forms, or their key components, could be adapted for use in other low-literacy settings to improve quality and quantity of drug safety reports as new medicines are scaled-up.     

Validity of anecdotal reports of suspected adverse drug reactions: the problem of false alarms

Suspected adverse drug reactions first reported in 1963 in the “British Medical Journal,” the “Lancet,” the “Journal of the American Medical Association,” and the “New England Journal of Medicine” were reviewed 18 years later to assess their initial validity and subsequent verification. Of 52 first reports, five were deliberate investigations into potential or predictable reactions, and in each case causality was reasonably established; the other 47 reports were essentially anecdotal. Of these 47 reports, 14 related to categories of adverse reaction where false-positive reports were unlikely: immediate reactions, local reactions, and known reactions caused by a different mode of administration or a brand previously thought or claimed to be safe. The problem of false alarms rose in the remaining types of reactions: general reactions that did not occur immediately after administration and arose for the first time with a new chemical entity. Of 33 reports of such suspected adverse reactions, validity was satisfactorily established in 14 cases on the basis of rechallenge, predictability from known pharmacology, or the unique nature of the reaction. Of the remaining 19 reports, further verification still has not been satisfactorily established in 12. Seven of these possible false alarms were haematological reactions.Although 35 of the 47 anecdotal reports were clearly correct, of the 19 reports that were not reasonably validated at the time of the report, only seven were subsequently verified. This suggests that agencies monitoring adverse drug reactions should adopt criteria for assessing the validity of first reports of suspected adverse reactions. Such criteria should include: reactions on rechallenge, a pharmacological basis for the adverse reaction, immediate acute reactions, local reactions at the site of administration, reactions with a new route of administration of a drug known to provoke such reactions by another route, and the repeated occurrence of very rare events.     

Identification by families of pediatric adverse events and near misses overlooked by health care providers

Background:

Identifying adverse events and near misses is essential to improving safety in the health care system. Patients are capable of reliably identifying and reporting adverse events. The effect of a patient safety reporting system used by families of pediatric inpatients on reporting of adverse events by health care providers has not previously been investigated.

Methods:

Between Nov. 1, 2008, and Nov. 30, 2009, families of children discharged from a single ward of British Columbia’s Children’s Hospital were asked to respond to a questionnaire about adverse events and near misses during the hospital stay. Rates of reporting by health care providers for this period were compared with rates for the previous year. Family reports for specific incidents were matched with reports by health care providers to determine overlap.

Results:

A total of 544 familes responded to the questionnaire. The estimated absolute increase in reports by health care providers per 100 admissions was 0.5% (95% confidence interval −1.8% to 2.7%). A total of 321 events were identified in 201 of the 544 family reports. Of these, 153 (48%) were determined to represent legitimate patient safety concerns. Only 8 (2.5%) of the adverse events reported by families were also reported by health care providers.

Interpretation:

The introduction of a family-based system for reporting adverse events involving pediatric inpatients, administered at the time of discharge, did not change rates of reporting of adverse events and near misses by health care providers. Most reports submitted by families were not duplicated in the reporting system for health care providers, which suggests that families and staff members view safety-related events differently. However, almost half of the family reports represented legitimate patient safety concerns. Families appeared capable of providing valuable information for improving the safety of pediatric inpatients.It has been estimated that adverse events occur in about 1% of children treated in hospital and that, on average, 60% of these events are preventable.¹ To increase institutional awareness of adverse events, hospitals have implemented systems to encourage health care providers to report adverse events.² The reporting of adverse events can be improved by making electronic systems for reporting readily accessible³ and by ensuring a “just culture,” which includes nonpunitive reporting policies.⁴ However, adverse events reported by health care providers account for only a small fraction of total adverse events as determined by chart review.⁵ Time pressures to treat patients, fear of punishment, lack of belief in the benefit of reporting and differing opinions of what defines a reportable event contribute to low reporting rates.⁶ However, patients and their families are readily available, keen and motivated observers who may not be subject to these reporting barriers. Family members are capable of observing and reporting adverse events in a variety of clinical settings.⁷ It is known that the interpretation of safety events and the threshold for reporting differ among health care disciplines and individual health care providers.⁶ However, it is not clear how families of pediatric patients interpret safety-related events or what their threshold would be for reporting events.The purpose of this study was to test whether the introduction of an adverse event reporting system for use by families of pediatric patients at the time of discharge from a surgical ward would significantly change the rate of reporting of adverse events by health care providers. We also evaluated the types of events that families reported, the relevance of these events with respect to patient safety, families’ desires for anonymous reporting and families’ assessments of institutional responses to reported events. We anticipated that health care providers’ reporting rates would rise with the introduction of the family reporting system, on the assumption that greater attention would be paid to reporting safety-related events on the ward. We also anticipated that families would provide useful information about safety-related events, at least some of the time. In particular, we thought that facilitating communication from the patient’s family directly to the study institution’s Quality, Safety and Outcome Improvement Department would allow more opportunities to improve safety through changes in practice.     

Examining Agreement between Clinicians when Assessing Sick Children

Background

Case management guidelines use a limited set of clinical features to guide assessment and treatment for common childhood diseases in poor countries. Using video records of clinical signs we assessed agreement among experts and assessed whether Kenyan health workers could identify signs defined by expert consensus.

Methodology

104 videos representing 11 clinical sign categories were presented to experts using a web questionnaire. Proportionate agreement and agreement beyond chance were calculated using kappa and the AC1 statistic. 31 videos were selected and presented to local health workers, 20 for which experts had demonstrated clear agreement and 11 for which experts could not demonstrate agreement.

Principal Findings

Experts reached very high level of chance adjusted agreement for some videos while for a few videos no agreement beyond chance was found. Where experts agreed Kenyan hospital staff of all cadres recognised signs with high mean sensitivity and specificity (sensitivity: 0.897–0.975, specificity: 0.813–0.894); years of experience, gender and hospital had no influence on mean sensitivity or specificity. Local health workers did not agree on videos where experts had low or no agreement. Results of different agreement statistics for multiple observers, the AC1 and Fleiss'' kappa, differ across the range of proportionate agreement.

Conclusion

Videos provide a useful means to test agreement amongst geographically diverse groups of health workers. Kenyan health workers are in agreement with experts where clinical signs are clear-cut supporting the potential value of assessment and management guidelines. However, clinical signs are not always clear-cut. Video recordings offer one means to help standardise interpretation of clinical signs.     

Serious adverse reactions associated with ivermectin: A systematic pharmacovigilance study in sub-Saharan Africa and in the rest of the World

BackgroundIvermectin is known to cause severe encephalopathies in subjects infected with loiasis, an endemic parasite in Sub-Saharan Africa (SSA). In addition, case reports have described ivermectin-related serious adverse drug reactions (sADRs) such as toxidermias, hepatic and renal disorders. The aim of this study was to identify suspected sADRs reported after ivermectin administration in VigiBase, the World Health Organization’s global individual case safety reports database and analyze their frequency relative to the frequency of these events after other antinematodal drugs reported in SSA and other areas of the world (ROW).MethodsAll antinematodal-related sADRs were extracted from VigiBase. Disproportionality analyses were conducted to investigate nervous, cutaneous, psychiatric, respiratory, renal, hepatic and cardiac suspected sADRs reported after ivermectin and benzimidazole drug administration across the world, in SSA and RoW.Principal findings2041 post-ivermectin or post-benzimidazole suspected sADRs were identified including 667 after ivermectin exposure (208 in SSA and 459 in the RoW). We found an increased reporting for toxidermias, encephalopathies, confusional disorders after ivermectin compared to benzimidazole drug administration. Encephalopathies were not only reported from SSA but also from the RoW (adjusted reporting odds ratios [aROR] 6.30, 95% confidence interval: 2.68–14.8), highlighting the fact these types of sADR occur outside loiasis endemic regions.ConclusionWe described for the first time suspected sADRs associated with ivermectin exposure according to geographical origin. While our results do not put in question ivermectin’s excellent safety profile, they show that as for all drugs, appropriate pharmacovigilance for adverse reactions is indicated.     

Valproic Acid and Fatalities in Children: A Review of Individual Case Safety Reports in VigiBase

Introduction

Valproic acid is an effective first line drug for the treatment of epilepsy. Hepatotoxicity is a rare and potentially fatal adverse reaction for this medicine.

Objective

Firstly to characterise valproic acid reports on children with fatal outcome and secondly to determine reporting over time of hepatotoxicity with fatal outcome.

Methods

Individual case safety reports (ICSRs) for children ≤17 years with valproic acid and fatal outcome were retrieved from the WHO Global ICSR database, VigiBase, in June 2013. Reports were classified into hepatotoxic reactions or other reactions. Shrinkage observed-to-expected ratios were used to explore the relative reporting trend over time and for patient age. The frequency of polytherapy, i.e. reports with more than one antiepileptic medicine, was investigated.

Results

There have been 268 ICSRs with valproic acid and fatal outcome in children, reported from 25 countries since 1977. A total of 156 fatalities were reported with hepatotoxicity, which has been continuously and disproportionally reported over time. There were 31 fatalities with pancreatitis. Other frequently reported events were coma/encephalopathy, seizures, respiratory disorders and coagulopathy. Hepatotoxicity was disproportionally and most commonly reported in children aged 6 years and under (104/156 reports) but affected children of all ages. Polytherapy was significantly more frequently reported for valproic acid with fatal outcome (58%) compared with non-fatal outcome (34%).

Conclusion

Hepatotoxicity remains a considerable problem. The risk appears to be greatest in young children (6 years and below) but can occur at any age. Polytherapy is commonly reported and seems to be a risk factor for hepatotoxicity, pancreatitis and other serious adverse drug reactions with valproic acid.     

Drug safety of rosiglitazone and pioglitazone in France: a study using the French PharmacoVigilance database

Background

Spontaneous reporting of adverse drug reactions (ADRs) is an important method for pharmacovigilance, but under-reporting and poor quality of reports are major limitations. The aim of this study was to evaluate if repeated one-page ADR information letters affect (i) the reporting rate of ADRs and (ii) the quality of the ADR reports.

Methods

All 151 primary healthcare units in the Region Västra Götaland, Sweden, were randomly allocated (1:1) to an intervention (n = 77) or a control group (n = 74). The intervention consisted of one-page ADR information letters administered at three occasions during 2008 to all physicians and nurses in the intervention units. The number of ADR reports received from the 151 units was registered, as was the quality of the reports, which was defined as high if the ADR was to be reported according to Swedish regulations, that is, if the ADR was (i) serious, (ii) unexpected, and/or (iii) related to the use of new drugs and not labelled as common in the Summary of Product Characteristics. A questionnaire was administered to evaluate if the ADR information letter had reached the intended recipient.

Results

Before the intervention, no significant differences in reporting rate or number of high quality reports could be detected between the randomization groups. In 2008, 79 reports were sent from 37 intervention units and 52 reports from 30 control units (mean number of reports per unit ± standard deviation: 1.0 ± 2.5 vs. 0.7 ± 1.2, P = 0.34). The number of high quality reports was higher in intervention units than in control units (37 vs. 15 reports, 0.5 ± 0.9 vs. 0.2 ± 0.6, P = 0.048). According to the returned questionnaires (n = 1,292, response rate 57%), more persons in the intervention than in the control group had received (29% vs. 19%, P < 0.0001) and read (31% vs. 26%, P < 0.0001) an ADR information letter.

Conclusions

This study suggests that repeated ADR information letters to physicians and nurses do not increase the ADR reporting rate, but may increase the number of high quality reports.     

Interlaboratory reproducibility of atypical squamous cells of undetermined significance report: a national survey

The study was aimed at assessing interlaboratory reproducibility in the reporting of cervical smears in the atypical squamous cells of undetermined significance (ASCUS) category. A set of 50 selected slides circulated among 89 laboratories, currently involved in population-based screening programmes for cervical cancer, which provided a diagnostic report according to four main reporting categories based on the 1991 Bethesda system. Interlaboratory agreement was determined according to kappa (K) statistics: overall and weighted K values were determined for each laboratory and for single reporting categories. The results showed a very low reproducibility for the ASCUS category. This finding supports the Bethesda system 1991 recommendation to limit the use of this reporting category and suggests that the clinical response to ASCUS reports should be decided locally, based on the observed positive predictive value for cervical intraepithelial neoplasia 2 or more severe lesions.     

Accounting for multiplicity in the evaluation of "signals" obtained by data mining from spontaneous report adverse event databases

Surveillance of drug products in the marketplace continues after approval, to identify rare potential toxicities that are unlikely to have been observed in the clinical trials carried out before approval. This surveillance accumulates large numbers of spontaneous reports of adverse events along with other information in spontaneous report databases. Recently developed empirical Bayes and Bayes methods provide a way to summarize the data in these databases, including a quantitative measure of the strength of the reporting association between the drugs and the events. Determining which of the particular drug-event associations, of which there may be many tens of thousands, are real reporting associations and which random noise presents a substantial problem of multiplicity because the resources available for medical and epidemiologic followup are limited. The issues are similar to those encountered with the evaluation of microarrays, but there are important differences. This report compares the application of a standard empirical Bayes approach with micorarray-inspired methods for controlling the False Discovery Rate, and a new Bayesian method for the resolution of the multiplicity problem to a relatively small database containing about 48,000 reports. The Bayesian approach appears to have attractive diagnostic properties in addition to being easy to interpret and implement computationally.     

The Role of Systematic Reviews in Pharmacovigilance Planning and Clinical Trials Authorisation Application: Example from the SLEEPS Trial

Background

Adequate sedation is crucial to the management of children requiring assisted ventilation on Paediatric Intensive Care Units (PICU). The evidence-base of randomised controlled trials (RCTs) in this area is small and a trial was planned to compare midazolam and clonidine, two sedatives widely used within PICUs neither of which being licensed for that use. The application to obtain a Clinical Trials Authorisation from the Medicines and Healthcare products Regulatory Agency (MHRA) required a dossier summarising the safety profiles of each drug and the pharmacovigilance plan for the trial needed to be determined by this information. A systematic review was undertaken to identify reports relating to the safety of each drug.

Methodology/Principal Findings

The Summary of Product Characteristics (SmPC) were obtained for each sedative. The MHRA were requested to provide reports relating to the use of each drug as a sedative in children under the age of 16. Medline was searched to identify RCTs, controlled clinical trials, observational studies, case reports and series. 288 abstracts were identified for midazolam and 16 for clonidine with full texts obtained for 80 and 6 articles respectively. Thirty-three studies provided data for midazolam and two for clonidine. The majority of data has come from observational studies and case reports. The MHRA provided details of 10 and 3 reports of suspected adverse drug reactions.

Conclusions/Significance

No adverse reactions were identified in addition to those specified within the SmPC for the licensed use of the drugs. Based on this information and the wide spread use of both sedatives in routine practice the pharmacovigilance plan was restricted to adverse reactions. The Clinical Trials Authorisation was granted based on the data presented in the SmPC and the pharmacovigilance plan within the clinical trial protocol restricting collection and reporting to adverse reactions.     

Comparison of adverse events associated with use of mefloquine and combination of chloroquine and proguanil as antimalarial prophylaxis: postal and telephone survey of travellers.

OBJECTIVE: To compare the frequency of adverse events, particularly neuropsychiatric effects, from mefloquine and from chloroquine plus proguanil as used for malaria chemoprophylaxis. DESIGN: Retrospective questionnaire to travellers taking either regimen between November 1993 and February 1995; telephone interview with those reporting pronounced side effects. SETTING: Travellers from Britain who consulted an advisory helpline. SUBJECTS: 1214 adults taking mefloquine and 1181 taking chloroquine plus proguanil. MAIN OUTCOME MEASURES: Reported presence of and degree of disability from 12 neuropsychiatric and other symptoms, as assessed by the subjects and by referees and on the basis of behaviour change. RESULTS: There were equal rates of any side effects (40%) and of stopping or changing medication. Overall, neuropsychiatric adverse events were significantly more common in travellers taking mefloquine. In all, 333 neuropsychiatric adverse events were reported by 1214 travellers taking mefloquine, compared with 189 such events in 1181 travellers taking proguanil plus chloroquine (P < 0.001). In all, 0.7% of travellers taking mefloquine had disabling neuropsychiatric adverse effects, compared with 0.09% of those taking proguanil plus chloroquine (P = 0.021). Two travellers taking mefloquine (1 in 607) were admitted to hospital as a result of the adverse event, compared with 1 in 1181 travellers taking proguanil plus chloroquine. CONCLUSION: There is a significant excess of adverse neuropsychiatric events of intermediate degrees of severity associated with the use of mefloquine compared with proguanil plus chloroquine. This finding may also explain the discrepant findings between earlier studies and clinical experience.