The impact of eHealth on the quality and safety of health care: a systematic overview

Background

There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care.

Methods and Findings

We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking.

Conclusions

There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and “techno-enthusiasts” as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology''s life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption. Please see later in the article for the Editors'' Summary     

Prevention of Rh(D) alloimmunization: a cost-benefit analysis.

The Rh Programme of Nova Scotia was established in 1964 for the prevention and treatment of Rh(D) alloimmunization. The program''s effectiveness in preventing the condition has been established previously. Because of increasing budget restraint in health care we decided to examine the cost-effectiveness of the program by comparing the cost of prevention (office administration fees, program staff salaries and the price of Rh immune globulin) with the cost of health care services required in addition to standard obstetric procedures and neonatal care in 80 cases of Rh(D) alloimmunization treated from 1982 to 1986. Neonatal intensive care accounted for 80.1% of the additional health care expenses; an extra 512 hospital days for such care constituted 65.7% of the total treatment expense. The cost per case prevented ($1495) was 2.7 times less than the cost per case treated ($3986).     

Dr. Balfour Mount and the cruel irony of our care for the dying.

Dr. Balfour Mount of Montreal thinks that the health care system, because of its fixation on disease processes, may have forgotten that it also has a mandate to alleviate suffering. "We need to recapture that vision," says Mount, who describes palliative medicine as a "rich combination" of clinical pharmacology, rehabilitation medicine and internal medicine. Mount says there is a cruel irony in our care of the dying. "Although these are the sickest people in our health care system, when medical technology doesn''t know what to do, the quality and quantity of care falls away. How can we justify that?"     

Benefits of coordinated action in PACS evaluation

PACS, a health care technology still in its developmental stage, aims to improve the management of diagnostic imaging investigations. As the technology has not been comprehensively assessed, data and facts to justify its clinical, economic and other benefits are to date insufficient. Through internationally coordinated action, it is expected to obtain a faster and more comprehensive technology assessment of PACS as well as recommendations for optimization of the system and guidelines for its rational use in various health care environments.     

A Multifaceted Intervention to Improve the Quality of Care of Children in District Hospitals in Kenya: A Cost-Effectiveness Analysis

Background

To improve care for children in district hospitals in Kenya, a multifaceted approach employing guidelines, training, supervision, feedback, and facilitation was developed, for brevity called the Emergency Triage and Treatment Plus (ETAT+) strategy. We assessed the cost effectiveness of the ETAT+ strategy, in Kenyan hospitals. Further, we estimate the costs of scaling up the intervention to Kenya nationally and potential cost effectiveness at scale.

Methods and Findings

Our cost-effectiveness analysis from the provider''s perspective used data from a previously reported cluster randomized trial comparing the full ETAT+ strategy (n = 4 hospitals) with a partial intervention (n = 4 hospitals). Effectiveness was measured using 14 process measures that capture improvements in quality of care; their average was used as a summary measure of quality. Economic costs of the development and implementation of the intervention were determined (2009 US$). Incremental cost-effectiveness ratios were defined as the incremental cost per percentage improvement in (average) quality of care. Probabilistic sensitivity analysis was used to assess uncertainty. The cost per child admission was US$50.74 (95% CI 49.26–67.06) in intervention hospitals compared to US$31.1 (95% CI 30.67–47.18) in control hospitals. Each percentage improvement in average quality of care cost an additional US$0.79 (95% CI 0.19–2.31) per admitted child. The estimated annual cost of nationally scaling up the full intervention was US$3.6 million, approximately 0.6% of the annual child health budget in Kenya. A “what-if” analysis assuming conservative reductions in mortality suggests the incremental cost per disability adjusted life year (DALY) averted by scaling up would vary between US$39.8 and US$398.3.

Conclusion

Improving quality of care at scale nationally with the full ETAT+ strategy may be affordable for low income countries such as Kenya. Resultant plausible reductions in hospital mortality suggest the intervention could be cost-effective when compared to incremental cost-effectiveness ratios of other priority child health interventions. Please see later in the article for the Editors'' Summary     

The World Health Organisation. WHO in Europe: does it have a role?

WHO is under pressure from all sides to justify its existence. Donors want to know what they are getting for their money, and health professionals question the relevance of the organisation''s work. The pressure to justify itself is perhaps strongest of all in Europe, where most member countries have fully fledged health infrastructures and high overall levels of health. Now there is the additional threat of encroachment into the field of public health by the European Union. The disintegration of the Soviet bloc has given WHO''s regional office in Europe a new sense of purpose and led to a major shift in resources towards the countries of central and eastern Europe. But WHO''s critics are calling for a different shift in the way its European office works: from its current concentration on broad based policy issues to the nitty-gritty of health care management and delivery.     

Reductions in Inpatient Mortality following Interventions to Improve Emergency Hospital Care in Freetown,Sierra Leone

Background

The demand for high quality hospital care for children in low resource countries is not being met. This paper describes a number of strategies to improve emergency care at a children''s hospital and evaluates the impact of these on inpatient mortality. In addition, the cost-effectiveness of improving emergency care is estimated.

Methods and Findings

A team of local and international staff developed a plan to improve emergency care for children arriving at The Ola During Children''s Hospital, Freetown, Sierra Leone. Following focus group discussions, five priority areas were identified to improve emergency care; staff training, hospital layout, staff allocation, medical equipment, and medical record keeping. A team of international volunteers worked with local staff for six months to design and implement improvements in these five priority areas. The improvements were evaluated collectively rather than individually. Before the intervention, the inpatient mortality rate was 12.4%. After the intervention this improved to 5.9%. The relative risk of dying was 47% (95% CI 0.369–0.607) lower after the intervention. The estimated number of lives saved in the first two months after the intervention was 103. The total cost of the intervention was USD 29 714, the estimated cost per death averted was USD 148. There are two main limitation of the study. Firstly, the brevity of the study and secondly, the assumed homogeneity of the clinical cases that presented to the hospital before and after the intervention.

Conclusions

This study demonstarted a signficant reductuion in inpatient mortality rate after an intervention to improve emergency hospital care If the findings of this paper could be reproduced in a larger more rigorous study, improving the quality of care in hospitals would be a very cost effective strategy to save children''s lives in low resource settings.     

Costs and Cost-Effectiveness of a Mobile Phone Text-Message Reminder Programmes to Improve Health Workers' Adherence to Malaria Guidelines in Kenya

Background

Simple interventions for improving health workers'' adherence to malaria case-management guidelines are urgently required across Africa. A recent trial in Kenya showed that text-message reminders sent to health workers'' mobile phones improved management of pediatric outpatients by 25 percentage points. In this paper we examine costs and cost-effectiveness of this intervention.

Methods/Findings

We evaluate costs and cost-effectiveness in 2010 USD under three implementation scenarios: (1) as implemented under study conditions in study areas; (2) if the intervention was routinely implemented by the Ministry of Health (MoH) in the same areas; and (3) if the intervention was scaled up nationally. Under study conditions, intervention costs were 19,342 USD, of which 45% were for developing and pretesting text-messages, 12% for developing text-message distribution system, 29% for collecting health workers'' phone numbers, and 13% were costs of sending text-messages and monitoring of the system. If the intervention was implemented in the same areas by the MoH, the costs would be 28% lower (13,920 USD) due to lower costs of collecting health workers'' numbers. The cost of national scale-up would be 97,350 USD, and the majority of these costs (66%) would be for sending text-messages. The cost per additional child correctly managed was 0.50 USD under study conditions, 0.36 USD if implemented by the MoH in the same area, and estimated at only 0.03 USD if implemented nationally. Even if the effect size was only 5% or the cost on the national scale was 400% higher than estimated, the cost per additional child correctly managed would be only 0.16 USD.

Conclusions

A simple text-messaging intervention improving health worker adherence to malaria guidelines is effective and inexpensive. Further research is justified to optimize delivery of the intervention and expand targets beyond children and malaria disease.     

How to estimate the cost of point-of-care CD4 testing in program settings: an example using the Alere Pima Analyzer in South Africa

Integrating POC CD4 testing technologies into HIV counseling and testing (HCT) programs may improve post-HIV testing linkage to care and treatment. As evaluations of these technologies in program settings continue, estimates of the costs of POC CD4 tests to the service provider will be needed and estimates have begun to be reported. Without a consistent and transparent methodology, estimates of the cost per CD4 test using POC technologies are likely to be difficult to compare and may lead to erroneous conclusions about costs and cost-effectiveness. This paper provides a step-by-step approach for estimating the cost per CD4 test from a provider''s perspective. As an example, the approach is applied to one specific POC technology, the Pima™ Analyzer. The costing approach is illustrated with data from a mobile HCT program in Gauteng Province of South Africa. For this program, the cost per test in 2010 was estimated at $23.76 (material costs = $8.70; labor cost per test = $7.33; and equipment, insurance, and daily quality control = $7.72). Labor and equipment costs can vary widely depending on how the program operates and the number of CD4 tests completed over time. Additional costs not included in the above analysis, for on-going training, supervision, and quality control, are likely to increase further the cost per test. The main contribution of this paper is to outline a methodology for estimating the costs of incorporating POC CD4 testing technologies into an HCT program. The details of the program setting matter significantly for the cost estimate, so that such details should be clearly documented to improve the consistency, transparency, and comparability of cost estimates.     

Cost-Effectiveness of Clinical Decision Support System in Improving Maternal Health Care in Ghana

ObjectiveThis paper investigated the cost-effectiveness of a computer-assisted Clinical Decision Support System (CDSS) in the identification of maternal complications in Ghana.MethodsA cost-effectiveness analysis was performed in a before- and after-intervention study. Analysis was conducted from the provider’s perspective. The intervention area was the Kassena- Nankana district where computer-assisted CDSS was used by midwives in maternal care in six selected health centres. Six selected health centers in the Builsa district served as the non-intervention group, where the normal Ghana Health Service activities were being carried out.ResultsComputer-assisted CDSS increased the detection of pregnancy complications during antenatal care (ANC) in the intervention health centres (before-intervention= 9 /1,000 ANC attendance; after-intervention= 12/1,000 ANC attendance; P-value=0.010). In the intervention health centres, there was a decrease in the number of complications during labour by 1.1%, though the difference was not statistically significant (before-intervention =107/1,000 labour clients; after-intervention= 96/1,000 labour clients; P-value=0.305). Also, at the intervention health centres, the average cost per pregnancy complication detected during ANC (cost –effectiveness ratio) decreased from US$17,017.58 (before-intervention) to US$15,207.5 (after-intervention). Incremental cost –effectiveness ratio (ICER) was estimated at US$1,142. Considering only additional costs (cost of computer-assisted CDSS), cost per pregnancy complication detected was US$285.ConclusionsComputer –assisted CDSS has the potential to identify complications during pregnancy and marginal reduction in labour complications. Implementing computer-assisted CDSS is more costly but more effective in the detection of pregnancy complications compared to routine maternal care, hence making the decision to implement CDSS very complex. Policy makers should however be guided by whether the additional benefit is worth the additional cost.     

Beware the curriculum-reform troops

Questions of resource allocation can pose practical and ethical dilemmas for clinicians. In the Aristotelian conception of distributive justice, the unequal allocation of a scarce resource may be justified by morally relevant factors such as need or likelihood of benefit. Even using these criteria, it can be difficult to reconcile completing claims to determine which patients should be given priority. To what extent the physician''s fiduciary duty toward a patient should supersede the interests of other patients and society as a whole is also a matter of controversy. Although the courts have been reluctant to become involved in allocation decisions in health care, they expect physicians to show allegiance to their patients regardless of budgetary concerns. The allocation of resources on the basis of clinically irrelevant factors such as religion or sexual orientation is prohibited. Clear, fair and publicly acceptable institutional and professional policies can help to ensure that resource allocation decisions are transparent and defensible.     

Shortfall of equipment for neonatal intensive care and the introduction of budget holding contracts.

As adequate allowance must be made for the costs of purchasing, maintaining, and updating equipment during the development of contracts the current standing of neonatal units with regard to available equipment was assessed. Data were collected as part of a one year prospective survey of the 17 perinatal units in the Trent region. Adequacy of provision of equipment for recognised intensive care cost was assessed using the recommendations of the British Paediatric Association and British Association of Perinatal Paediatrics. It was assumed that units without recognised intensive care cost had to be able to equip one cot to a standard of intensive care level 1 in the short term. Equipment more than 5 years old was considered likely to warrant replacement or major maintenance within the next two years. With these guidelines over 600,000 pounds would be required to provide sufficient equipment for all recognised level 1 intensive care cost and to allow units without funded cost to provide this level of care in the short term and to replace existing equipment more than 5 years old for these cost alone. This amount could be reduced by 25% by subdividing intensive care cost into levels 1 and 2, thereby reducing equipment requirements, but this would impair the units'' ability to perform level 1 care at funded provision, which has already been shown to need expansion. Neither figure takes account of equipment requirements for infants requiring special care. In addition, no allowance has been made for purchase or update of ultrasound scanners or blood gas analysers. If the government''s proposed reforms are to be implemented clinicians need to revise guidelines regarding essential equipment, and plans must be made to correct any existing shortfalls so that they do not become inherited financial liabilities for future budget holders.     

WHAT IS THE GOOD OF HEALTH CARE?

This paper sets out to discuss what precisely is meant by 'benefit" when we talk of the requirement that the health care system concern itself with health gain or with maximizing beneficial health care. In particular I argue that in discharging the duty to do what is most beneficial we need to choose between rival conceptions of what is meant by beneficial. One is the patient's conception of benefit and the second is the provider's or funder's conception of benefit. I argue that it is the patient's conception of benefit which is paramount and that if this is followed it commits us to a conception of patient care which must be blind to prognosis in so far as prognosis is thought to bear upon issues of prioritisation or resource allocation.     

Prioritising health services in an era of limits: the Oregon experience.

How do we decide who should receive the benefits that medical science has to offer? One approach to this decision process, that used by the state of Oregon, is described: who and what are covered, and how health care is financed and delivered, are considered. Oregon''s priorities were set on the basis of broad consensus. The objective of health care reform, it was agreed, is to improve, maintain, or restore health--not universal coverage, access to health care, or cost containment. A Health Services Commission was created to consider clinical effectiveness and, through public involvement, to attempt to integrate social values into the priority list. Oregon''s legislature can use the list to develop an overall health policy which recognises that health can be maintained only if investments in several related areas are balanced.     

Cost-Effectiveness of Collaborative Care for Depression in UK Primary Care: Economic Evaluation of a Randomised Controlled Trial (CADET)

Background

Collaborative care is an effective treatment for the management of depression but evidence on its cost-effectiveness in the UK is lacking.

Aims

To assess the cost-effectiveness of collaborative care in a UK primary care setting.

Methods

An economic evaluation alongside a multi-centre cluster randomised controlled trial comparing collaborative care with usual primary care for adults with depression (n = 581). Costs, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratios (ICER) were calculated over a 12-month follow-up, from the perspective of the UK National Health Service and Personal Social Services (i.e. Third Party Payer). Sensitivity analyses are reported, and uncertainty is presented using the cost-effectiveness acceptability curve (CEAC) and the cost-effectiveness plane.

Results

The collaborative care intervention had a mean cost of £272.50 per participant. Health and social care service use, excluding collaborative care, indicated a similar profile of resource use between collaborative care and usual care participants. Collaborative care offered a mean incremental gain of 0.02 (95% CI: –0.02, 0.06) quality-adjusted life-years over 12 months, at a mean incremental cost of £270.72 (95% CI: –202.98, 886.04), and resulted in an estimated mean cost per QALY of £14,248. Where costs associated with informal care are considered in sensitivity analyses collaborative care is expected to be less costly and more effective, thereby dominating treatment as usual.

Conclusion

Collaborative care offers health gains at a relatively low cost, and is cost-effective compared with usual care against a decision-maker willingness to pay threshold of £20,000 per QALY gained. Results here support the commissioning of collaborative care in a UK primary care setting.     

How attractive does a new technology have to be to warrant adoption and utilization? Tentative guidelines for using clinical and economic evaluations.

Because economic evaluations of health care services are being published with increasing frequency it is important to (a) evaluate them rigorously and (b) compare the net benefit of the application of one technology with that of others. Four "levels of evidence" that rate economic evaluations on the basis of their methodologic rigour are proposed. They are based on the quality of the methods used to estimate clinical effectiveness, quality of life and costs. With the use of the magnitude of the incremental net benefit of a technology, therapies can also be classified into five "grades of recommendation." A grade A technology is both more effective and cheaper than the existing one, whereas a grade E technology is less or equally effective and more costly. Those of grades B through D are more effective and more costly. A grade B technology costs less than $20,000 per quality-adjusted life-year (QALY), a grade C one $20,000 to $100,000/QALY and a grade D one more than $100,000/QALY. Many issues other than cost effectiveness, such as ethical and political considerations, affect the implementation of a new technology. However, it is hoped that these guidelines will provide a framework with which to interpret economic evaluations and to identify additional information that will be useful in making sound decisions on the adoption and utilization of health care services.     

Development of unit cost for the health services offered at King FAHD Central hospital Jazan,Saudi Arabia

BackgroundEfficiency remains one of the most important drivers of decision making in health care system. Fund allocators need to receive structured information about the cost healthcare services from hospitals for better decisions related to resource allocation and budgeting. The objective of the study was to estimate the unit cost for health services offered to inpatients in King Fahd Central hospital (KFCH) Jazan during the financial year 2018.MethodsWe applied a retrospective approach using a top-down costing method to estimate the cost of health care services. Clinical and Administrative departments divided into cost centres, and the unit cost was calculated by dividing the total cost of final care cost centres into the total number of patients discharged in one year. The average cost of inpatient services was calculated based on the average cost of each ward and the number of patients treated.ResultsThe average cost per patient stayed in KFCH was SAR 19,034, with the highest cost of SAR 108,561 for patients in the Orthopedic ward. The average cost of the patient in the Surgery ward, Plastic surgery, Neurosurgery, Medical ward, Pediatric ward and Gynecology ward was SAR 33,033, SAR 29,425, SAR 23,444, SAR 20,450, SAR 9579 and SAR 8636 respectively.ConclusionThis study provides necessary information about the cost of health care services in a tertiary care setting. This information can be used as a primary tool and reference for further studies in other regions of the country. Hence, this data can help to provide a better understanding of tertiary hospital costing in the region to achieve the privatization objective.     

The Cost and Impact of Scaling Up Pre-exposure Prophylaxis for HIV Prevention: A Systematic Review of Cost-Effectiveness Modelling Studies

Background

Cost-effectiveness studies inform resource allocation, strategy, and policy development. However, due to their complexity, dependence on assumptions made, and inherent uncertainty, synthesising, and generalising the results can be difficult. We assess cost-effectiveness models evaluating expected health gains and costs of HIV pre-exposure prophylaxis (PrEP) interventions.

Methods and Findings

We conducted a systematic review comparing epidemiological and economic assumptions of cost-effectiveness studies using various modelling approaches. The following databases were searched (until January 2013): PubMed/Medline, ISI Web of Knowledge, Centre for Reviews and Dissemination databases, EconLIT, and region-specific databases. We included modelling studies reporting both cost and expected impact of a PrEP roll-out. We explored five issues: prioritisation strategies, adherence, behaviour change, toxicity, and resistance. Of 961 studies retrieved, 13 were included. Studies modelled populations (heterosexual couples, men who have sex with men, people who inject drugs) in generalised and concentrated epidemics from Southern Africa (including South Africa), Ukraine, USA, and Peru. PrEP was found to have the potential to be a cost-effective addition to HIV prevention programmes in specific settings. The extent of the impact of PrEP depended upon assumptions made concerning cost, epidemic context, programme coverage, prioritisation strategies, and individual-level adherence. Delivery of PrEP to key populations at highest risk of HIV exposure appears the most cost-effective strategy. Limitations of this review include the partial geographical coverage, our inability to perform a meta-analysis, and the paucity of information available exploring trade-offs between early treatment and PrEP.

Conclusions

Our review identifies the main considerations to address in assessing cost-effectiveness analyses of a PrEP intervention—cost, epidemic context, individual adherence level, PrEP programme coverage, and prioritisation strategy. Cost-effectiveness studies indicating where resources can be applied for greatest impact are essential to guide resource allocation decisions; however, the results of such analyses must be considered within the context of the underlying assumptions made. Please see later in the article for the Editors'' Summary     

Methodological Problems in Evolutionary Biology. XII. Against Evolutionary Ethics

Evolutionary ethics has recently become popular again. Some of its representatives elaborate new attempts to derive ethics from evolutionary biology. The attempts, like previous ones, fail because they commit the naturalistic fallacy. Premises from evolutionary biology together with normative premises also do not justify ethical principles. Other representatives argue that evolutionary considerations imply that ethics cannot be justified at all. Their arguments presuppose an unacceptable form of foundationalism. In principle, evolutionary biology might explain some aspects of morality, but in practice explanations are hard to come by. All this does not imply that evolutionary theory is irrelevant in normative settings. To the contrary, it may help us devise guidelines in environmental policy and health care policy. It is to be hoped that evolutionary ethicists will divert their research efforts to the elaboration of such guidelines.     

Allocation of health care resources: a challenge for the medical profession.

If current limitations on health care funding continue, medical practitioners will face increasing pressure to conserve scarce resources and to participate in the allocation of funds. This article discusses the ethical and economic aspects of the physician''s role and briefly reviews some efficiency measures that might mitigate the effects of rationing of health care services.