Annual league tables of mortality in neonatal intensive care units: longitudinal study |
| |
| Authors: | Gareth J Parry Craig R Gould Chris J McCabe William O Tarnow-Mordi |
| |
| Institution: | aMedical Care Research Unit, School of Health and Related Research, University of Sheffield, Sheffield S3 7XL, bSheffield Health Economics Group, School of Health and Related Research, cDepartment of Child Health, Ninewells Hospital and Medical School, Dundee DD1 9SY |
| |
| Abstract: | Objective: To assess whether crude league tables of mortality and league tables of risk adjusted mortality accurately reflect the performance of hospitals. Design: Longitudinal study of mortality occurring in hospital. Setting: 9 neonatal intensive care units in the United Kingdom. Subjects: 2671 very low birth weight or preterm infants admitted to neonatal intensive care units between 1988 and 1994. Main outcome measures: Crude hospital mortality and hospital mortality adjusted using the clinical risk index for babies (CRIB) score. Results: Hospitals had wide and overlapping confidence intervals when ranked by mortality in annual league tables; this made it impossible to discriminate between hospitals reliably. In most years there was no significant difference between hospitals, only random variation. The apparent performance of individual hospitals fluctuated substantially from year to year. Conclusions: Annual league tables are not reliable indicators of performance or best practice; they do not reflect consistent differences between hospitals. Any action prompted by the annual league tables would have been equally likely to have been beneficial, detrimental, or irrelevant. Mortality should be compared between groups of hospitals using specific criteria—such as differences in the volume of patients, staffing policy, training of staff, or aspects of clinical practice—after adjusting for risk. This will produce more reliable estimates with narrower confidence intervals, and more reliable and rapid conclusions. Key messages - League tables are being used increasingly to evaluate hospital performance in the United Kingdom
- In annual league tables the rankings of nine neonatal intensive care units in different hospitals had wide and overlapping confidence intervals and their rankings fluctuated substantially over six years
- Annual league tables of hospital mortality were inherently unreliable for comparing hospital performance or for indicating best practices
- The UK government’s commitment to using annual league tables of outcomes such as mortality to monitor services and the spread of best practices should be reconsidered
- Prospective studies of risk adjusted outcome in hospitals grouped according to specific characteristics would provide better information and be a better use of resources
|
| |
| Keywords: | |
|
|
