University of Leicester
Browse

Quantifying the Potential Bias when Directly Comparing Standardised Mortality Ratios for In-Unit Neonatal Mortality

Download (648.11 kB)
journal contribution
posted on 2015-07-14, 13:31 authored by T. Alun Evans, Sarah E. Seaton, Bradley N. Manktelow
Introduction: The Standardised Mortality Ratio (SMR) is increasingly used to compare the performance of different healthcare providers. However, it has long been known that differences in the populations of the providers can cause biased results when directly comparing two SMRs. This is potentially a particular problem in neonatal medicine where units provide different levels of care. Methods: Using data from The Neonatal Survey (TNS), babies born at 24 to 31 weeks gestational age from 2002 to 2011 and admitted to one of 11 UK neonatal units were identified. Risk-adjusted SMRs were calculated for each unit using a previously published model to estimate the expected number of deaths. The model parameters were then re-estimated based on data from each individual neonatal unit (“reference” unit) and these then applied to each of the other units to estimate the number of deaths each unit would have observed if they had the same underlying mortality rates as each of the “reference” hospitals. The ratios of the SMRs were then calculated under the assumption of identical risk-specific probabilities of death. Results: 7243 babies were included in all analyses. When comparing between Network Neonatal Units (Level 3) the ratio of SMRs ranged from 0.92 to 1.00 and for the comparisons within Local Neonatal Units (Level 2) ranged from 0.79 to 1.56. However when comparing between neonatal units providing different levels of care ratios up to 1.68 were observed. Conclusions: If the populations of healthcare providers differ considerably then it is likely that bias will be an issue when directly comparing SMRs. In neonatal care, the comparison of Network Neonatal Units is likely to be useful but caution is required when comparing Local Neonatal Units or between units of different types. Tools to quantify the likely bias are required.

History

Citation

PLoS One, 2013, 8 (4), e61237

Author affiliation

/Organisation/COLLEGE OF MEDICINE, BIOLOGICAL SCIENCES AND PSYCHOLOGY/School of Medicine/Department of Health Sciences

Version

  • VoR (Version of Record)

Published in

PLoS One

Publisher

Public Library of Science

eissn

1932-6203

Acceptance date

2013-03-07

Copyright date

2013

Available date

2015-07-14

Publisher version

http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0061237

Notes

PMCID: PMC3618107

Language

en

Usage metrics

    University of Leicester Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC