Increased mortality associated with weekend hospital admission: a case for expanded seven day services?
BMJ 2015; 351 doi: https://doi.org/10.1136/bmj.h4596 (Published 05 September 2015) Cite this as: BMJ 2015;351:h4596
All rapid responses
Rapid responses are electronic comments to the editor. They enable our users to debate issues raised in articles published on bmj.com. A rapid response is first posted online. If you need the URL (web address) of an individual response, simply click on the response headline and copy the URL from the browser window. A proportion of responses will, after editing, be published online and in the print journal as letters, which are indexed in PubMed. Rapid responses are not indexed in PubMed and they are not journal articles. The BMJ reserves the right to remove responses which are being wilfully misrepresented as published articles or when it is brought to our attention that a response spreads misinformation.
From March 2022, the word limit for rapid responses will be 600 words not including references and author details. We will no longer post responses that exceed this limit.
The word limit for letters selected from posted responses remains 300 words.
A feature article covering the background to this paper has been published by The BMJ at the following: http://www.bmj.com/content/352/bmj.i1193
Competing interests: I am employed by The BMJ.
Sir Bruce Keogh's belated response persists in describing the 'weekend effect' in blinkered terms, and persists in claiming it relevant to plans for seven-day working.
For example, his statement "whether or not the finding of increased mortality associated with weekend admission published in 2012 and derived from 2009/10 data still existed." fails yet again to insert the word "rate" after "mortality". He completely fails to recognise or address the fact that mortality ( total deaths) are fewer following admission on any weekend day than after admission on any week-day. If he achieves his aim to re-distribute NHS service ( routine and emergency) equally throughout the seven days, then it seems more likely from all the critique from respondents, that he will merely redistribute the consequent deaths, WITHOUT PREVENTING ANY DEATHS. Unless he knows something we don't ? His hypothesis presumes that equalised seven-day working will lead to a reduced absolute number of deaths, without specifying which services are changed, how and at what cost.
Following the hypothesis-generation of this observational study, the next step should be a local pilot, ie a controlled study of seven-day versus usual-working, to prove the hypothesis, and establish the costs, benefits, and harms.
Instead, we have presumption, wholesale reform, and debacle.
Competing interests: No competing interests
There has been quite a bit of speculation regarding the origin of our paper and declared interests. The idea for the paper originated during discussions within NHS England based on two issues. The first was whether or not the finding of increased mortality associated with weekend admission published in 2012 and derived from 2009/10 data still existed. Secondly, if so, it would be useful to have a baseline against which to assess the impact of changes to the national hospital contract and CQC inspections. I therefore asked research colleagues in Birmingham and UCL to update the analysis we originally published in 2012. It has been argued that the provenance and potential conflicts of interest were not clear. So, for the purposes of clarity, I personally asked for the analysis. I chose to be an author, as I had been part of the original research team. I also encouraged one of my directors leading the work on seven day services on behalf of NHS England to contribute. Our affiliations are clearly described in the authorship list, as is the fact that I requested the repeat analysis: “Contributors and sources: This article arose from a request by BK to update our earlier analyses with more recent data”. We chose to publish the updated analysis in order to stimulate constructive debate on how improve weekend services, given that the solutions would be best found through the minds of those providing the services.
Competing interests: Paper co-author, National Medical Director
Mr Dean raises concerns about the governance and provenance of our work on weekend mortality,[1] however, documentation available to him in the public domain [2] clearly demonstrates these concerns are unfounded. The HSCIC license referred to by Mr Dean can be seen in row 3 of the relevant document published by HSCIC.[2]
This license refers to work for the replication of Summary Hospital Mortality Indicators (as clearly specified in the document). University Hospital Birmingham are part of the SHMI working group which was set up by the then Secretary of State to facilitate methodological work on that metric. We might note that in row 4[2] there is an identical license given for the same purpose to another Institution. For the analysis of hospital mortality outcomes by days of the week, we did not and could not use the SHMI Group license in row 3.[2]
A careful look at the same documents would have identified several licenses (rows 330-334)[2] for data release to University Hospital Birmingham, which do not have any reference to the Secretary of State. The analysis for mortality by days of the week was conducted under the governance umbrella provided by the latter licenses.
For the avoidance of doubt, our work published in the BMJ [1] was not conceived, executed, or published in collaboration with the Secretary of State for Health.
References
1. Freemantle N, Ray D, Mcnulty D, Rosser D, Bennett S, Keogh BE, Pagano D. Increased mortality associated with week-end hospital admission: a case for expanded seven-day services? BMJ, 2015; 351: h4596
2. http://www.hscic.gov.uk/media/17946/Data-Release-Register-January-to-May... [accessed 19/2/16]
Competing interests: No competing interests
Having removed the inherent bias caused by including routine admissions, and shown that the ‘weekend effect’ persists following emergency admission, could Freemantle et al now provide the raw data ( cf the format below, from the HiSLAC document) ?
Freemantle et al state “Our analysis of 2013-14 data suggests that around 11000 more people die each year within 30 days of admission to hospital on Friday, Saturday, Sunday, or Monday compared with other days of the week (Tuesday, Wednesday, Thursday)” which now seems perfectly obvious. They go on to say “It is not possible to ascertain the extent to which these excess deaths may be preventable; to assume that they are avoidable would be rash and misleading.” But the term ‘excess deaths‘ is rash, misleading, and unjustifiable,.
Inspection of the data table below shows that the cohort of patients admitted on Saturday, or on Sunday, suffer FEWER deaths than patients admitted on Wednesday, but at a higher rate.. Roughly 11000 deaths occur in any day’s cohort. Thus, in the FOUR days Friday, Saturday, Sunday, and Monday there are 11000 more deaths than in the THREE days Tuesday, Wednesday, and Thursday.
These are NOT “EXCESS” deaths, but simply the consequence of counting an ‘EXTRA’ day … They are no more or less avoidable on Saturday, than they are on Wednesday.
I call upon Freemantle et al again to provide the raw data table, and to justify or withdraw the reference to ‘excess deaths’, used so freely by Jeremy Hunt with potentially devastating consequences.
Reference
http://hislac.org/images/docs/HiSLAC_Collab_Meet_13th_April_2014_session...
Competing interests: No competing interests
I have previously provided evidence that suggests the Secretary of State had access to this paper’s pre-publication and un-peer reviewed data for his King’s Fund Speech on 16/07/2015 [1]. The authors of this paper have not yet commented on this. When you ask the Department of Health (DH) how Jeremy Hunt got his 6,000 excess deaths figure for this speech, you are directed to this DH webpage [2, Webpage 1, Webpage 2]. This webpage and attached document claims that the 6,000 excess deaths figure was derived from the Freemantle 2012 JRSM paper [3].
I believe this webpage which claims that Jeremy Hunt’s 6,000 deaths data was derived from the 2012 Freemantle paper to be incorrect for two reasons:
Firstly, Jeremy Hunt used the 15% increase in Sunday mortality noted from the 2015 study, not the 16% increase in Sunday mortality noted from the 2012 Freemantle study [see 1].
Secondly, when you submit a Freedom of Information request to the DH about all the correspondence involved in creating that webpage, you get an interesting set of emails between NHS England and the DH. These emails confirm that the 6,000 estimate came from medical research expected to be ‘published by the researchers in the British Medical Journal in due course’ [Email 1].
However because the DH author wants to ‘avoid undue criticism of either DH or of NHS England’, they ask NHS England whether (since the research is unpublished) they can help answer the question posed by the UK Statistics Agency as to 'how best to supplement the information currently available’ so the public can understand the figure.
NHS England dutifully respond with a one-page suggestion of how the figure of 6000 ‘can be arrived at by combining the relative risks from the published 2012 paper with HES data for 2009/10’ [Email 2]. This information was seen as something that could have been ‘as readily generated by DH as NHSE’ [Email 2]. They went on to say that if the ‘solution appeals’ then they should feel free to take it forward. The attached one-page solution [Email 3] obviously appealed. It looks very similar to the explanation that can be found on the DH webpage.
This alleged collaboration between NHS England and the DH to obscure the source of Jeremy Hunt’s data for the King’s Fund speech is very worrying, as (amongst many other reasons) it is an undeclared collaboration before the paper was published. Please can the authors urgently clarify that they were not in any way involved or aware of this?
Jonathan P Sturgeon
Paediatrics Trainee
South London
(1) 'No copy of the paper was shared with the Department of Health by ‘any of the authors’ in advance of publication’ , Rapid Response, 3rd February, Sturgeon J, Dean B. http://www.bmj.com/content/351/bmj.h4596/rr-59
(2) https://www.gov.uk/government/publications/higher-risk-of-death-associat...
(3) Freemantle N, Richardson M, Wood J, Ray D, Khosla S, Shahian D, Roche WR, Stephens I, Keogh B, Pagano D. Weekend hospitalization and additional risk of death: An analysis of inpatient data. Journal of the Royal Society of Medicine, 2012; 105: 74-84.
Competing interests: BMA member and Junior Doctor
The study by Pagano et al(1) does not specify the exact details of the data application and release from the HSCIC. Having reviewed the HSCIC data releases I am unsure as to which specific data releases relate to the Pagano et al study (http://www.hscic.gov.uk/dataregister) and would be very grateful for the authors’ urgent clarification of this matter. I would be particularly interested to know if the data release to the University Hospitals Birmingham (row id 18 of April to June 2014 HSCIC releases) related to the study as this was commissioned by the Secretary of State for Health.
1. Freemantle N, Ray D, McNulty D, et al. Increased mortality associated with weekend hospital admission: a case for expanded seven day services? BMJ (Clinical research ed) 2015; 351.
Competing interests: No competing interests
The paper by Freemantle et al should have been titled “Increased mortality RATE associated with weekend hospital admission..”
The HiSLAC collaborators meeting referred to by Dominic Pimenta, referenced below , gives a very straightforward and revealing table of raw data of the sort requested by many respondents to Freemantle et al. The crucial difference between actual number of deaths, and death rate, is revealed.
The authors have confirmed in Rapid Responses that their ‘weekend effect’ persists amongst ‘emergency’ admissions after the ‘routine’ admissions are removed.
If I now make the reasonable assumption that the population has a propensity to die, and that admission as an emergency in large part reflects perception of this risk, the ‘weekend effect’ can now be readily explained. The data table shows that fewer people are admitted as emergencies at weekend. Freemantle et al agree that “fewer hospital admissions occur at the weekend, patients admitted on Saturday and Sunday are sicker and face an increased likelihood of death within 30 days even when severity of illness is taken into account”. Given that admission is discouraged, and resisted, could it be that those less likely to die do not get admitted on weekends ? Thus, in absolute terms, there are fewer deaths at weekends, but the rate amongst those admitted is higher. Triage works.
Elucidation of risk and response would be well served a prospective trial of current configuration, versus easy admission of all at risk. Who will fund it, with so few doctors available ?
Reference
http://hislac.org/images/docs/HiSLAC_Collab_Meet_13th_April_2014_session...
Competing interests: No competing interests
Dear Sir,
The furore around this paper grows ever louder - the most recent revelations that results were leaked into political briefs by Deloitte while still in peer review is particularly disturbing2. The anger, rightly so, has been at the overt politicisation of the paper, on both sides. The authors must be as exhausted of hearing the phrase '11,000 excess deaths' as they are of the phrase 'to assume these deaths are avoidable is rash and misleading'.
But are we ignoring a wider body of evidence here - the only question that actually matters; to what extent is the 'weekend effect' 'avoidable'? Sadly, we don't know the answer, although early data from the HISLAC study1 seems to suggest what has already been purported - the 'case mix' adjustment for these large, data mined HES studies is insufficient to correct for significant weekend behaviour confounders.
But let's assume for a moment the 'weekend effect' is not an artefact but a true phenomenon - is there any evidence out there to show it is avoidable?
Hogan et al published a moderately sized study looking at 'avoidable’ death3 (Hogan et al., 2015), in a methodology most clinicians would find acceptable. 3400 case notes of patients that had died following hospital admission were reviewed by a panel that looked for errors in care that had they been avoided, would've potentially averted death. They found a remarkably low rate of truly 'avoidable' death - 3% for the cohort 2012/13 and 5.2% for 2009/10. Unfortunately day of admission was not a datapoint collected.
Now in a thought experiment let's apply this to the Freemantle data. Unfortunately the 2013/4 deaths/day for admissions is not available for 2015, so we will use the data from 2009/10 (Freemantle et al., 2012)4 and the corresponding ‘avoidable death’ figure of 5.2% from 2009, using the odds ratio for 'increased' risk of death from the 2012 Freemantle paper for Saturday and Sunday - 1.11 and 1.16 respectively. Assuming, as we have been told repeatedly by the Dept. of Health, that this effect is 'avoidable', this would increase the baseline 5.2% 'avoidable' deaths to 5.8% and 6% respectively (note the later 2013 ‘avoidable’ death percentage was 3%).
If we then look at the number of deaths by day of admission - we find 573 'excess' avoidable deaths on the weekend. In the context of 14217640 hospital admissions that is a 0.004% absolute increased risk of death, or a number needed to harm of 24811. (Table attached). Using best guess estimates for 2013 mortality this falls to a NNH of 50000.
I invest no academic rigour into the above - this is a pencil and napkin exercise that merely outlines how small the 'avoidable' mortality figures are, and even smaller the 'avoidable' weekend effect - which begs the question - is it worth investing the £1-1.4 billion estimated to try to tackle this? At the very least we could invest in a proper, clinical study that might better answer this question. Or could NHS money be better deployed across the week, identifying what the actual avoidable problems are and addressing them?
Critics of this government policy have been told they are 'misled' by civil servants and ministers for health; most recently Dr Fiona Godlee, editor of this esteemed journal, was told she was 'wrong' in her analysis by the Secretary of State for Health on the Andrew Marr Show 7/2/16. Given the above, one might suggest the only one who has been significantly 'misled' in this dispute is The Rt Honourable Jeremy Hunt himself.
Dr Dominic Pimenta
[1] http://hislac.org/images/docs/HiSLAC_Collab_Meet_13th_April_2014_session...
[2] 'No copy of the paper was shared with the Department of Health by ‘any of the authors’ in advance of publication’ , Rapid Response, 3rd February, Sturgeon J, Dean http://www.bmj.com/content/351/bmj.h4596/rr-59
[3] Hogan, H., Zipfel, R., Neuburger, J., Hutchings, A., Darzi, A. and Black, N. (2015). Avoidability of hospital deaths and association with hospital-wide mortality ratios: retrospective case record review and regression analysis. BMJ, p.h3239.
[4] Freemantle, N., Richardson, M., Wood, J., Ray, D., Khosla, S., Shahian, D., Roche, W., Stephens, I., Keogh, B. and Pagano, D. (2012). Weekend hospitalization and additional risk of death: An analysis of inpatient data. JRSM, 105(2), pp.74-84.
Competing interests: No competing interests
Re: Increased mortality associated with weekend hospital admission: a case for expanded seven day services?
There has been much controversy regarding the higher mortality of patients admitted to hospital on the weekend.
This recent study demonstrates that part of this effect is probably due to a day of week cycle in blood biochemistry.
http://www.sciencedomain.org/abstract/16594
These conclusions are supported by another recent study by CHKS demonstrating that patients admitted on the weekend are 'sicker' than at other times of the week
http://www.chks.co.uk/userfiles/files/Weekend%20Mortality%20in%20the%20N...
A key observation in the biochemistry study was that patients are only at risk of death when their biochemistry score undergoes a rapid and permanent shift.
Like many others I have begun to question the validity of hospital mortality models and have published a series investigating possible flaws in these models, mainly intended for hospital managers and clinicians, see http://www.hcaf.biz/2010/Publications_Full.pdf
In retrospect, it is now clear that all must remember the fact that, all models are flawed - some are just more flawed than others.
Competing interests: No competing interests