Skip to main content

Real world hospital costs following stress echocardiography in the UK: a costing study from the EVAREST/BSE-NSTEP multi-centre study

This article has been updated

Abstract

Background

Stress echocardiography is widely used to detect coronary artery disease, but little evidence on downstream hospital costs in real-world practice is available. We examined how stress echocardiography accuracy and downstream hospital costs vary across NHS hospitals and identified key factors that affect costs to help inform future clinical planning and guidelines.

Methods

Data on 7636 patients recruited from 31 NHS hospitals within the UK between 2014 and 2020 as part of EVAREST/BSE-NSTEP clinical study, were used. Data included all diagnostic tests, procedures, and hospital admissions for 12 months after a stress echocardiogram and were costed using the NHS national unit costs. A decision tree was built to illustrate the clinical pathway and estimate average downstream hospital costs. Multi-level regression analysis was performed to identify variation in accuracy and costs at both patient, procedural, and hospital level. Linear regression and extrapolation were used to estimate annual hospital cost-savings associated with increasing predictive accuracy at hospital and national level.

Results

Stress echocardiography accuracy varied with patient, hospital and operator characteristics. Hypertension, presence of wall motion abnormalities and higher number of hospital cardiology outpatient attendances annually reduced accuracy, adjusted odds ratio of 0.78 (95% CI 0.65 to 0.93), 0.27 (95% CI 0.15 to 0.48), 0.99 (95% CI 0.98 to 0.99) respectively, whereas a prior myocardial infarction, angiotensin receptor blocker medication, and greater operator experience increased accuracy, adjusted odds ratio of 1.77 (95% CI 1.34 to 2.33), 1.64 (95% CI 1.22 to 2.22), and 1.06 (95% CI 1.02 to 1.09) respectively. Average downstream costs were £646 per patient (SD 1796) with significant variation across hospitals. The average downstream costs between the 31 hospitals varied from £384–1730 per patient. False positive and false negative tests were associated with average downstream costs of £1446 (SD £601) and £4192 (SD 3332) respectively, driven by increased non-elective hospital admissions, adjusted odds ratio 2.48 (95% CI 1.08 to 5.66), 21.06 (95% CI 10.41 to 42.59) respectively. We estimated that an increase in accuracy by 1 percentage point could save the NHS in the UK £3.2 million annually.

Conclusion

This study provides real-world evidence of downstream costs associated with stress echocardiography practice in the UK and estimates how improvements in accuracy could impact healthcare expenditure in the NHS. A real-world downstream costing approach could be adopted more widely in evaluation of imaging tests and interventions to reflect actual value for money and support realistic planning.

Introduction

Coronary artery disease (CAD) is a leading cause of morbidity and mortality in the UK and remains a major financial healthcare burden [1]. Early diagnosis is important to prevent acute events and a number of tests and imaging modalities are available, all with relatively similar levels of predictive accuracy [2,3,4,5]. In the UK, the National Institute for Health and Care Excellence (NICE) provides guidance on best practice, taking into account economic evidence from cost-effectiveness analysis. Current guidelines recommend non-invasive anatomical imaging as first-line investigation [6]. However, the authors highlighted this guidance was limited by a lack of meaningful data to evaluate real-world downstream costs associated with different imaging tests. Short term, de novo health economic models with instant time horizons, considering only the imaging test and associated complications were used, without ongoing management costs [6]. Furthermore, the imaging combinations modelled did not reflect real world practice and the substantial economic costs of installing new infrastructure to deliver this guidance across the UK were not considered [7, 8].

Stress echocardiography is one of the most widely used functional tests for detecting CAD in the UK [9] and has been shown to be accurate and cost-effective [10,11,12,13,14]. Additionally, the European Society of Cardiology (ESC) guidelines recommend both non-invasive functional imaging and non-invasive anatomical imaging for diagnosis of severe CAD [15]. We have recently reported results from the largest, prospective, observational study of stress echocardiography in the UK (Echocardiography Value and Accuracy at Rest and Stress—EVAREST), which showed stress echocardiography is being performed with a high level of accuracy in the NHS [5, 16]. As all patients in EVAREST are followed up for at least 12 months, we have now evaluated real world downstream costs associated with the CAD patient care pathway. The aim of this costings sub-study is to determine to what extent stress echocardiography accuracy and downstream hospital costs vary across National Health Service (NHS) hospitals in the UK and identify key factors that might be able to be modified to reduce costs within the NHS and help inform future clinical planning and guidelines.

Methods

Patient recruitment and follow-up

The EVAREST study (NCT03674255) is an ongoing, prospective, multi-centre, observational study examining the use, accuracy and downstream cost of stress echocardiography in real-world NHS settings, and since 2021, has been conducted in collaboration with the British Society of Echocardiography as the National Review of Stress Echocardiography Practice (BSE-NSTEP). Ethical approval was granted by the Health Research Authority NRES Committee (South Central–Berkshire) review board (IRAS reference:14/SC/1437). Patients are recruited at the time of their stress echocardiogram and are eligible for inclusion if they are aged over 18 years of age and provide written informed consent. The performance and interpretation of the stress echocardiogram is carried out per local centre protocol, and the downstream management of each patient is determined by clinicians at the recruiting centre as per usual care basis. Information relating to patient demographics, stress echocardiogram protocol and stress echocardiogram result are extracted from hospital records. Patients in this analysis were followed up for 12 months using medical records reviews and patient phone calls conducted by hospital staff to determine whether they had undergone any further cardiac imaging investigations and treatments e.g. initiation of medical therapy and/or revascularization, as well as if they had suffered major cardiac events such as myocardial infarction (MI) or cardiac-related death. Full study design is described elsewhere [5].

Patient and hospital characteristics

All patients recruited from March 2014 to March 2020 across 28 NHS Trusts in England (comprised of 31 hospitals) who had completed a diagnostic stress echo protocol were used in this analysis. Data at the individual level included socio-demographic characteristics (age and gender) and presence of cardiac risk factors at the time of undergoing a stress echocardiogram including smoking status, body-mass index (BMI), hypertension, hypercholesteremia, peripheral vascular disease, diabetes, family history of premature cardiovascular disease, previous CAD, previous MI, and previous revascularisation. Cardiac medications and resting regional wall motion abnormalities (RWMAs) were also included. Data at the hospital level included socio-economic deprivation based on the Office for National Statistics (ONS) Index of Multiple Deprivation (IMD) rank, number of beds in hospital, cardiology attendances per year, and stress echocardiograms performed per year. Bed number was obtained from NHS England [17], and cardiology attendances per year were obtained from NHS Digital [18]. Information related to annual capacity for stress echocardiography were self-reported by each hospital.

Definition of predictive accuracy

All clinical data were reviewed by an adjudication committee including at least one accredited cardiologist, blinded to stress echocardiogram result and a binary (cardiac/non-cardiac) outcome assigned. Cardiac outcome was defined as angiography demonstrating an anatomically or functionally significant lesion [defined as greater than 70% narrowing (or 50% in the left main stem) or abnormal fractional flow reserve or instantaneous wave-free ratio], referral for revascularization, initiation of appropriate pharmacological therapy, acute coronary syndrome, or cardiac-related death. All patients in whom no additional cardiac intervention, management, or investigation was required were assigned a non-cardiac outcome. A correct stress echocardiogram is categorised as either true positive (TP) or true negative (TN), these are defined as an agreement between the interpretation of the reporting clinician (positive or negative for ischaemia) and the per patient outcome assigned by the study adjudication committee..

Downstream hospital costs

Cardiac related elective (including day case) and non-elective hospital admissions, as well as further cardiac investigations, of individuals over the 12-month period following their stress echocardiogram were costed using 2019/20 unit costs from the NHS National Schedule of Reference Costs [19]. Where multiple procedure costs were present on the schedule, for example due to multiple complexity and comorbidity scores, a weighted average cost was calculated.

Statistical analysis

Descriptive statistics (i.e. frequencies, mean, median, standard deviation, and interquartile range) were performed to describe the sample and differences between hospitals were statistically tested using Kruskal–Wallis test for continuous variables and Chi2 for categorical variables. Further, a decision tree was constructed using TreeAge Pro Healthcare (TreeAge Software LLC, Massachusetts, USA) to illustrate the management pathway for individuals following a positive or negative stress echocardiogram and calculate the associated mean downstream hospital costs.

Regression analysis was performed to test the association of stress echocardiogram predictive accuracy with non-elective hospitalization and downstream costs. Predictive accuracy was defined in the regression models as an individual having a correct stress echocardiogram or not, a false positive (FP) or not, and a false negative (FN) or not. The latter two determinants of accuracy were used separately in the regression analyses to disentangle their association with downstream hospital costs in the case of a not accurate diagnosis. Total downstream costs per individual over a year were included as an outcome variable alongside a binary variable whether an individual had a non-elective hospital admission for cardiac reasons. The latter outcome variable was specified to test the hypothesis that individuals with FN stress echocardiogram were at higher risk of major adverse cardiovascular events (MACE). We also included variables that were associated with both predictive accuracy and downstream costs (i.e. confounders). These variables included socio-demographic characteristics (age and gender), cardiac risk factors at the time of undergoing a stress echocardiogram (smoking status, BMI, hypertension, hypercholesteremia, peripheral vascular disease, diabetes, family history of premature cardiovascular disease, previous CAD, previous MI, and previous revascularisation), cardiac medications, resting RWMAs, IMD rank, number of beds in hospital, cardiology attendances per year, and stress echocardiograms performed per year. Additional File 1 provides a graphical illustration of the causal pathway with the predictive accuracy as an exposure variable, the predictive accuracy as an outcome variable, and the several confounders at individual and hospital level.

Mixed-effects generalised linear regression models with random intercept and clustered standard errors at hospital level were specified to accommodate the hierarchy of the data (i.e. individuals clustered in hospitals). For binary outcomes, binary distribution with logit function link were used, while for downstream costs gamma distribution and log link were used to accommodate for skewed cost data. Last, regression analysis was used to estimate the annual cost-savings per index stress echocardiogram associated with increasing predictive accuracy. Linear extrapolation was then conducted to estimate the annual cost-savings of increasing predictive accuracy across the EVAREST hospitals, and nationally. For extrapolation at the national level, a reference value of 61,458 stress echocardiograms performed annually at 115 NHS Trusts in the UK as reported by Asher et al. [20], was used. Statistical analysis was carried out using STATA 15-MP (StataCorp, Texas, USA), and used a threshold of 0.05 for statistical significance.

Results

Demographics

Follow up data for 12 months following their stress echocardiogram procedure was available for 7636 patients across 28 NHS Trusts (31 hospitals). The median age of the population was 66 (IQR 57 to 73) years and 4278 (56%) were male. There were 1425 (18.7%) individuals with a positive stress echocardiogram, while 6211 (81.3%) had a negative stress echocardiogram. A complete list of patient demographics is shown in Table 1, and aggregated descriptive statistics at the hospital level demonstrate variation in patient characteristics (p < 0.001) [see Additional file 2].

Table 1 Patient demographics at the time of stress echocardiogram for all patients (N = 7636). Also shown is the range between the 28 participating NHS Trusts

Predictive accuracy of stress echocardiograpy

Predictive accuracy varied across Trusts with a mean sensitivity and specificity of 81.7% (SD 15.0%, range 40.0–100.0%) and 95.8% (SD 2.7%, range 90.3–100.0%) respectively. Overall accuracy was 94.2% (SD 2.1%, range 89.6–98.2%) [see Additional file 3].

Variation in downstream costs

The average downstream costs per patient were £646 (SD £1796, median £191, range £191–19,973). The average downstream costs between the 31 hospitals varied from £384–1730 per patient (Fig. 1A). The average hospital cost following a TP stress echocardiogram was £2312 (SD £3894), and £227 (SD £271) after a TN stress echocardiogram. For those with a FP stress echocardiogram, the average hospital cost was £1446 (SD £601), and for a FN stress echocardiogram, the average cost was £4192 (SD £3332) (Fig. 2). A breakdown of outcomes of patient management following a positive and negative stress echocardiogram is given in Table 2. The decision tree depicting all patient downstream outcomes as well as associated costs for a positive and negative stress echocardiogram is shown in Additional file 4 and 5 respectively.

Fig. 1
figure 1

A Variation in average downstream cost across NHS Trusts. Red line indicates mean trust cost. B Linear regression analysis between predictive accuracy and average downstream costs for each Trust

Fig. 2
figure 2

Average downstream costs incurred per patient

Table 2 Breakdown of patient management following positive and negative stress echocardiography

Demographic associations with accuracy

Stress echocardiogram correct

Individuals with hypertension and those with resting RWMAs were associated with a decreased likelihood of a correct stress echocardiogram with an adjusted odds ratio of 0.78 (95% CI 0.65 to 0.93, p < 0.01) and 0.27 (95% CI 0.15 to 0.48, p < 0.001), respectively. Those with a prior MI and those taking an angiotensin receptor blocker were associated with an increased likelihood of a correct stress echocardiogram with an adjusted odds ratio of 1.77 (95% CI 1.34 to 2.33, p < 0.001) and 1.64 (95% CI 1.22 to 2.22, p < 0.01), respectively. In terms of hospital demographics, number of stress echocardiograms performed per year was associated with a slight increased likelihood of a correct stress echocardiogram, adjusted odds ratio 1.06 (95% CI 1.02 to 1.09, p < 0.01). The number of cardiology attendances per year at each hospital, used as a surrogate marker of cardiology department size was associated with a slight decreased likelihood of a correct stress echocardiogram, adjusted odds ratio 0.99 (95% CI 0.98 to 0.99, p < 0.001) [see Additional file 6A].

False diagnoses

BMI, hypertension, resting RWMAs, and cardiology attendances were all associated with an increased likelihood of a FP stress echocardiogram, adjusted odds ratio 1.02 (95% CI 1.01 to 1.04, p < 0.01), 1.28 (95% CI 1.02 to 1.60, p < 0.01), 4.68 (95% CI 1.96 to 11.17, p < 0.01), 1.02 (95% CI 1.01 to 1.03, p < 0.01), respectively. Conversely, male sex, diabetes, previous MI, and angiotensin receptor blocker use, were associated with a decreased likelihood of a FP stress echocardiogram, adjusted odds ratio 0.70 (95% CI 0.52 to 0.94, p < 0.05), 0.65 (95% CI 0.44 to 0.97, p < 0.05), 0.44 (95% CI 0.29 to 0.67, p < 0.001), 0.71 (95% CI 0.51 to 0.99, p < 0.05), respectively. Male sex, diabetes, and resting RWMAs, were all associated with an increased likelihood of a FN stress echocardiogram, adjusted odds ratio 1.94 (95% CI 1.32 to 2.86, p < 0.01), 2.02 (95% CI 1.33 to 3.06, p < 0.01), 2.15 (95% CI 1.42 to 3.26, p < 0.001), respectively. No variables were associated with a decrease in the likelihood of a FN stress echocardiogram [see Additional file 6B].

Hospital admission

Non-elective procedures

In the 12-month period following their stress echocardiogram, 162 (2.1%) patients were admitted with an acute coronary syndrome (ACS), 156 (2.0%) received a non-elective invasive coronary angiogram (ICA), 94 (1.2%) were managed medically, 45 (0.6%) had a non-elective percutaneous coronary intervention (PCI), and 4 (0.1%) had a non-elective coronary artery bypass graft (CABG). A further 13 (0.2%) patients underwent both non-elective PCI and CABG. The remaining six patients who did not undergo non-elective coronary angiography were referred directly for non-elective CABG. A correct stress echocardiogram was associated with a decrease in the likelihood of a non-elective hospital admission, adjusted odds ratio 0.13 (95% CI 0.06 to 0.25, p < 0.001) [see Additional file 7]. A false positive or false negative stress echocardiogram was associated with an increased likelihood of non-elective hospital admission, adjusted odds ratio 2.48 (95% CI 1.08 to 5.66, p < 0.05), 21.06 (95% CI 10.41 to 42.59, p < 0.001), respectively [see Additional file 8].

Associations of accuracy with downstream costs

A correct stress echocardiogram was associated with 76% less mean downstream cost per patient, (adjusted means ratio: 0.24, 95% CI 0.21 to 0.27; p-value < 0.001) (Fig. 3A) or £1096 (95% CI £912–1280, p < 0.001) compared to an incorrect stress echocardiogram. A FP stress echocardiogram was associated with a 186% increase in mean downstream costs per patient (adjusted means ratio: 2.86, 95% CI 2.51 to 3.27; p-value < 0.001) or £803 (95% CI £646 to 960, p < 0.001), while a FN stress echocardiogram was also associated with a 584% increase in mean downstream costs per patient, (adjusted means ratio: 6.84; 95% CI 5.70 to 8.20; p-value < 0.001) or £1425 (95% CI £1195 to 1654, p < 0.001) (Fig. 3B).

Fig. 3
figure 3

Association of diagnosis with hospital 12-month follow up costs in correct diagnosis (A) and false diagnosis (B)

Cost savings by increasing accuracy

As shown in Fig. 1B, an increase in stress echocardiogram accuracy by 1 percentage point could save on average £57.30 downstream hospital costs in 12 months following a stress echocardiogram. This could be translated to £1 098 211 savings annually across the 31 hospitals in the EVAREST study (19,166 combined stress echocardiograms performed per year self-reported by hospital). A 1 percentage point increase in stress echocardiogram accuracy extrapolated nationally could result in an annual saving of £3.5 million (assuming the EVAREST cohort is representative of UK practice overall). Additionally, 15 hospitals in EVAREST performed below the calculated mean hospital predictive accuracy (94.2%). Increasing stress echocardiogram accuracy at these hospitals to the mean accuracy level in EVAREST would result in an annual cost savings of £772 871. Again, extrapolating to the national level would result in increases in accuracy at 58 hospitals across the UK with a potential cost-saving of £3.2 million.

Discussion

In this study, we calculated the mean downstream hospital cost over a 12-month period following a stress echocardiogram to be £646 per patient with a variation of £384 and £1730 between the 31 hospitals in our study. This variation in cost is primarily explained by the range in predictive accuracy of stress echocardiogram between centres observed in this real-world setting, which is strongly associated with the increased cost attributed to non-elective hospital admissions. If overall accuracy could be increased by 1 percentage point, then NHS hospitals could save £57.30 per individual undergoing a stress echocardiogram. For NHS budget holders, this would be a cost saving of approximately £3.5 million per year.

Associations with accuracy

Our findings show people with diabetes and males are more likely to have a FN stress echocardiogram, which mirrors findings from a 2016 study by Premarante et al. [21] and a small cohort study by Elhendy et al. [22]. These findings may be attributed to an increased prevalence of CAD amongst males or a difference in myocardial response to stress. Furthermore, our results show that a higher BMI, female sex, and being non-diabetic are associated with a higher risk of a FP stress echocardiogram, consistent with previous studies examining risk factor associations with FP stress echocardiogram results [23,24,25,26]. Those with prior MI and those currently taking angiotensin receptor blockers, perhaps due to a higher pre-test probability of disease in these patients, had a reduced risk of FP stress echocardiogram. It is surprising that angiotensin receptor blockers were the only cardiac medications observed to affect accuracy. A possible explanation for their reduction in false positive rate may be related to their anti-hypertensive effect, thereby reducing hypertension-induced wall motion abnormalities [27]. However, it is not clear why other anti-hypertensive medications did not also affect accuracy and further work is needed to explore this hypothesis. We have previously reported in a smaller sample of the EVAREST dataset that the presence of resting RWMAs was associated with a reduction in specificity and overall accuracy over a six-month follow-up period [5]. This was also evident in the current dataset and the increase in FP stress echocardiogram is likely due to the difficulty in determining whether the resting RWMA has worsened at higher heart rates. An older study by Marcovitz and Armstrong demonstrated an increase in FP rates in the presence of resting RWMAs [28] and our data suggest this continues to be an issue despite newer ultrasound technologies with higher resolutions and frame rates. The finding that prior MI leads to a reduction in FP rate while the presence of RWMAs leads to an increase in FP rate is interesting, since a prior MI is likely to be associated with RWMAs. This discordance suggests the increase in FP rate in those with RWMAs is driven by referral for angiography in those with RWMA but without a history of prior MI. One possible explanation is that the operator has a lower threshold for referral in those with RWMAs without prior cardiac history. This group then is found to either have non-cardiac reasons for their RWMA or their coronary disease is not flow limiting. Surprisingly, a higher number of hospital cardiology attendances was associated with a decreased likelihood of a correct stress echocardiogram. This could reflect similar problems to those observed in Emergency Departments where increased workload leads to poorer patient outcomes [29]. Employing newer technologies including automated reading of stress echocardiograms with artificial intelligence may also prove useful in increasing accuracy. We recently reported [31] a mean increase in sensitivity and specificity of 10% and 1.4% respectively could be achieved when clinicians were provided with an artificial intelligence-based assessment of stress echocardiogram images during a randomised reader study. The PROTEUS randomised controlled trial is currently ongoing to assess the impact of using artificial intelligence-based assessments as a diagnostic aid during stress echocardiography [32]. A real-world costing analysis will be possible in PROTEUS to evaluate whether improvements in accuracy lead to the health economic benefits estimated in this current work.

Hospital admissions

The significance of FP stress echocardiograms has been debated with some discharging these patients from further investigation following angiography, whilst others advocate for additional scrutiny and management [33, 34]. Our results support the latter argument as we found an increased likelihood of a subsequent non-elective hospital admission following a FP stress echocardiogram. These results are consistent with those of From et al., where all-cause mortality was similar for those patients with TP and FP stress echocardiogram results [25]. This has been further demonstrated recently by Gurunathan et al. [35] who reported similar cardiovascular event rates for patients with a FP and TP stress echocardiogram result even when conducting a subsequent fractional flow reserve investigation. Similarly, Gilchrist et al. [36] reported a significant increase in the likelihood of a major cardiac event for patients with a FP stress echocardiogram when compared to matched controls. Whilst these patients might benefit from increased surveillance, the overall costs associated with a FP stress echocardiogram were still lower than those attributed to FN stress echocardiogram. Whilst the proportion of FN stress echocardiograms accounted for only 1.7% of the total stress echocardiograms performed in this study, the high number of ICAs and rates of PCI in this group resulted in significantly higher costs. Furthermore, a large increase in downstream costs associated with a FN stress echocardiogram related to non-elective admissions for an acute coronary syndrome—one of the most expensive care pathways costed. However, in our multivariate model we did not identify factors that could be addressed to specifically reduce FN stress echocardiogram rates and, therefore, this additional cost. Other studies have demonstrated that increased age, male sex, diabetes, smoking status, previous diagnosis of CAD and resting RWMA are associated with increased mortality and/or new CAD lesion despite a negative stress echocardiogram [23, 37]. This discrepancy may result from a different pattern of referral or patient demographic in the EVAREST cohort study or the longer follow-up period used in these other studies. Long-term follow up of the EVAREST cohort beyond 12-months will be of interest to explore this further.

These results contrast with the assumptions included in the economic modelling conducted to support the recent NICE guidelines on stable chest pain where FN and FP stress echocardiograms were considered of equal importance. Our study provides evidence that FN results are far costlier to the NHS (average annual downstream cost of £4192) compared to those incurred due to a FP stress echocardiogram (average annual downstream cost of £1446). Additionally, the sensitivity and specificity of stress echocardiogram reported in our cohort (81.7% and 95.8%, respectively) are higher than the data included in the economic analysis within the NICE guidelines (75.6% and 80.4%, respectively).

Strengths of study

This is the first study to provide a detailed examination of care pathway and associated costs over 12 months following stress echocardiogram for a large volume of patients across 28 NHS Trusts (31 hospitals). The data collected in the study consists of a wide variation of patient and organisational characteristics across England, which is likely representative of stress echocardiogram practice across the country. Notably, our data is not modelled and represent true costs down all diagnosis pathways (TN, TP, FN, FP) which has strengths over the instant time-horizon modelling used in the 2016 NICE guideline de novo health economic model. This provides a more holistic view of overall costs as opposed to cost per correct diagnosis reported in the de novo model. Thus, we were able to address assumptions made in the de novo model such as illustrating that there is a marked increase in downstream costs following a FN stress echocardiogram result as compared to costs associated with a FP result. Additionally, our modelling estimated cost-savings associated with national improvement of stress echocardiography accuracy, potentially providing evidence in favour of implementing strategies to improve accuracy at the hospital level and across the UK.

Limitations to study

In this study, patients were only followed up for a 12-month period. Thus, we may have missed some delayed non-elective hospital admissions. Furthermore, due to the real-world nature of the study, angiography was not performed in all patients to definitively confirm the presence or absence of obstructive CAD. As such, in the case of the absence of angiography, an outcome was assigned based on the stress echocardiogram result and clinical status of the patient during the follow-up period, using methods designed to assign outcomes with missing data [38, 39]. However, the statistical risk of misclassifying a stress echocardiogram as FN when disease was, in fact, present is arguably minimised by the risk of misclassification of stress echocardiograms as FP when disease is not present. Additionally, the costs utilised in this analysis rely on NHS cost codes rather than actual costs to each hospital. Also, due to the nature of the consent process there may be a selection bias amongst the study population compared with other studies using registry or audit data. Finally, while this observational study provides data regarding downstream cost of stress echocardiography, it is unable to provide data on cost effectiveness compared with other clinical management approaches. Given the findings of the ISCHEMIA study, future prospective randomized controlled trials would be of interest to evaluate the role of imaging in decision making and the current manuscript should provide baseline data against which cost savings can be compared.

Conclusion

Our study provides the first real world downstream costs associated with performance of stress echocardiography. The analysis identified which individuals were at a higher risk of an incorrect stress echocardiogram (notably male sex, hypertension, diabetes, and presence of resting RWMAs) within a broad representative population of England and therefore may require more detailed attention during imaging tests. Furthermore, we have identified that provider workload and experience impact accuracy of stress echocardiogram diagnosis in real world practice. This finding highlights the importance of workforce planning and training in delivery of imaging tests Finally, our findings may be used to assess the actual value for money of innovations that increase cardiac imaging accuracy and support realistic planning of the clinical pathway.

Availability of data and materials

The relevant data underlying this article will be shared on reasonable request to the corresponding author.

Change history

  • 08 June 2023

    The title lacked a letter in "centre" due to a technical error, this article has been updated.

Abbreviations

BMI:

Body Mass Index

BSE-NSTEP:

British Society of Echocardiography: National Review of Stress Echocardiography Practice

CABG:

Coronary Artery Bypass Graft

CAD:

Coronary artery disease

ESC:

European Society of Cardiology

FN:

False negative

FP:

False positive

ICA:

Invasive coronary angiogram

IMD:

Index of Multiple Deprivation

MACE:

Major Adverse Cardiovascular Events

MI:

Myocardial infarction

NHS:

National Health Service

NICE:

National Institute for Health and Care Excellence

ONS:

Office for National Statistics

PCI:

Percutaneous Coronary Intervention

RWMAs:

Regional wall motion abnormalities

TN:

True negative

TP:

True positive

References

  1. Heart & Circulatory Disease Statistics 2022. In: Foundation BH, editor. Compendium 2022. Brisith Heart Foundation: British Heart Foundation; 2022.

  2. Janne d’Othée B, Siebert U, Cury R, Jadvar H, Dunn EJ, Hoffmann U. A systematic review on diagnostic accuracy of CT-based detection of significant coronary artery disease. Eur J Radiol. 2008;65(3):449–61.

    Article  PubMed  Google Scholar 

  3. Parker MW, Iskandar A, Limone B, Perugini A, Kim H, Jones C, et al. Diagnostic accuracy of cardiac positron emission tomography versus single photon emission computed tomography for coronary artery disease. Circulation. 2012;5(6):700–7.

    PubMed  Google Scholar 

  4. Yang K, Yu S-Q, Lu M-J, Zhao S-H. Comparison of diagnostic accuracy of stress myocardial perfusion imaging for detecting hemodynamically significant coronary artery disease between cardiac magnetic resonance and nuclear medical imaging: a meta-analysis. Int J Cardiol. 2019;293:278–85.

    Article  PubMed  Google Scholar 

  5. Woodward W, Dockerill C, McCourt A, Upton R, O’Driscoll J, Balkhausen K, et al. Real-world performance and accuracy of stress echocardiography: the EVAREST observational multi-centre study. Eur Heart J Cardiovasc Imaging. 2022;23(5):689–98.

    Article  PubMed  Google Scholar 

  6. Recent-onset chest pain of suspected cardiac origin: assessment and diagnosis; Clinical Guidance CG95. National Institute for Health and Care Excellence (NICE); 2016 30 November 2016.

  7. Dr Ed Nicol DSP, Dr Giles Roditi, Professor Carl Roobottom. The challenge of national CT Coronary Angiography (CTCA) provision in response to NICE CG95 update 2016. British Society of Cardiology; 2016.

  8. Dreisbach JG, Nicol ED, Roobottom CA, Padley S, Roditi G. Challenges in delivering computed tomography coronary angiography as the first-line test for stable chest pain. Heart. 2018;104(11):921–7.

    Article  PubMed  Google Scholar 

  9. Bhattacharyya S, Chehab O, Khattar R, Lloyd G. Stress echocardiography in clinical practice: a United Kingdom National Health Service Survey on behalf of the British Society of Echocardiography. Eur Heart J. 2014;15(2):158–63.

    Google Scholar 

  10. Wennike N, Shah BN, Boger E, Senior R, Greaves K. Stress echocardiography in the district hospital setting: a cost-saving analysis. Eur J Echocardiogr. 2010;11(5):401–5.

    Article  PubMed  Google Scholar 

  11. Picano E, Molinaro S, Pasanisi E. The diagnostic accuracy of pharmacological stress echocardiography for the assessment of coronary artery disease: a meta-analysis. Cardiovasc Ultrasound. 2008;6:30.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Bedetti G, Pasanisi EM, Pizzi C, Turchetti G, Loré C. Economic analysis including long-term risks and costs of alternative diagnostic strategies to evaluate patients with chest pain. Cardiovasc Ultrasound. 2008;6(1):21.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Thom H, West NEJ, Hughes V, Dyer M, Buxton M, Sharples LD, et al. Cost-effectiveness of initial stress cardiovascular MR, stress SPECT or stress echocardiography as a gate-keeper test, compared with upfront invasive coronary angiography in the investigation and management of patients with stable chest pain: mid-term out. BMJ Open. 2014;4(2):e003419.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Papachristidis A, Demarco DC, Roper D, Tsironis I, Papitsas M, Byrne J, et al. The safety, efficacy and cost-effectiveness of stress echocardiography in patients with high pretest probability of coronary artery disease. Open Heart. 2017;4(2): e000605.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Knuuti J, Wijns W, Saraste A, Capodanno D, Barbato E, Funck-Brentano C, et al. 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes: The Task Force for the diagnosis and management of chronic coronary syndromes of the European Society of Cardiology (ESC). Eur Heart J. 2020;41(3):407–77.

    Article  PubMed  Google Scholar 

  16. Woodward W, McCourt A, Dockerill C, Ayres L, Augustine D, O'Driscoll J, et al. Real-world use and accuracy of stress echocardiography: preliminary insights from the EVAREST study. European Heart Journal. 2020;41(Supplement_2).

  17. England N. [Excel Document]. https://www.england.nhs.uk/statistics/wp-content/uploads/sites/2/2019/11/Beds-Open-Overnight-Web_File-Final-Q1-201920.xlsx.

  18. Digital N. [Excel Document]. https://files.digital.nhs.uk/A4/81A55C/hosp-epis-stat-outp-pla-2018-19-tab%20v2.xlsx.

  19. Asher C, Puyol-Anton E, Rizvi M, Ruijsink B, Chiribiri A, Razavi R, et al. The role of AI in characterizing the DCM phenotype. Front Cardiovasc Med. 2021;8: 787614.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Asher A, Ghelani R, Thornton G, Rathod K, Jones D, Wragg A, et al. UK perspective on the changing landscape of non-invasive cardiac testing. Open Heart. 2019;6(2): e001186.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Premaratne M, Yip B, Sefhore O, Sriamareswaran R, Yeap A, Lefkovits L, et al. Diabetes is an independent predictor of false negative stress echocardiography. Heart Lung Circ. 2016;25:S225.

    Article  Google Scholar 

  22. Elhendy A, Geleijnse Ml Fau - van Domburg RT, van Domburg Rt Fau - Nierop PR, Nierop Pr Fau - Poldermans D, Poldermans D Fau - Bax JJ, Bax Jj Fau - TenCate FJ, et al. Gender differences in the accuracy of dobutamine stress echocardiography for the diagnosis of coronary artery disease. (0002–9149 (Print)).

  23. Rachwan RJ, Mshelbwala FS, Dardari Z, Batal O. False-positive stress echocardiograms: predictors and prognostic relevance. Int J Cardiol. 2019;296:157–63.

    Article  PubMed  Google Scholar 

  24. Shin J-H, Shiota T, Kim Y-J, Kwan J, Qin JX, Eto Y, et al. False-positive exercise echocardiograms: impact of sex and blood pressure response. Am Heart J. 2003;146(5):914–9.

    Article  PubMed  Google Scholar 

  25. From AM, Kane G, Bruce C, Pellikka PA, Scott C, McCully RB. Characteristics and outcomes of patients with abnormal stress echocardiograms and angiographically mild coronary artery disease (< 50% stenoses) or normal coronary arteries. J Am Soc Echocardiogr. 2010;23(2):207–14.

    Article  PubMed  Google Scholar 

  26. Guerreiro RA, Fazendas P, Pereira AR, Marques A, Pais J, Alegria S, et al. Clinical and echocardiographic characterization of false-positive results from stress echocardiography. J Cardiovasc Imaging. 2020;28(2):123–33.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Ha JW, Juracan EM, Mahoney DW, Oh JK, Shub C, Seward JB, et al. Hypertensive response to exercise: a potential cause for new wall motion abnormality in the absence of coronary artery disease. J Am Coll Cardiol. 2002;39(2):323–7.

    Article  PubMed  Google Scholar 

  28. Marcovitz PA, Armstrong WF. Accuracy of dobutamine stress echocardiography in detecting coronary artery disease. (0002–9149 (Print)).

  29. Morley C, Unwin M, Peterson GM, Stankovich J, Kinsman L. Emergency department crowding: a systematic review of causes, consequences and solutions. PLoS ONE. 2018;13(8):e0203316-e.

    Article  Google Scholar 

  30. Picano E, Lattanzi F, Orlandini A, Marini C, L’Abbate A. Stress echocardiography and the human factor: the importance of being expert. J Am Coll Cardiol. 1991;17(3):666–9.

    Article  CAS  PubMed  Google Scholar 

  31. Upton R, Mumith A, Beqiri A, Parker A, Hawkes W, Gao S, et al. Automated echocardiographic detection of severe coronary artery disease using artificial intelligence. JACC Cardiovasc Imaging. 2022;15(5):715–27.

    Article  PubMed  Google Scholar 

  32. Ltd. U. PROTEUS: Evaluating the Use of Artificial Intelligence to Support Stress Echocardiography Testing for Heart Disease (PROTEUS). ClinicalTrialsgov identifier: NCT05028179.

  33. Labovitz AJ. The "myth" of the false positive stress echo. (1097–6795 (Electronic)).

  34. Cho IA-O. False-positive Stress Echocardiography: Not as Simple as It Looks. (2586–7296 (Electronic)).

  35. Gurunathan S, Ahmed A, Vamvakidou A, Ramzy IS, Akhtar M, Ali A, et al. Diagnostic concordance and clinical outcomes in patients undergoing fractional flow reserve and stress echocardiography for the assessment of coronary stenosis of intermediate severity. J Am Soc Echocardiogr. 2018;31(2):180–6.

    Article  PubMed  Google Scholar 

  36. Gilchrist I, Foy A, Davidson W. A false-positive stress echocardiogram is not the same as a negative result. J Am Coll Cardiol. 2017;69(11):1426.

    Article  Google Scholar 

  37. Kamalesh M, Matorin R, Sawada S. Prognostic value of a negative stress echocardiographic study in diabetic patients. Am Heart J. 2002;143(1):163–8.

    Article  PubMed  Google Scholar 

  38. Altman DG, Bland JM. Missing data. BMJ. 2007;334(7590):424.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clnical measurement. Lancet. 1986;327(8476):307–10.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to express gratitude to the funders of this study. Additionally, the authors would like to thank all EVAREST/BSE-NSTEP investigators as well as participating patients without whom this work would not be possible.

EVAREST/BSE-NSTEP Investigators: Paul Leeson1, Roxy Senior3, Jacob Easaw4, Daniel X. Augustine4, Keith Pearce8, Rajan Sharma10, Abraheem Abraheem13, Sanjay Banypersad14, Christopher Boos15, Sudantha Bulugahapitiya16, Jeremy Butts17, Duncan Coles18, Thuraia Nageh18, Haytham Hamdan19, Ayyaz Sultan19, Shahnaz Jamil-Copley20, Gajen Kanaganayagam21, Tom Mwambingu22, Antonis Pantazis23, Alexandros Papachristidis24, Ronak Rajani25, Muhammad Amer Rasheed26, Naveed A. Razvi27, Sushma Rekhraj20, David P. Ripley28, Kathleen Rose29, Michaela Scheuermann-Freestone30, Rebecca Schofield31, Spyridon Zidros32, Kenneth Wong33, Sarah Fairbarin34, Badrinathan Chandrasekaran35, Maria Paton36, Patrick Gibson37, Attila Kardos38, Henry Boardman38, Joanna d’Arcy38, Katrin Balkhausen39, Ioannis Moukas40, Joban S. Sehmi41, Soroosh Firoozan42

13Tameside and Glossop Integrated Care NHS Foundation Trust, Ashton-under-Lyne, UK. 14East Lancashire Hospitals NHS Trust, Burnley, UK. 15Poole Hospital NHS Foundation Trust, Poole, UK. 16Bradford Teaching Hospitals NHS Foundation Trust, Bradford, UK. 17Calderdale and Huddersfield NHS Foundation Trust, Calderdale, UK. 18Mid and South Essex NHS Foundation Trust, UK. 19Wrightington, Wigan and Leigh NHS Foundation Trust, UK. 20Nottingham University Hospitals NHS Trust, UK. 21Chelsea and Westminster Hospital NHS Foundation Trust, UK. 22The Mid Yorkshire Hospitals NHS Trust, UK. 23North Middlesex University Hospital NHS Trust, UK. 24King's College Hospital NHS Foundation Trust, UK. 25Guy’s and St Thomas’ NHS Foundation Trust, UK. 26Yeovil District Hospital NHS Foundation Trust, UK. 27East Suffolk and North Essex NHS Foundation Trust, UK. 28Northumbria Healthcare NHS Foundation Trust, UK. 29Northampton General Hospital NHS Trust, UK. 30Hampshire Hospitals NHS Foundation Trust, UK. 31North West Anglia NHS Foundation Trust, UK. 32Bedford Hospital NHS Trust, UK. 33Blackpool Teaching Hospitals NHS Foundation Trust, UK. 34University Hospitals Bristol and Weston NHS Foundation Trust, UK. 35Great Western Hospitals NHS Foundation Trust, UK. 36Leeds Teaching Hospitals NHS Trust, UK. 37 NHS Lothian, UK. 38Milton Keynes University Hospital NHS Foundation Trust, UK. 39Royal Berkshire NHS Foundation Trust, UK. 40Warrington and Halton Teaching Hospitals NHS Foundation Trust, UK. 41West Hertfordshire Hospitals NHS Trust, UK. 42Buckinghamshire Healthcare NHS Trust, UK.

Funding

This work was supported by National Institute for Health Research Health Education England Healthcare Science Research Fellowship [NIHR-HCS-P13-04–001]; Cardiovascular Clinical Research Facility, University of Oxford; Ultromics Ltd.; Lantheus Medical Imaging Inc. and National Institute for Health Research Oxford Biomedical Research Centre, University of Oxford. The funders of the study had no role in study design, data collection, analysis, interpretation, or writing of the report.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

PL and DXA were responsible for conceptualization of the study. PL, DXA, and AT supported study methodology. PL assisted with funding acquisition. MM, DXA, MP, JOD, DO, KP, SR, JW, PL provided supervision. WW, CD, CLJ, AM, and SK provided project administration and data curation. WW, CD, CLJ, AM, SK, DXA, JW, MP, PL, RSe, JOD, RS, and all EVAREST/BSE-NSTEP investigators provided investigation for the study. AT and WW provided and utilised software to complete formal data analysis. CLJ and AT provided data visualization of the unpublished results. WW, CLJ, AT, PL wrote and edited the original manuscript draft. WW and CLJ contributed equally to this manuscript as first authors. All authors reviewed and edited the manuscript. PL and AT contributed equally as guarantors and senior authors for this manuscript. All BSE-NSTEP/EVAREST Investigators conducted investigations for the purposes of the study.

Corresponding author

Correspondence to Paul Leeson.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was granted by the Health Research Authority NRES Committee (South Central–Berkshire) review board (IRAS reference:14/SC/1437).

Consent for publication

Not applicable.

Competing interests

All authors have completed the Unified Competing Interest form (available on request from the corresponding author) and declare: PL is founder and shareholder of Ultromics Ltd., which develops AI echocardiography software and has previously consulted for Intelligent Ultrasound and has held research grants from the Lantheus Medical Imaging and the NIHR. PL has patents in the field of echocardiography. RSe has received speaker fees from Lantheus Medical Imaging. JOD has received research funding from Ultromics Ltd. All other authors have no conflicts to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Figure S1.

Causal pathway of predictive accuracy with downstream costs.

Additional file 2: Table S1.

Average patient demographics at each hospital.

Additional file 3: Table S2.

Organisational Demographic Variation.

Additional file 4: Figure S2A

. Decision tree depicting patient downstream outcomes 12 months post-stress echocardiogram for (A) Negative Stress Echocardiogram.

Additional file 5: Figure S2B.

Decision tree depicting patient downstream outcomes 12 months post-stress echocardiogram for (B) Positive Stress Echocardiogram.

Additional file 6: Figure S3.

(A) Factors associated with a correct stress echo; (B) Factors associated with a false stress echo diagnosis.

Additional file 7: Figure S4.

Association of a correct stress echocardiogram diagnosis with non-elective hospital admissions.

Additional file 8: Figure S5.

Association of false stress echocardiogram diagnoses with non-elective hospital admissions.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Johnson, C.L., Woodward, W., McCourt, A. et al. Real world hospital costs following stress echocardiography in the UK: a costing study from the EVAREST/BSE-NSTEP multi-centre study. Echo Res Pract 10, 8 (2023). https://doi.org/10.1186/s44156-023-00020-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s44156-023-00020-1

Keywords