Validation of aortic valve pressure gradient quantification using semi-automated 4D flow CMR pipeline
BMC Research Notes volume 15, Article number: 151 (2022)
Doppler echocardiographic aortic valve peak velocity and peak pressure gradient assessment across the aortic valve (AV) is the mainstay for diagnosing aortic stenosis. Four-dimensional flow cardiovascular magnetic resonance (4D flow CMR) is emerging as a valuable diagnostic tool for estimating the peak pressure drop across the aortic valve, but assessment remains cumbersome.
We aimed to validate a novel semi-automated pipeline 4D flow CMR method of assessing peak aortic value pressure gradient (AVPG) using the commercially available software solution, CAAS MR Solutions, against invasive angiographic methods.
We enrolled 11 patients with severe AS on echocardiography from the EurValve programme. All patients had pre-intervention doppler echocardiography, invasive cardiac catheterisation with peak pressure drop assessment across the AV and 4D flow CMR.
The peak AVPG was 51.9 ± 35.2 mmHg using the invasive pressure drop method and 52.2 ± 29.2 mmHg for the 4D flow CMR method (semi-automated pipeline), with good correlation between the two methods (r = 0.70, p = 0.017).
Assessment of AVPG by 4D flow CMR using the novel semi-automated pipeline method shows excellent agreement to invasive assessment when compared to doppler-based methods and advocate for its use as complementary to echocardiography.
Aortic stenosis (AS) is the most common valvular heart disease , affecting nearly 10% of people over the age of 80 years . With its prevalence increasing with age, 2 year survival rates can be less than 50% in symptomatic subjects with reduced cardiac function, unless the valve is replaced . With no medical therapy proven to attenuate progression or improve survival , temporising balloon valvuloplasty may be required as a bridge to a definitive valvular replacement, which is performed either surgically (SAVR) or using a transcatheter approach (TAVR). Balancing the risk between operative mortality and post-replacement complications against the likelihood of disease progression and cardiovascular death is essential in determining the appropriateness and timing of intervention. Several imaging modalities can be used to evaluate valve anatomy, haemodynamics, and the morphological sequelae of disease, which alongside objective measures of functional limitation, can be used to grade severity.
Transthoracic echocardiography (TTE) is the first-line investigation to assess the severity of AS and its impact on haemodynamics and LV function .
Four-dimensional (4D) flow cardiovascular magnetic resonance (CMR) imaging is emerging as a valuable non-invasive imaging technique that circumvents many of the echocardiographic limitations such as Doppler misalignment and geometric assumptions . Validation studies on manual 4D flow CMR assessment demonstrated comparable estimates between 4D flow CMR and invasive assessment methods but highlighted the requirement for significant acquisition and post-processing competence . Intending to progress the evolution of advanced imaging techniques into streamlined tools for clinical practice, we aimed to validate the 4D flow CMR (semi-automated pipeline) method of assessing peak aortic valve pressure gradient (AVPG) against the reference invasive pressure drop method and two other methods of peak AVPG quantification (TTE and 4D flow CMR with the manual assessment of AVPG). We also performed reproducibility analyses for the novel semi-automated pipeline 4D flow CMR method of peak AVPG assessment.
Materials and methods
11 subjects from the EurValve programme with suspected severe aortic stenosis on echocardiography were included . All subjects had pre-TAVI/SAVR peak AVPG assessment with TTE, invasive cardiac catheterisation, and 4D flow CMR.
Ethical approval was provided by the National Research Ethics Service, United Kingdom (17/LO/0283). Informed written consent was obtained from all subjects.
Non-CMR assessment of peak AVPG
Transthoracic echocardiography was performed according to the British Society of Echocardiography guidelines . Severity grading of aortic stenosis was performed as per the European Society of Cardiology (ESC) consensus guidelines .
Invasive pressure gradients were obtained during cardiac catheterisation in all patients as part of routine care before TAVI/SAVR. Full details of the procedure to invasively assess peak AVPG are presented in Additional file 1: (item 1) and previously published reports . Manual 4D flow CMR assessment was performed in MASS (version 2019 EXP, LUMC Netherlands). The semi-automated pipeline 4D flow CMR assessment was performed in CAAS (prototype version 5.2.1, Pie Medical Imaging, the Netherlands).
CMR was performed on a 3.0 Tesla Phillips Healthcare Ingenia system equipped with a 28-channel coil and Phillips dStream digital broadband MR architecture technology.
The CMR protocol included baseline surveys, cines (vertical long-axis, horizontal long-axis, short-axis contiguous left-ventricle volume stack, 3-chamber, and aortic root). Cine images were acquired during end-expiratory breath-holds with a balanced steady-state free precession, single-slice breath-hold sequence. Procedures relating to 4D flow CMR pre-processing were delivered in accordance with established standards of practice . Technical parameters for the CMR protocol are presented in Additional file 1: (items 2 and 3).
4D flow CMR assessment of AVPG
Post-processing and analysis were computed using CAAS MR Solutions (prototype version 5.2.1, Pie Medical Imaging, the Netherlands). Two assessors with at least two years of CMR experience independently calculated peak AVPG using the novel semi-automated pipeline method (CGC, PG). CGC repeated the analysis after four weeks, blinded to the results of the first analysis for intraobserver reproducibility analysis. When calculating peak AVPG, the assessors was blinded from the results of TTE and invasive assessments.
Two methods involving 4D flow CMR were used to determine peak AVPG. The manual method, as described in Archer et al. , and a novel semi-automated pipeline method. For both methods, aliasing correction was performed automatically in all three-phase directions. Any spatial misalignment with cine superimposition was manually corrected throughout the cardiac cycle before quantification.
The manual method involved plotting several multi-planar slices above the valvular plane to assess the quality of flow curves in the region of the vena contracta. The reformatted plane with the highest velocity and no artefact was then used to determine the peak pressure drop, calculated using the simplified Bernoulli Eq. (4Vmax2). This method is rigorously described within a previously published report .
The novel automated pipeline 4D flow CMR evaluation of AVPG involved three steps which are detailed in Fig. 1.
All continuous parameters are reported as mean ± standard deviation (SD). Correlation between TTE, 4D flow CMR (manual method), 4D flow CMR (semi-automated pipeline method) and the reference invasive pressure drop assessment were calculated using Pearson’s correlation coefficient. Agreement between the four methods was calculated using Bland–Altman statistics, where the mean difference between the two methods was reported as the relative risk of bias (measured in mmHg). The Shapiro–Wilk test assessed the normality of data. Since the data was normally distributed, parametric two-tailed paired samples t-test were used between peak AVPG assessment using invasive measures compared with TTE and the two 4D flow CMR methods. Interobserver and intraobserver variability were assessed using the interclass correlation coefficient (ICC). For all analyses, p < 0.05 was deemed to be statistically significant.
11 subjects underwent peak AVPG assessment using TTE, cardiac catheterisation, and 4D flow CMR. The mean age of subjects was 80 ± 6 years. All subjects were male (n = 11). The mean NYHA class of subjects was 2 (range 1–3). Detailed clinical and imaging characteristics are provided in Additional file 1: (item 4). All CMR studies were of good imaging quality and there were no notable technical difficulties in 4D flow CMR analyses.
The mean peak AVPG was 51.9 ± 35.2 mmHg using the invasive pressure drop method. The mean peak AVPG was 66.7 ± 34.8, 53.7 ± 23.6 and 52.2 ± 29.2 mmHg for TTE, 4D flow CMR (manual method) and 4D flow CMR (semi-automated pipeline method), respectively (Additional file 1: item 5).
Validation of AVPG assessment using 4D flow CMR (novel automated pipeline)
The mean peak pressure gradient derived from the semi-automated pipeline 4D flow CMR method was comparable to the invasive pressure gradient method (52.2 ± 29.2 versus 51.9 ± 35.2 mmHg) with minimal bias between the two methods (bias = 0.3 mmHg, p = 0.974). 4D flow CMR (semi-automated pipeline) method of peak AVPG showed good correlation to the invasive pressure drop method (r = 0.70, p = 0.017) (Table 1).
Compared with invasive assessment, the most strongly correlated method of peak pressure gradient was TTE (r = 0.95, p < 0.001) followed by 4D flow CMR (semi-automated pipeline method; r = 0.70, p = 0.02) and then 4D flow CMR (manual method; r = 0.63, p = 0.04) (Fig. 2). The two methods of 4D flow CMR derived peak pressure gradient were strongly correlated to each other (r = 0.94, p < 0.001), but showed modest correlation to TTE (manual method, r = 0.61, p = 0.04; semi-automated pipeline method, r = 0.62, p = 0.04).
Compared with invasive assessment, the method demonstrating the lowest bias was 4D flow CMR semi-automated pipeline method (bias = −0 .3 mmHg, p = 0.974) followed by 4D flow CMR manual method (bias = 1.8 mmHg, p = 0.836) (Fig. 2). TTE demonstrated significant bias when compared to invasively derived peak pressure gradients (bias = 14.8 mmHg, p = 0.001).
Interobserver and intraobserver reproducibility
Interobserver reproducibility analysis between two independent assessors demonstrated excellent agreement in peak pressure gradient assessment using the semi-automated pipeline 4D flow CMR method (ICC 0.98, 95% CI 0.92–0.99).
Intraobserver reproducibility analysis between two blinded readings from one assessor demonstrated excellent agreement in peak pressure gradient assessment using the semi- automated pipeline 4D flow CMR method (ICC 0.99, 95% CI 0.99–1.00).
This study provides the first validation of a novel semi-automated pipeline method of aortic valve peak pressure gradient assessment by 4D flow CMR against transthoracic echocardiography and the reference standard, cardiac catheterisation, for subjects with severe aortic stenosis. We have identified that automated pipeline aortic valve peak pressure gradient assessment by 4D flow CMR demonstrates superior agreement to invasively measured pressure gradient when compared to echocardiography and 4D flow CMR (manual method). Consistent with other studies [7, 10], we also identified a systematic bias between Doppler and invasive measures for the assessment of peak pressure drop across the aortic valve, and therefore recommend the use of 4D flow CMR to corroborate and sense-check the metrics from echocardiography in challenging or discrepant cases. It is important to reinforce that echocardiography should remain the key technique through which the diagnosis of valvular heart diseases is screened, and the progression of disease is monitored. Echocardiography, in the assessment of thin and mobile valve leaflets, offers excellent spatial and temporal resolution, which considered alongside its low cost and accessibility, makes it an incredibly valuable diagnostic tool in patients with suspected aortic disease. 4D flow CMR assessment has clear benefits. For instance, visualisation of blood flow (i.e., streamlines / pathlines) permits the modelling of complex 3D flow jet patterns and haemodynamic changes associated with aortic stenosis . An additional benefit of 4D flow CMR is the ability to retrospectively and flexibly visualise and quantify blood flow without being restricted to 2D plane and view angles. Since it is common for systolic flow jets in AS to be eccentric, 4D flow CMR offers a significant benefit over TTE in that it is not hindered by flow eccentricity . 4D-flow CMR offers multidirectional velocity-encoding which allows for quantification of velocities regardless of the spatial orientation of the flow jet.
A recent cohort study comparing 2D and 4D flow CMR with TTE in patients with severe aortic stenosis showed that 4D flow CMR significantly underestimates systolic peak flow velocity . Our study provides a different perspective, as we included a comparison with the gold-standard reference, invasive assessment. Our study suggests it is rather that TTE overestimates systolic peak flow volume, rather than 4D flow CMR underestimating it, as the latter demonstrates excellent concordance to invasive assessment with minimal bias. It is recognised that peak aortic jet velocity assessment using echocardiography is user dependent and carries several pitfalls that may result in under- or overestimated of stenosis severity . For instance, misalignment of the Doppler beam with the AS jet risks substantial underestimation of aortic velocity. A further limitation of echocardiography is that aortic jet velocity is highly flow dependent. This has the potential to lead to profound overestimation of AS severity in high-flow states (e.g., concomitant aortic regurgitation, severe anaemia, or thyrotoxicosis). Other common limitations to echocardiography include poor acoustic quality,
In addition to the comparable agreement and precision of the semi-automated pipeline 4D flow CMR method to the manual 4D flow CMR method, there was a notable difference in the processing time to obtain the peak AVPG value in the former, taking on average 4 min per subject to quantify, in comparison to 20 min using the equivalent manual 4D flow CMR method. This operational outcome, alongside the reduced technical and post-processing competence required of the operator in using the semi-automated pipeline method, is notable, given the need to streamline and simplify the complex acquisition and post-processing procedures for routine clinical practice.
We included only a small number of subjects included within the analyses. It is important for larger studies to be performed to corroborate and evolve our findings. There is a need for same-day dual-modality echo-MRI studies to allow for greater confidence in the results of agreement analyses, in addition to determining the performance of techniques, either in isolation or in tandem, within the clinical setting. Caution also needs to be made to the fact the manual 4D flow CMR assessment of peak AVPG was performed in MASS (version 2019 EXP, LUMC, The Netherlands), whereas the semi-automated pipeline 4D flow CMR method was used within CAAS. The former is not licensed for commercial use, whereas CAAS is. Furthermore, there have been no studies evaluating the concordance between manual peak AVPG assessment between CAAS and MASS. MASS does not currently offer a semi-automated pipeline method for peak AVPG assessment.
Availability of data and materials
The datasets generated and analysed during the current study are available in the Harvard repository, https://doi.org/10.7910/DVN/OLOH39.
Aortic valve pressure gradient
Cardiovascular magnetic resonance
European Society of Cardiology
Interclass correlation coefficient
New York heart association
Surgical aortic valve replacement
Trans-aortic valve replacement
Iung B, Baron G, Butchart EG, et al. A prospective survey of patients with valvular heart disease in Europe: the euro heart survey on valvular heart disease. Eur Heart J. 2003;24:1231–43.
Eveborn GW, Schirmer H, Heggelund G, Lunde P, Rasmussen K. The evolving epidemiology of valvular aortic stenosis the Tromsø study. Heart Br Card Soc. 2013;99:396–400.
Aronow WS, Ahn C, Kronzon I, Nanna M. Prognosis of congestive heart failure in patients aged > or = 62 years with unoperated severe valvular aortic stenosis. Am J Cardiol. 1993;72:846–8.
Marquis-Gravel G, Redfors B, Leon MB, Généreux P. Medical treatment of aortic stenosis. Circulation. 2016;134:1766–84.
Baumgartner H, Falk V, Bax JJ, et al. 2017 ESC/EACTS guidelines for the management of valvular heart disease. Eur Heart J. 2017;38:2739–91.
Garcia J, Barker AJ, Markl M. The role of imaging of flow patterns by 4D Flow MRI in aortic stenosis. JACC Cardiovasc Imaging. 2019;12:252–66.
Archer GT, Elhawaz A, Barker N, et al. Validation of four-dimensional flow cardiovascular magnetic resonance for aortic stenosis assessment. Sci Rep. 2020;10:10569.
Wharton G, Steeds R, Allen J, et al. A minimum dataset for a standard adult transthoracic echocardiogram: a guideline protocol from the British Society of Echocardiography. Echo Res Pract. 2015;2:G9–24.
Dyverfeldt P, Bissell M, Barker AJ, et al. 4D flow cardiovascular magnetic resonance consensus statement. J Cardiovasc Magn Reson. 2015;17:72.
Parameswaran AC, Reisner D, Amanullah A. Discrepancy between gradients derived by cardiac catheterization and by doppler echocardiography in aortic stenosis: how often does pressure recovery play a role? Echocardiogr. 2009. https://doi.org/10.1111/j.1540-8175.2009.00909.x.
Adriaans BP, Westenberg JJM, van Cauteren YJM, et al. Clinical assessment of aortic valve stenosis: comparison between 4d flow mri and transthoracic echocardiography. J Magn Reson Imaging. 2020;51:472–80.
Hälvä R, Vaara SM, Peltonen JI, et al. Peak flow measurements in patients with severe aortic stenosis: a prospective comparative study between cardiovascular magnetic resonance 2D and 4D flow and transthoracic echocardiography. J Cardiovasc Magn Reson. 2021;23:132.
Baumgartner chair H, Hung co-chair J, Bermejo J, et al. Recommendations on the echocardiographic assessment of aortic valve stenosis: a focused update from the European Association of Cardiovascular imaging and the American Society of Echocardiography. Eur Heart J Cardiovasc Imaging. 2017;18:254–75.
This work was partly funded by Wellcome Trust grants (220703/Z/20/Z and 215799/Z/19/Z). For the purpose of open access, the author has applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission.
Ethics approval and consent to participate
Ethical approval was provided by the National Research Ethics Service, United Kingdom (17/LO/0283). Informed written consent was obtained from all subjects before participation. The study complied with the Declaration of Helsinki.
Consent for publication
PG is a clinical advisor for Pie Medical Imaging and Medis Medical Imaging. All other authors have no competing interests to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
: Item 1: Invasive pressure gradient assessment. Item 2: CMR protocol technical parameters. Item 3: 4D flow CMR acquisition procedures. Item 4: Baseline characteristics. Item 5: Peak aortic value pressure gradient across the four methods of assessment.
About this article
Cite this article
Grafton-Clarke, C., Njoku, P., Aben, JP. et al. Validation of aortic valve pressure gradient quantification using semi-automated 4D flow CMR pipeline. BMC Res Notes 15, 151 (2022). https://doi.org/10.1186/s13104-022-06033-z
- Aortic stenosis
- Cardiac MRI