Article Text
Abstract
Introduction This meta-analysis aims to evaluate the agreement and correlation between phase-resolved functional lung MRI (PREFUL MRI) and dynamic contrast-enhanced (DCE) MRI in evaluating perfusion defect percentage (QDP), as well as the agreement between PREFUL MRI and 129Xe MRI in assessing ventilation defect percentage (VDP).
Method A systematic search was conducted in the Medline, Embase and Cochrane Library databases to identify relevant studies comparing QDP and VDP measured by DCE MRI and 129Xe MRI compared with PREFUL MRI. Meta-analytical techniques were applied to calculate the pooled weighted bias, limits of agreement (LOA) and correlation coefficient. The publication bias was assessed using Egger’s regression test, while heterogeneity was assessed using Cochran’s Q test and Higgins I2 statistic.
Results A total of 399 subjects from 10 studies were enrolled. The mean difference and LOA were −2.31% (−8.01% to 3.40%) for QDP and 0.34% (−4.94% to 5.62%) for VDP. The pooled correlations (95% CI) were 0.65 (0.55 to 0.73) for QDP and 0.72 (0.61 to 0.80) for VDP. Furthermore, both QDP and VDP showed a negative correlation with forced expiratory volume in 1 s (FEV1). The pooled correlation between QDP and FEV1 was −0.51 (−0.74 to −0.18), as well as between VDP and FEV1 was −0.60 (−0.73 to −0.44).
Conclusions PREFUL MRI is a promising imaging for the assessment of lung function, as it demonstrates satisfactory deviations and LOA when compared with DEC MRI and 129Xe MRI.
PROSPERO registration number CRD42023430847.
- Cystic Fibrosis
- Imaging/CT MRI etc
- Non invasive ventilation
- Respiratory Function Test
Data availability statement
Data are available upon reasonable request.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
WHAT IS ALREADY KNOWN ON THIS TOPIC
The phase-resolved functional lung (PREFUL) MRI has been demonstrated to quantitatively assess pulmonary perfusion and ventilation during free breathing and without contrast agents. However, the comparability of derived parameters from PREFUL MRI with dynamic contrast-enhanced MRI and 129Xe MRI remains unknown.
WHAT THIS STUDY ADDS
The PREFUL MRI demonstrates high accuracy and good consistency in quantifying pulmonary perfusion defects and ventilation defects, showing a strong correlation with existing clinically reliable methods. It holds promise as a long-term pulmonary function assessment method for patients with chronic lung diseases.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
The application of PREFUL MRI in pulmonary diseases provides patients with a convenient and non-invasive method for lung functional imaging, enabling early diagnosis and treatment assessment of pulmonary conditions.
Introduction
Pulmonary diseases are closely linked to structural changes in the lungs, making morphological evaluation crucial for patient assessment. However, during the early stages, the disease process predominantly affects pulmonary function while exhibiting limited modifications in pulmonary morphology.1 Spirometry is widely used to assess the ventilatory function, which provides a global assessment of lung function but exhibits limited sensitivity to early functional changes.2 Lung functional imaging provides the capability to identify regional lung lesions, enabling enhanced evaluation of lung diseases prior to the manifestation of global functional and morphological alterations.3 Chronic obstructive pulmonary disease (COPD) is a heterogeneous disease, and patients with different phenotypes respond differently to therapeutic drugs. Functional lung imaging contributes to the analysis of disease phenotypes in patients with COPD, providing potential benefits for drug screening and optimising treatment.4
The development of hyperpolarised noble gas MRI imaging as a viable technique for ventilation imaging has been underway.5 6 Such using 129Xe ventilation MRI, it is possible to calculate the ventilation defect percentage (VDP), which represents the proportion of the lung that is non-ventilated.7 VDP has been proven to be a reliable and sensitive clinical outcome measure for assessing longitudinal lung disease changes in patients with cystic fibrosis (CF).8 9 Nevertheless, the clinical adoption of this technique has been limited due to its reliance on specialised polariser equipment. Dynamic contrast-enhanced (DCE) MRI is commonly used to assess pulmonary perfusion and volume, enabling quantification of the perfusion defect percentage (QDP).10 11 DCE MRI has demonstrated its capability to offer quantitative assessments and has been successfully employed in the evaluation of various diseases, including COPD, CF and chronic thromboembolic pulmonary hypertension (CTEPH).11–13 Furthermore, DCE MRI has been demonstrated to discriminate idiopathic pulmonary fibrosis (IPF) and serve as a biomarker for the progression of IPF disease.14 However, DCE MRI requires breath holding and injection of a gadolinium-containing contrast agent, and the long-term effects of gadolinium deposition in the brain are unknown.15
Fourier decomposition (FD) MRI has been shown to provide quantitative assessment of pulmonary ventilation under free breathing and without the need for contrast media.16 Recently, a postprocessing technique, phase-resolved functional lung (PREFUL) imaging, has been introduced to enhance temporal resolution and enable the quantitative evaluation of regional perfusion and ventilation dynamics.17 Distinguishing from FD MRI, PREFUL is different in several aspects: first, PREFUL performs perfusion/ventilation filtering with broad high-pass/low-pass filtering, while FD employs peak integration; second, PREFUL computes ventilation amplitudes in the time domain, contrasting with FD’s frequency domain computation; additionally, PREFUL sorts images based on their phase to reconstruct cardiac/ventilation cycles with enhanced temporal resolution.17 18 Extensive investigations have demonstrated consistent measurement outcomes between PREFUL MRI and DCE MRI in detecting regional pulmonary QDP across various lung diseases.11 19 20 Similarly, there is concordance between PREFUL MRI and 129Xe MRI in assessing regional VDP.21 Additionally, prior studies have revealed a significant correlation between PREFUL MRI and spirometry-derived forced expiratory volume in 1 s (FEV1).13 20 21 Although multiple studies have evaluated the accuracy of PREFUL MRI in assessing lung function, each study included only a small number of patients, necessitating caution in making generalisations and broader interpretations.
Therefore, the primary objective of this meta-analysis was to systematically assess the agreement and correlation of PREFUL MRI with DCE MRI and 129Xe MRI of lung function parameters. Additionally, we also assessed the correlation of QDP and VDP derived from PREFUL MRI with the FEV1 derived from spirometry.
Methods
This study followed the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.22 This study was registered in PROSPERO with ID number CRD42023430847.
Search strategy
A systematic search was conducted in Medline, Embase and Cochrane Library databases to identify relevant articles that compared QDP and VDP as measured by PREFUL MRI, DCE MRI and 129Xe MRI. The search was limited to articles published until 27 October 2023. Two authors independently carried out the search process, and any discrepancies were resolved through mutual agreement and consensus.
An exhaustive search of the literature was conducted using a combination of keywords, either in MeSH or ‘free text’ terms: ‘phase-resolved functional lung magnetic resonance imaging’ OR ‘PREFUL MRI’ OR ‘free‐breathing proton magnetic resonance imaging’ OR ‘free-breathing 1H magnetic resonance imaging’ OR ‘dynamic contrast‐enhanced magnetic resonance imaging’ OR ‘DCE MRI’ OR ‘129Xe magnetic resonance imaging’ OR ‘129Xe MRI’ AND ‘perfusion defect percentage’ OR ‘QDP’ OR ‘ventilation defect percentage’ OR ‘VDP’ OR ‘forced expiratory volume in the first second’ OR ‘FEV1’. For a full comprehensive search strategy, see online supplemental file 1.
Supplemental material
Study selection
The inclusion criteria for study selection were determined according to the following criteria: (1) studies provided detailed information on the MRI scan parameters, including the scan sequence, image processing software and processing method; (2) studies included comprehensive descriptions of the study methodology and demographic data of the participants; (3) Bland-Altman analysis was employed to assess the consistency between the different MRI imaging methods; (4) Spearman or Pearson coefficient was used to evaluate the correlation between the two modalities; (5) studies included the provision of QDP or VDP parameters for PREFUL MRI, QDP parameter for DCE MRI, VDP parameter for 129Xe MRI and FEV1 measurement obtained through spirometry. Exclusion criteria for the meta-analysis involved the exclusion of animal studies and papers written in languages other than English. Additionally, abstracts, letters, editorials and meta-analyses were excluded due to lacking Bland-Altman or Pearson analysis data. The meta-analysis included both prospective and retrospective studies, as long as they met the inclusion criteria. The study population was not restricted, encompassing both adults and children, as well as patients and healthy volunteers, as long as they fulfilled the inclusion criteria.
Data extraction
The following data were extracted by two investigators: (1) information related to the articles, such as authors, publication journal, the total number of subjects and demographic and disease characteristics of participants; (2) MRI acquisition sequences and protocols; (3) postprocessing analysis methods employed for the calculation of QDP and VDP, along with the dedicated software used for postprocessing; (4) outcomes derived from the Bland-Altman analysis, including the mean difference (MD) and limits of agreement (LOA) for QDP between PREFUL MRI and DCE MRI, as well as VDP between PREFUL MRI and 129Xe MRI; (5) Spearman or Pearson correlation coefficient (r) values of QDP and VDP between the two imaging methods, and the correlation between FEV1 and QDP and VDP. The Spearman coefficients reported in the publications were transformed into Pearson coefficients.23 24 Furthermore, Fisher’s r-to-z transformation was applied to obtain the Pearson coefficient values.25
Quality assessment
The assessment of bias risk in each included study was conducted using the modified Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool via Review Manager V.5.3.26 This tool is frequently employed for the assessment of the quality of diagnostic studies.
Statistical analysis
The MD, LOA and r values from each study were weighted based on the sample size using a random-effects model. A modified forest plot was created to visualise the meta-analysis results for bias and LOA of each parameter. Pooled correlation coefficients for each parameter were displayed in a forest plot. Heterogeneity among the included studies was assessed using the Cochrane Q test and expressed as I2. Moderate to severe heterogeneity was considered present if the p value was less than 0.05 for the Q test or if I2 exceeded 50%. Publication biases were evaluated using Egger’s test and represented through funnel plots. All statistical analyses were conducted using R (V.4.2.2, R Foundation for Statistical Computing, Vienna, Austria) with the meta package and Review Manager (V.5.3, The Cochrane Collaboration 2021, The Nordic Cochrane Centre, Copenhagen, Denmark).
Results
Study selection
Following the systematic search, a total of 105 citations from Medline, 456 from Embase and 6 from Cochrane were identified. After removing duplicates, 508 potentially eligible articles remained. Through the screening of titles and abstracts, 413 studies were excluded for irrelevant topics, animal models, case reports, reviews or guidelines. A total of 95 articles underwent full-text review. After a thorough evaluation based on the inclusion criteria, an additional 85 publications were excluded for reasons such as being non-English, focusing on other parameters, having unextractable data or potentially containing duplicate patient data. Finally, 10 studies met the inclusion criteria and were included in the meta-analysis. The flow chart illustrating the process of literature search and study selection can be found in figure 1.13 19–21 27–32
Study characteristics
The meta-analysis comprised a total of 10 studies, including 399 participants: 101 with CF, 150 with COPD, 66 with CTEPH and 82 healthy volunteers. QDP was analysed in 4 studies, VDP in 4 studies and FEV1 in 8 studies. Table 1 presents a summary of the characteristics of the enrolled studies and details regarding MRI image acquisition. Among the studies, a 1.5-tesla (T) system was used in all except for Munidasa et al29 and Couch et al,28 which used a 3 T system. The most commonly used acquisition sequence for PREFUL MRI was the spoiled gradient echo (SPGR), and all DCE MRI acquisitions employed the time-resolved angiography with stochastic trajectories sequence.
Study quality
The results of the quality assessment, conducted using the QUADAS-2 checklist, are presented in figure 2. Five studies reported enrolling consecutive patients, while in five studies, the method of patient enrolment was not clearly explained. The risk of bias in the ‘index test’ or ‘reference standard’ domains was assessed as ‘unclear’ in six studies due to the absence of information regarding whether the MRI results were interpreted with knowledge of each other. The majority of studies (89%) demonstrated a low risk of bias in the ‘flow’ and ‘timing’ domains. Applicability concerns across all domains were rated as ‘low’.
Publication bias
Figure 3 displays the funnel plots for each parameter. The funnel plots for all parameters exhibited a relatively symmetric shape, suggesting no significant publication bias (p>0.05), except for the agreement of QDP, which showed remarkable publication bias (p=0.017).
Agreement and correlation for measurements of QDP
Among the included studies, three reported the MD and LOA for QDP as assessed by Bland-Altman analysis between PREFUL MRI and DCE MRI. One of these studies analysed three different groups of patient results.13 The MD of QDP was −2.31%, with a pooled LOA ranging from −8.01% to 3.40% (figure 4A). Significant heterogeneity was observed (I2=82%, p<0.01). In addition, the pooled correlation coefficient for QDP was 0.65 (95% CI 0.55 to 0.73), with low heterogeneity (I2=0%, p=0.44). The result of the modified forest plot is shown in figure 5A.
Agreement and correlation for measurements of VDP
Four studies investigated the correlation of VDP between PREFUL MRI and 129Xe MRI. However, only three studies reported the agreement for VDP assessment using Bland-Altman analysis. The overall MD for VDP was 0.34%, and the pooled LOA ranged from −4.94% to 5.62%. Notably, there was significant heterogeneity observed in the finding (I2=89%, p<0.01). Furthermore, the pooled correlation coefficient for VDP was 0.72 (95% CI 0.61 to 0.80), with mild heterogeneity (I2=40%, p=0.14). Figures 4B and 5B provide forest plots of these results.
Correlation between PREFUL MRI and FEV1 of spirometry
The meta-analysis including four studies revealed a pooled correlation coefficient of −0.51 (95% CI −0.74 to −0.18) between QDP and FEV1. The analysis also indicated significant heterogeneity among the studies (I2=83%, p<0.01). Moreover, in seven studies, the pooled correlation coefficient between VDP and FEV1 was −0.60 (95% CI −0.73 to −0.44), with a significant heterogeneity (I2=70%, p<0.01). All the results are shown in figure 5C,D.
Discussion
To the best of our understanding, this meta-analysis is the first systematic investigation of pulmonary function assessment using PREFUL MRI in comparison to DCE MRI and 129Xe MRI. The analysis includes a total of 10 studies involving 399 subjects. The findings indicate that the evaluation of QDP on PREFUL MRI demonstrates good agreement (MD, −2.31%; LOA, −8.01% to 3.40%) and moderate correlations (r=0.65; 95% CI 0.55 to 0.73) with DCE MRI, although notable heterogeneities are observed among the studies. Furthermore, the results reveal that VDP on PREFUL MRI exhibits favourable agreement (MD, 0.34%; LOA, −4.94% to 5.62%) and strong correlations (r=0.72; 95% CI 0.61 to 0.80) with 129Xe MRI. These findings suggest that free-breathing, non-contrast agents PREFUL MRI may allow for pulmonary perfusion and ventilation assessment comparable to DCE MRI and 129Xe MRI.
DCE MRI is a well-established and widely used technique for assessing lung perfusion. Recent studies have demonstrated that DCE MRI achieves comparable diagnostic accuracy when compared with planar scintigraphy and ventilation/perfusion scans.33 Furthermore, investigations have shown significant correlations and spatial agreement between perfusion-weighted PREFUL MRI and DCE MRI measurements.34 However, it is worth noting that previous research findings have been based on limited sample sizes. In our meta-analysis, we provide robust evidence supporting the clinical practice of PREFUL MRI. Notably, when considering the study by Behrendt et al,13 we observed a larger pooled MD and the LOA. This can be attributed to incomplete breath holding during DCE data acquisition, resulting in residual movement and artificially elevated perfusion values near the diaphragm.
The majority of studies used an SPGR sequence to acquire PREFUL algorithm images at 1.5 T MR, typically capturing 3–8 coronal slices. Postprocessing procedures involved registering each coronal slice image to a reference image in an intermediate respiratory position. Furthermore, automatic segmentation techniques were employed to delineate the lung parenchyma and eliminate pulmonary vessels with Otsu methods for variable thresholding.10 Through the combination of automatically determined regions of interest along with heart frequencies, the complete cardiac cycle was reconstructed using a phase-sorting algorithm. For each slice, the perfusion weighting phase was automatically selected, and the perfusion value was normalised using the signal from the whole blood voxel defined in the middle slice.13 Notably, the determination of the threshold plays a critical role in the calculation of QDP. In Pöhler et al’s study, the threshold of PREFUL MRI for healthy perfusion values was defined as 1% of the full blood voxel signal value.35 However, in the research conducted by Behrendt et al,19 the threshold of PREFUL MRI was set at 2% and the threshold of DCE MRI was 1.75% for QDP analysis. Additionally, as taken in the study by Schiwek et al,10 the calculation method involving variable thresholds rather than fixed thresholds is being increasingly adopted for both PREFUL MRI and DCE MRI. These differences in threshold determination across studies could potentially account for variations in the MD observed in our meta-analysis.
Hyperpolarised gas MRI is a highly sensitive and specific imaging technique that directly visualises the distribution of ventilation within the lung.36 On the other hand, PREFUL MRI is a method that uses regional lung motion during the breathing cycle to quantify regional ventilation (RV). It identifies ventilation defects, characterised by minimal signal changes or altered signal dynamics between inspiration and expiration. Although our meta-analysis demonstrates good agreement and strong correlation between PREFUL VDP and 129Xe VDP, some variations persist, particularly in the study conducted by Couch et al.28 These differences can be attributed, at least in part, to the influence of time-of-flight inflow effects, resulting in enhanced visibility of pulmonary vessels in single-slice, free-breathing 1H images.
The computation of VDP in PREFUL MRI primarily relies on two ventilation-derived maps: the RV map and the flow-volume loop (FVL) correlation map. The RV map quantifies the signal change between end inspiration and end expiration while correcting for volume errors resulting from image registration.37 On the other hand, the FVL correlation map cross-correlates each voxel FVL in the lung parenchyma with a healthy reference FVL to generate a voxel FVL cross-correlation map, which is subsequently used to calculate the FVL-based VDP value.38 Generally, for VDPRV, VDP is determined by identifying voxels with ventilation deficit, where all RV values below the 90th percentile multiplied by a factor of 0.4 are considered as such defects. Conversely, for VDPFVL, a fixed threshold of 0.9 is used to identify ventilation defects.38 In our meta-analysis, the VDP values derived from PREFUL MRI were calculated based on VDPRV, which resulted in relatively consistent results among all included studies, with an MD of 0.34% (95% CI −4.94% to 5.62%) and a correlation coefficient of 0.73. The results indicate that the VDP measured by PREFUL and 129Xe MRI was essentially consistent, with a difference of only 0.34% between the VDP values calculated by the two MRI imaging methods. This consistency in VDP outcomes may be attributed to the utilisation of VDPRV as the basis for VDP calculation across the studies.
Previous studies have reported remarkable correlations between RV assessed by FD techniques and spirometry parameters, particularly FEV1.35 39 Similarly, considerable correlations have been observed between PREFUL MRI-derived QDP and predicted FEV1 for the whole lung.13 19 20 However, on combining the correlation coefficients from the included studies, our results found that the correlation between QDP and FEV1 (r=−0.51; 95% CI −0.74 to −0.18) was relatively weaker compared with that between VDP and FEV1 (r=−0.60; 95% CI −0.73 to −0.44). This observation can be explained by the fact that QDP represents a perfusion parameter while FEV1 reflects a ventilation parameter. Additionally, it should be noted that PREFUL MRI, unlike global lung function measurements such as FEV1, involves the calculation of QDP based on only 3–8 slices, resulting in incomplete coverage of the entire lung parenchyma.19
The results from our meta-analysis hold significant implications for the future clinical application of PREFUL MRI, considering the crucial role of lung function assessment in the diagnosis and prognosis of pulmonary diseases. Moreover, the measurement of ventilation and perfusion is of remarkable importance in monitoring the efficacy of pharmacological interventions in hyperinflated patients with COPD and predicting adverse outcomes such as chronic lung allograft dysfunction-related mortality or transplant failure in large prospective cohorts of lung transplant recipients.40 41 Finally, PREFUL MRI offers the advantage of simultaneously obtaining ventilation and perfusion parameters in a single examination, eliminating the need for breath-holding manoeuvres and contrast agent administration. This feature is particularly advantageous for patients with lung diseases who may have difficulties tolerating prolonged supine breath-holding examinations.
Several limitations are associated with this meta-analysis. First, the sample size was comparatively modest, consisting of only 10 studies. Moreover, there was variation in the literature enrolled when examining different lung function indicators. Second, the diverse range of disease states encompassed in this study, including both healthy volunteers and patients with various conditions such as CF, introduces potential limitations in extrapolating the results to specific populations. Third, substantial heterogeneity was observed in the meta-analysis, but due to the limited number of available studies, subgroup analyses could not be conducted to explore potential sources of heterogeneity. Lastly, the quantification of lung function parameters using PREFUL MRI does not directly measure FEV1. Published studies have consistently shown a significant correlation between PREFUL lung function parameters and spirometry-based FEV1. Therefore, this study does not directly compare PREFUL MRI with spirometry-based FEV1.
Conclusions
PREFUL MRI is a promising innovative imaging for assessing lung function, as it exhibits satisfactory bias and LOA compared with DEC MRI and 129Xe MRI. In the future, large-scale, multicentre, prospective studies will be needed to validate it.
Supplemental material
Data availability statement
Data are available upon reasonable request.
Ethics statements
Patient consent for publication
Ethics approval
Not applicable.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Contributors QY had full access to all of the data in the study and took responsibility for the integrity of the data and the accuracy of the data analysis. QY and TO contributed to the study conception, study design, study management, data analysis, data interpretation and manuscript writing. YT and TO collected the data and performed the data analysis, with verification of the analysis and results. TO and YT wrote the initial draft of the manuscript. CZ made revisions to the manuscript. All authors provided critical feedback and made substantial revisions to the manuscript, and ultimately approved the final version for submission. The final responsibility for the decision to submit the manuscript for publication rested with all the authors. QY is the guarantor.
Funding This work was supported by the Beijing Hospitals Authority Clinical Medicine Development of Special Funding Support (ZLRK202306), the Beijing Hospitals Authority’s Ascent Plan (DFL20220303) and the Beijing Key Specialists in Major Epidemic Prevention and Control.
Competing interests CZ was employed by Siemens Healthineers.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.