Rezvani, S. | bioRxiv Science

bioRxiv2025

Probabilistic Multi-site MR Image Harmonization via Feature Preserving Conditional Generative Adversarial Networks

Brain magnetic resonance imaging (MRI) is pivotal in diagnosing and monitoring neurological disorders. However, despite their extensive applications, MR images have certain shortcomings. In particular, factors other than the anatomy of brain tissues influence the intensity distribution of voxels in MR images. These factors include hardware, software, magnetic field strength, and acquisition protocol. This inconsistency poses challenges in multi-site neuroimaging studies, where images are obtained from various devices with minimal control over acquisition parameters. Image harmonization algorithms aim to eliminate non-biological characteristics in MR images through various approaches, including converting images from multiple sites into a format resembling that of a designated target site. Among image harmonization methods, those relying on deep learning algorithms have gained significant attention recently. Nevertheless, certain aspects of deep learning-based image harmonization remain unexplored, notably the integration of probabilistic deep generative models to transform the distribution of MR images to a desired distribution. Inspired by this, we introduced a feature preserving conditional generative adversarial network (FP-cGAN) that converts images from multiple origins into the format of a target site while preserving anatomical features by imposing a novel regularizing constraint. We conduct our experiments on MR images from the SRPBS dataset, which comprises unpaired images in addition to paired (traveling subjects) images from multiple sites. We utilize the unpaired data for training our models and the paired data for evaluation. Furthermore, we compare our results with cycleGAN and histogram matching, two widely used image harmonization methods. Our experiments reveal that our approach surpasses the other techniques. Article HighlightsO_LIWe introduce an FP-cGAN model to harmonize multi-site MRI scans into a target site. C_LIO_LIA novel anatomical feature invariant constraint maintains tissue integrity. C_LIO_LIThe models are trained in an unpaired setting without requiring traveling subjects. C_LIO_LIWe evaluate harmonization performance using paired traveling subjects. C_LI

bioengineering↗

bioRxiv2024

Probabilistic Brain MR Image Transformation Using Generative Models

Brain MR image transformation, which is the process of transforming one type of MR image into another, is a critical neuroimaging task that is needed when the target image type is missing or corrupted. Accordingly, several methods have been developed to tackle this problem, with a recent focus on deep learning-based models. In this paper, we investigate the performance of the conditional version of three such probabilistic generative models, including conditional Generative Adversarial Networks (cGAN), Noise Conditioned Score Networks (NCSN), and De-noising Diffusion Probabilistic Models (DDPM). We also compare their performance against a more traditional deterministic U-Net based model. We train and test these models using MR images from publicly available datasets IXI and OASIS. For images from the IXI dataset, we conduct experiments on combinations of transformations between T1-weighted (T1), T2-weighted (T2), and proton density (PD) images, whereas for the OASIS dataset, we consider combinations of T1, T2, and Fluid Attenuated Inversion Recovery (FLAIR) images. In evaluating these models, we measure the similarity between the transformed image and the target image using metrics like PSNR and SSIM. In addition, for the three probabilistic generative models, we evaluate the utility of generating an ensemble of predictions by computing a metric that measures the variance in their predictions and demonstrate that it can be used to identify out-of-distribution (OOD) input images. We conclude that the NCSN model yields the most accurate transformations, while the DDPM model yields variance results that most clearly detect OOD inputs. We also note that while the results for the two diffusion models (NCSN and DDPM) are more accurate than those for the cGAN, the latter was significantly more efficient in generating multiple samples. Overall, our work demonstrates the utility of probabilistic conditional generative models for MR image transformation and highlights the role of generating an ensemble of outputs in identifying OOD input images.

bioengineering↗