bioRxiv Science⌕ Search

Biology subjects

Moazami, S.

Publications and source records attributed to Moazami, S..

3 recordsLinked to original sources

Probabilistic Multi-site MR Image Harmonization via Feature Preserving Conditional Generative Adversarial Networks

Brain magnetic resonance imaging (MRI) is pivotal in diagnosing and monitoring neurological disorders. However, despite their extensive applications, MR images have certain shortcomings. In particular, factors other than the anatomy of brain tissues influence the intensity distribution of voxels in MR images. These factors include hardware, software, magnetic field strength, and acquisition protocol. This inconsistency poses challenges in multi-site neuroimaging studies, where images are obtained from various devices with minimal control over acquisition parameters. Image harmonization algorithms aim to eliminate non-biological characteristics in MR images through various approaches, including converting images from multiple sites into a format resembling that of a designated target site. Among image harmonization methods, those relying on deep learning algorithms have gained significant attention recently. Nevertheless, certain aspects of deep learning-based image harmonization remain unexplored, notably the integration of probabilistic deep generative models to transform the distribution of MR images to a desired distribution. Inspired by this, we introduced a feature preserving conditional generative adversarial network (FP-cGAN) that converts images from multiple origins into the format of a target site while preserving anatomical features by imposing a novel regularizing constraint. We conduct our experiments on MR images from the SRPBS dataset, which comprises unpaired images in addition to paired (traveling subjects) images from multiple sites. We utilize the unpaired data for training our models and the paired data for evaluation. Furthermore, we compare our results with cycleGAN and histogram matching, two widely used image harmonization methods. Our experiments reveal that our approach surpasses the other techniques. Article HighlightsO_LIWe introduce an FP-cGAN model to harmonize multi-site MRI scans into a target site. C_LIO_LIA novel anatomical feature invariant constraint maintains tissue integrity. C_LIO_LIThe models are trained in an unpaired setting without requiring traveling subjects. C_LIO_LIWe evaluate harmonization performance using paired traveling subjects. C_LI

bioengineering↗

Probabilistic Brain MR Image Transformation Using Generative Models

Brain MR image transformation, which is the process of transforming one type of MR image into another, is a critical neuroimaging task that is needed when the target image type is missing or corrupted. Accordingly, several methods have been developed to tackle this problem, with a recent focus on deep learning-based models. In this paper, we investigate the performance of the conditional version of three such probabilistic generative models, including conditional Generative Adversarial Networks (cGAN), Noise Conditioned Score Networks (NCSN), and De-noising Diffusion Probabilistic Models (DDPM). We also compare their performance against a more traditional deterministic U-Net based model. We train and test these models using MR images from publicly available datasets IXI and OASIS. For images from the IXI dataset, we conduct experiments on combinations of transformations between T1-weighted (T1), T2-weighted (T2), and proton density (PD) images, whereas for the OASIS dataset, we consider combinations of T1, T2, and Fluid Attenuated Inversion Recovery (FLAIR) images. In evaluating these models, we measure the similarity between the transformed image and the target image using metrics like PSNR and SSIM. In addition, for the three probabilistic generative models, we evaluate the utility of generating an ensemble of predictions by computing a metric that measures the variance in their predictions and demonstrate that it can be used to identify out-of-distribution (OOD) input images. We conclude that the NCSN model yields the most accurate transformations, while the DDPM model yields variance results that most clearly detect OOD inputs. We also note that while the results for the two diffusion models (NCSN and DDPM) are more accurate than those for the cGAN, the latter was significantly more efficient in generating multiple samples. Overall, our work demonstrates the utility of probabilistic conditional generative models for MR image transformation and highlights the role of generating an ensemble of outputs in identifying OOD input images.

bioengineering↗

Probabilistic Brain Extraction in MR Images via Conditional Generative Adversarial Networks

Brain extraction, which refers to the task of segmenting brain tissue in an MR image of a subject, forms an essential first step for many quantitative neuroimaging applications. These include quantifying grey and white matter volumes, monitoring neurological diseases like multiple sclerosis (MS) and Alzheimers disease, and estimating brain atrophy. Over the years several algorithms that automate brain extraction have been proposed. More recently, novel image-to-image deep learning methods have been implemented for this task, and have demonstrated significant gains in accuracy and robustness. However, to our knowledge, none of these algorithms account for the uncertainty that is inherent in brain extraction. Motivated by this, we propose a novel, probabilistic deep learning algorithm for brain extraction that recasts this task as a Bayesian inference problem, and then utilizes a conditional generative adversarial network (cGAN) to solve it. The input to the generator network is an MR image of the head and the output is a collection of images of the brain that are drawn from a probability density conditioned on the input image. These images are used to generate a pixel-wise mean image, which serves as the best guess for an image of the brain, and a pixel-wise standard deviation image, which quantifies the uncertainty in the prediction. We test this algorithm on head MR images of fifty subjects and demonstrate that it is more accurate than a commonly used brain extraction tool, and that its performance compares well with the current state of the art in deep learning algorithms. We also demonstrate the utility of the estimates of uncertainty generated by the algorithm.

bioengineering↗