bioRxiv Science⌕ Search

Biology subjects

Thompson, P. M.

Publications and source records attributed to Thompson, P. M..

At least 55 records · Page 3Linked to original sources

Parameter Efficient Fine-tuning of Transformer-based Masked Autoencoder Enhances Resource Constrained Neuroimage Analysis

Recent innovations in artificial intelligence (AI) have increasingly focused on large-scale foundational models that are more general purpose in contrast to conventional models trained to perform specialized tasks. Transformer-based architectures have become the standard backbone in foundation models across data modalities (image, text, audio, video). There has been a keen interest in applying parameter-efficient fine-tuning (PEFT) methods to adapt these models to specialized downstream tasks in language and vision. These methods are particularly essential for medical image analysis where the limited availability of training data could lead to overfitting. In this work, we evaluated different types of PEFT methods on pre-trained vision transformers relative to typical training approaches, such as full fine-tuning and training from scratch. We used a transformer-based masked autoencoder (MAE) framework, to pretrain a vision encoder on T1- weighted (T1-w) brain MRIs. The pretrained vision transformers were then fine-tuned using different PEFT methods that reduced the trainable model parameters to as few as 0.04% of the original model size. Our study shows that: 1. PEFT methods were competitive with or outperformed the reference full fine-tuning approach and outperformed training from scratch, with only a fraction of the trainable parameters; 2. PEFT methods with a 32% reduction in model size boosted Alzheimers disease (AD) classification by 3% relative to full fine-tuning and 11% relative to a 3D CNN, with only 258 training scans; and 3. PEFT methods performed well on diverse neuroimaging tasks including AD and Parkinsons disease (PD) classification, and "brain-age" prediction based on T1-w MRI datasets - a standard benchmark for deep learning models in neuroimaging; 4. smaller model sizes were competitive with larger models in test performance. Our results show the value of adapting foundation models to neuroimaging tasks efficiently and effectively in contrast to training stand- alone special purpose models.

neuroscience↗

Leveraging a Vision-Language Model with Natural Text Supervision for MRI Retrieval, Captioning, Classification, and Visual Question Answering

Large multimodal models are now extensively used worldwide, with the most powerful ones trained on massive, general-purpose datasets. Despite their rapid deployment, concerns persist regarding the quality and domain relevance of the training data, especially in radiology, medical research, and neuroscience. Additionally, healthcare data privacy is paramount when querying models trained on medical data, as is transparency regarding service hosting and data storage. So far, most deep learning algorithms in radiologic research are designed to perform a specific task (e.g., diagnostic classification) and cannot be prompted to perform multiple tasks using natural language. In this work, we introduce a framework based on vector retrieval and contrastive learning to efficiently learn visual brain MRI concepts via natural language supervision. We show how the method learns to identify factors that affect the brain in Alzheimers disease (AD) via joint embedding and natural language supervision. First, we pre-train separate text and image encoders using self-supervised learning, and jointly fine-tune these encoders to develop a shared embedding space. We train our model to perform multiple tasks, including MRI retrieval, MRI captioning, and MRI classification. We show its versatility by developing a retrieval and re-ranking mechanism along with a transformer decoder for visual question answering. Clinical RelevanceBy learning a cross-modal embedding of radiologic features and text, our approach can learn to perform diagnostic and prognostic assessments in AD research as well as to assist practicing clinicians. Integrating medical imaging with clinical descriptions and text prompts, we aim to provide a general, versatile tool for detecting radiologic features described by text, offering a new approach to radiologic research.

neuroscience↗

Lifespan Normative Modeling of Brain Microstructure

Normative models of brain metrics based on large populations could be extremely valuable for detecting brain abnormalities in patients with a variety of disorders, including degenerative, psychiatric and neurodevelopmental conditions, but no such models exist for the brains white matter (WM) microstructure. Here we present a large-scale normative model of brain WM microstructure - based on 19 international diffusion MRI datasets covering almost the entire lifespan (totaling N=54,583 individuals; age: 4-91 years). We extracted regional diffusion tensor imaging (DTI) metrics using a standardized analysis and quality control protocol and used hierarchical Bayesian regression (HBR) to model the statistical distribution of derived WM metrics as a function of age and sex. We extracted the average lifespan trajectories and corresponding centile curves for each WM region. We illustrate the utility of the method by applying it to detect and visualize profiles of WM microstructural deviations in a variety of contexts: in mild cognitive impairment, Alzheimers disease, and 22q11.2 deletion syndrome - a neurogenetic condition that markedly increases risk for schizophrenia. The resulting large-scale model provides a common reference to identify disease effects on the brains microstructure in individuals or groups, and to compare disorders, and discover factors affecting WM abnormalities. The derived normative models are a valuable resource publicly available to the community, adaptable and extendable to future datasets as the available data expands.

neuroscience↗

Instantaneous Frequency: A New Functional Biomarker for Dynamic Brain Causal Networks

This study introduces instantaneous frequency (IF) analysis as a novel method for characterizing dynamic brain causal networks from fMRI blood-oxygen-level-dependent (BOLD) signals. Effective connectivity, estimated using dynamic causal modeling (DCM), is analyzed to derive IF sequences, with the average IF across brain regions serving as a potential biomarker for global network oscillatory behavior. Analysis of data from the Alzheimers Disease Neuroimaging Initiative (ADNI), Open Access Series of Imaging Studies (OASIS), and Human Connectome Project (HCP) demonstrates the methods efficacy in distinguishing between clinical and demographic groups, such as cognitive decline stages, sex differences, and sleep quality levels. Statistical analyses reveal significant group differences in IF metrics, highlighting its potential as a sensitive indicator for early diagnosis and monitoring of neurodegenerative and cognitive conditions. Graphical Abstract O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=100 SRC="FIGDIR/small/628965v1_ufig1.gif" ALT="Figure 1"> View larger version (35K): org.highwire.dtl.DTLVardef@10da58org.highwire.dtl.DTLVardef@6eee6borg.highwire.dtl.DTLVardef@e6e756org.highwire.dtl.DTLVardef@15dff2a_HPS_FORMAT_FIGEXP M_FIG C_FIG HighlightsO_LIThe study introduces instantaneous frequency (IF) as a novel biomarker derived from dynamic brain effective connectivity, capturing temporal fluctuations in brain networks. C_LIO_LIThe proposed IF biomarker effectively differentiates between various clinical stages, such as Mild Cognitive Impairment (MCI) and Alzheimers Disease (AD), and demographic factors, including sex and sleep quality. C_LIO_LIThe robustness and clinical relevance of the IF biomarker are validated using three independent datasets: ADNI, OASIS, and HCP, demonstrating its potential in cognitive and neurological research. C_LI

neuroscience↗

Evaluating Synthetic Diffusion MRI Maps created with Diffusion Denoising Probabilistic Models

Generative AI models, such as Stable Diffusion, DALL-E, and MidJourney, have recently gained widespread attention as they can generate high-quality synthetic images by learning the distribution of complex, high-dimensional image data. These models are now being adapted for medical and neuroimaging data, where AI-based tasks such as diagnostic classification and predictive modeling typically use deep learning methods, such as convolutional neural networks (CNNs) and vision transformers (ViTs), with interpretability enhancements. In our study, we trained latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) specifically to generate synthetic diffusion tensor imaging (DTI) maps. We developed models that generate synthetic DTI maps of mean diffusivity by training on real 3D DTI scans, and evaluating realism and diversity of the synthetic data using maximum mean discrepancy (MMD) and multi-scale structural similarity index (MS-SSIM). We also assess the performance of a 3D CNN-based sex classifier, by training on combinations of real and synthetic DTIs, to check if performance improved when adding the synthetic scans during training, as a form of data augmentation. Our approach efficiently produces realistic and diverse synthetic data, potentially helping to create interpretable AI-driven maps for neuroscience research and clinical diagnostics.

neuroscience↗

A Surface-based deep learning approach for cortical shape analysis

Advances in deep learning hold promise for predicting clinical factors from human brain images. In this study, we applied a spherical harmonics-based convolutional neural network approach (SPHARM-Net) to MRI-derived brain shape metrics to predict age, sex, and Alzheimers disease (AD) diagnosis. MRI-derived brain features included vertex-wise cortical curvature, convexity, thickness, and surface area. SPHARM-Net performs convolutions using the spherical harmonic transforms, eliminating the need to explicitly define neighborhood size, and achieving rotational equivariance. Sex classification and age regression were carried out in a large sample of healthy adults (UK Biobank; N=32,979), and AD classification performance was tested in a large, publicly available sample (ADNI; N=1,213). SPHARM-Net showed strong performance for sex classification (accuracy=0.91; balanced accuracy= 0.91; AUC=0.97), and age regression (average absolute error=2.97 years; R-squared=0.77; Pearsons coefficient=0.9). AD classification also performed well (accuracy=0.86; balanced accuracy=0.83; AUC=0.9). Our experiments demonstrate promising preliminary performance using the SPHARM-Net for two widely studied benchmarking tasks and for AD classification. Future work will include comparisons of shape-based methods and extending these analysis to more challenging tasks such as mood disorder classification.

neuroscience↗

White Matter Microstructural Alterations in Autism Localized with Bundle Analytics

Previous diffusion magnetic resonance imaging research in autism has reported altered microstructure in the corpus callosum (CC), the major commissure connecting the two brain hemispheres. However, the CC consists of many fibers connecting various brain regions, and the precise localization of these differences in autism remains unclear. Additionally, the conventional diffusion tensor imaging (DTI) model cannot resolve complex fiber configurations and may miss subtle alterations. In this study, we investigated CC microstructure in 365 participants (5-25 years; 34.0% female; 195 with autism) from 10 sites/scanners by using a novel along-tract mapping method, BUndle ANalytics (BUAN), and advanced microstructure model, the tensor distribution function (TDF). Autism was associated with regionally specific reductions in white matter integrity and elevations in diffusivity. The TDF model detected CC microstructure differences more sensitively than DTI. Taken together, BUAN and TDF allow for precise and rigorous white matter analyses, enhancing the detection of subtle neural differences.

neuroscience↗

Generalizability of Normative Models of Brain Morphometry Across Distinct Ethnoracial Groups

Normative modeling of brain morphometric data can inform about the clinical significance of deviations from typical patterns in brain structure. Their usefulness, however, is dependent on their applicability to diverse ethnoracial groups. With this in mind, we developed age- and sex-specific normative models for cortical thickness, surface area, and subcortical volumes using brain scans from 37,407 healthy individuals from a diverse international sample. Here we demonstrate the validity of these models in diverse and distinct populations. Specifically, we tested these pre-trained models on independent samples of healthy individuals that either self-identified as Black, South Asian, East Asian Chinese, East Asian Japanese, or we categorized as African, Admixed American, East Asian, and European based on their genetic ancestry. Regardless of ethnoracial definition, the performance of the pretrained models in these samples was exceptionally high; the relative mean absolute error for each regional brain morphometry measure was less than 10% across all the distinct ethnoracial groups. These findings affirm the broad applicability of our models, ensuring that brain morphometry assessments using these models are accurate and reliable for individuals regardless of background. This broad applicability has significant implications for advancing personalized medicine and improving health outcomes in diverse populations.

bioinformatics↗

The Pattern and Staging of Brain Atrophy in Spinocerebellar Ataxia Type 2 (SCA2): MRI Volumetrics from ENIGMA-Ataxia

ObjectiveSpinocerebellar ataxia type 2 (SCA2) is a rare, inherited neurodegenerative disease characterised by progressive deterioration in both motor coordination and cognitive function. Atrophy of the cerebellum, brainstem, and spinal cord are core features of SCA2, however the evolution and pattern of whole-brain atrophy in SCA2 remain unclear. We undertook a multi-site, structural magnetic resonance imaging (MRI) study to comprehensively characterize the neurodegeneration profile of SCA2. MethodsVoxel-based morphometry analyses of 110 participants with SCA2 and 128 controls were undertaken to assess groupwise differences in whole-brain volume. Correlations with clinical severity and genotype, and cross-sectional profiling of atrophy patterns at different disease stages, were also performed. ResultsAtrophy in SCA2 relative to controls was greatest (Cohens d>2.5) in the cerebellar white matter (WM), middle cerebellar peduncle, pons, and corticospinal tract. Very large effects (d>1.5) were also evident in the superior cerebellar, inferior cerebellar, and cerebral peduncles. In cerebellar grey matter (GM), large effects (d>0.8) mapped to areas related to both motor coordination and cognitive tasks. Strong correlations (|r|>0.4) between volume and disease severity largely mirrored these groupwise outcomes. Stratification by disease severity showed a degeneration pattern beginning in cerebellar and pontine WM in pre-clinical subjects; spreading to the cerebellar GM and cerebro-cerebellar/corticospinal WM tracts; then finally involving the thalamus, striatum, and cortex in severe stages. InterpretationThe magnitude and pattern of brain atrophy evolves over the course of SCA2, with widespread, non-uniform involvement across the brainstem, cerebellar tracts, and cerebellar cortex; and late involvement of the cerebral cortex and striatum.

neuroscience↗

Comparison of Explainable AI Models for MRI-based Alzheimer's Disease Classification

Deep learning models based on convolutional neural networks (CNNs) have been used to classify Alzheimers disease or infer dementia severity from 3D T1-weighted brain MRI scans. Here, we examine the value of adding occlusion sensitivity analysis (OSA) and gradient-weighted class activation mapping (Grad-CAM) to these models to make the results more interpretable. Much research in this area focuses on specific datasets such as the Alzheimers Disease Neuroimaging Initiative (ADNI) or National Alzheimers Coordinating Center (NACC), which assess people of North American, predominantly European ancestry, so we examine how well models trained on these data generalize to a new population dataset from India (NIMHANS cohort). We also evaluate the benefit of using a combined dataset to train the CNN models. Our experiments show feature localization consistent with knowledge of AD from other methods. OSA and Grad-CAM resolve features at different scales to help interpret diagnostic inferences made by CNNs.

neuroscience↗

Global brain asymmetry and its variations in aging and related diseases

Functional lateralization is a cardinal feature of human brain, and deviations from typical lateralization are observed in various brain disorders. Although this phenomenon has been widely acknowledged in the field of human neuroscience, decades of research have shown that it is a challenge to bridge the gap between (a)typically lateralized functions and hemispheric differences in structure (termed structural asymmetry). To address this important question, the present study employed the state-of-the-art machine learning techniques to investigate the brain structural asymmetry and its associations with cognitive functions, aging, and aging-related diseases, by integrating large-scale datasets. Our proposed multivariate approach revealed previously unknown and substantial structural differences between the left and right hemispheres, and established the associations between the global brain asymmetry and lateralized functions including hand motor and emotion processing. Furthermore, at the population level we mapped the aging trajectories of the global brain asymmetry, and unveiled significant diagnosis-specific variations in patients with Alzheimers disease and Parkinsons disease, and individuals carrying a relevant genetic risk for atypical brain aging (i.e., APOE4 carriers). These results demonstrated left-hemisphere-linked changes in aging, which has challenged the traditional "right hemi-aging" model, and offered a promising approach for assessing brain aging and related diseases. Overall, our study with a novel approach presents one of the largest-scale investigation of global brain asymmetry, and takes an important step forward in understanding the intricate interplay between structural asymmetry, lateralized functions, and brain aging in health and disease. Significance statementFunctional lateralization is fundamental to the human brain, with deviations linked to various brain disorders. Bridging the gap between functional lateralization and structural asymmetry has been a long-standing challenge. Using advanced machine learning and large-scale datasets, this study introduced a multivariate global brain asymmetry approach and revealed previously unidentified structural differences between the brain hemispheres, correlating these with cognitive functions, aging, and diseases like Alzheimers and Parkinsons. Contrary to the traditional "right hemi-aging" model, we found left-hemisphere-linked aging changes. This work provides new insights into brain asymmetry, lateralized functions, and aging, offering a promising approach for assessing brain health and disease. Classifications: Biological Sciences (Psychological and Cognitive Sciences);

neuroscience↗

BundleAGE: Predicting White Matter Age using Along-Tract Microstructural Profiles from Diffusion MRI

Brain Age Gap Estimation (BrainAGE) is an estimate of the gap between a persons chronological age (CA) and a measure of their brains biological age (BA). This metric is often used as a marker of accelerated aging, albeit with some caveats. Age prediction models trained on brain structural and functional MRI have been employed to derive BrainAGE biomarkers, for predicting the risk of neurodegeneration. While voxel-based and along-tract microstructural maps from diffusion MRI have been used to study brain aging, no studies have evaluated along-tract microstructure for computing BrainAGE. In this study, we train machine learning models to predict a persons age using along-tract microstructural profiles from diffusion tensor imaging. We were able to demonstrate differential aging patterns across different white matter bundles and microstructural measures. The novel Bundle Age Gap Estimation (BundleAGE) biomarker shows potential in quantifying risk factors for neurodegenerative diseases and aging, while incorporating finer scale information throughout white matter bundles.

neuroscience↗

Amyloid, Tau, and APOE in Alzheimer's Disease: Impact on White Matter Tracts

Alzheimers disease (AD) is characterized by cognitive decline and memory loss due to the abnormal accumulation of amyloid-beta (A{beta}) plaques and tau tangles in the brain; its onset and progression also depend on genetic factors such as the apolipoprotein E (APOE) genotype. Understanding how these factors affect the brains neural pathways is important for early diagnostics and interventions. Tractometry is an advanced technique for 3D quantitative assessment of white matter tracts, localizing microstructural abnormalities in diseased populations in vivo. In this work, we applied BUAN (Bundle Analytics) tractometry to 3D diffusion MRI data from 730 participants in ADNI3 (phase 3 of the Alzheimers Disease Neuroimaging Initiative; age range: 55-95 years, 349M/381F, 214 with mild cognitive impairment, 69 with AD, and 447 cognitively healthy controls). Using along-tract statistical analysis, we assessed the localized impact of amyloid, tau, and APOE genetic variants on the brains neural pathways. BUAN quantifies microstructural properties of white matter tracts, supporting along-tract statistical analyses that identify factors associated with brain microstructure. We visualize the 3D profile of white matter tract associations with tau and amyloid burden in Alzheimers disease; strong associations near the cortex may support models of disease propagation along neural pathways. Relative to the neutral genotype, APOE{varepsilon} 3/{varepsilon}3, carriers of the AD-risk conferring APOE{varepsilon} 4 genotype show microstructural abnormalities, while carriers of the protective{varepsilon} 2 genotype also show subtle differences. Of all the microstructural metrics, mean diffusivity (MD) generally shows the strongest associations with AD pathology, followed by axial diffusivity (AxD) and radial diffusivity (RD), while fractional anisotropy (FA) is typically the least sensitive metric. Along-tract microstructural metrics are sensitive to tau and amyloid accumulation, showing the potential of diffusion MRI to track AD pathology and map its impact on neural pathways.

neuroscience↗

The Genetic Architecture of the Human Corpus Callosum and its Subregions

The corpus callosum (CC) is the largest set of white matter fibers connecting the two hemispheres of the brain. In humans, it is essential for coordinating sensorimotor responses, performing associative/executive functions, and representing information in multiple dimensions. Understanding which genetic variants underpin corpus callosum morphometry, and their shared influence on cortical structure and susceptibility to neuropsychiatric disorders, can provide molecular insights into the CCs role in mediating cortical development and its contribution to neuropsychiatric disease. To characterize the morphometry of the midsagittal corpus callosum, we developed a publicly available artificial intelligence based tool to extract, parcellate, and calculate its total and regional area and thickness. Using the UK Biobank (UKB) and the Adolescent Brain Cognitive Development study (ABCD), we extracted measures of midsagittal corpus callosum morphometry and performed a genome-wide association study (GWAS) meta-analysis of European participants (combined N = 46,685). We then examined evidence for generalization to the non-European participants of the UKB and ABCD cohorts (combined N = 7,040). Post-GWAS analyses implicate prenatal intracellular organization and cell growth patterns, and high heritability in regions of open chromatin, suggesting transcriptional activity regulation in early development. Results suggest programmed cell death mediated by the immune system drives the thinning of the posterior body and isthmus. Global and local genetic overlap, along with causal genetic liability, between the corpus callosum, cerebral cortex, and neuropsychiatric disorders such as attention-deficit/hyperactivity and bipolar disorders were identified. These results provide insight into variability of corpus callosum development, its genetic influence on the cerebral cortex, and biological mechanisms related to neuropsychiatric dysfunction.

neuroscience↗

Sex, racial, and APOE-ϵ4 allele differences in longitudinal white matter microstructure in multiple cohorts of aging and Alzheimer's disease

Structured AbstractO_ST_ABSINTRODUCTIONC_ST_ABSThe effects of sex, race, and Apolipoprotein E (APOE) - Alzheimers disease (AD) risk factors - on white matter integrity are not well characterized. METHODSDiffusion MRI data from nine well-established longitudinal cohorts of aging were free-water (FW)-corrected and harmonized. This dataset included 4,702 participants (age=73.06 {+/-} 9.75) with 9,671 imaging sessions over time. FW and FW-corrected fractional anisotropy (FAFWcorr) were used to assess differences in white matter microstructure by sex, race, and APOE-{varepsilon}4 carrier status. RESULTSSex differences in FAFWcorr in association and projection tracts, racial differences in FAFWcorr in projection tracts, and APOE-{varepsilon}4 differences in FW limbic and occipital transcallosal tracts were most pronounced. DISCUSSIONThere are prominent differences in white matter microstructure by sex, race, and APOE- {varepsilon}4 carrier status. This work adds to our understanding of disparities in AD. Additional work to understand the etiology of these differences is warranted. HighlightsO_LISex, race, and APOE-{varepsilon}4 carrier status relate to white matter microstructural integrity C_LIO_LIFemales generally have lower FAFWcorr compared to males C_LIO_LINon-Hispanic Black adults generally have lower FAFWcorr than non-Hispanic White adults C_LIO_LIAPOE-{varepsilon}4 carriers tended to have higher FW than non-carriers C_LI Research in Context Systematic ReviewThe authors used PubMed and Google Scholar to review literature that used conventional and free-water (FW)-corrected microstructural metrics to evaluate sex, race, and APOE-{varepsilon}4 differences in white matter microstructure. While studies have previously explored differences by sex and APOE-{varepsilon}4 status, less is known about racial differences and no large-scale FW-corrected analysis has been performed. InterpretationSex and race were more associated with FAFWcorr while APOE-{varepsilon}4 status was associated with FW metrics. Association, projection, limbic, and occipital transcallosal tracts showed the greatest differences. Future DirectionFuture studies to determine the biological and social pathways that lead to sex, racial, and APOE-{varepsilon}4 differences are warranted. Consent StatementAll participants provided informed consent in their respective cohort studies.

neuroscience↗

Microstructural Mapping of Neural Pathways in Alzheimer's Disease using Macrostructure-Informed Normative Tractometry

IntroductionDiffusion MRI is sensitive to the microstructural properties of brain tissues, and shows great promise in detecting the effects of degenerative diseases. However, many approaches analyze single measures averaged over regions of interest, without considering the underlying fiber geometry. MethodsHere, we propose a novel Macrostructure-Informed Normative Tractometry (MINT) framework, to investigate how white matter microstructure and macrostructure are jointly altered in mild cognitive impairment (MCI) and dementia. We compare MINT-derived metrics with univariate metrics from diffusion tensor imaging (DTI), to examine how fiber geometry may impact interpretation of microstructure. ResultsIn two multi-site cohorts from North America and India, we find consistent patterns of microstructural and macrostructural anomalies implicated in MCI and dementia; we also rank diffusion metrics sensitivity to dementia. DiscussionWe show that MINT, by jointly modeling tract shape and microstructure, has potential to disentangle and better interpret the effects of degenerative disease on the brains neural pathways.

neuroscience↗

Reference curves for harmonizing multi-site regional diffusion MRI metrics across the lifespan

Age-related white matter (WM) microstructure maturation and decline occur throughout the human lifespan, complementing the process of gray matter development and degeneration. Here, we create normative lifespan reference curves for global and regional WM microstructure by harmonizing diffusion MRI (dMRI)-derived data from ten public datasets (N = 40,898 subjects; age: 3-95 years; 47.6% male). We tested three harmonization methods on regional diffusion tensor imaging (DTI) based fractional anisotropy (FA), a metric of WM microstructure, extracted using the ENIGMA-DTI pipeline. ComBat-GAM harmonization provided multi-study trajectories most consistent with known WM maturation peaks. Lifespan FA reference curves were validated with test-retest data and used to assess the effect of the ApoE4 risk factor for dementia in WM across the lifespan. We found significant associations between ApoE4 and FA in WM regions associated with neurodegenerative disease even in healthy individuals across the lifespan, with regional age-by-genotype interactions. Our lifespan reference curves and tools to harmonize new dMRI data to the curves are publicly available as eHarmonize (https://github.com/ahzhu/eharmonize).

neuroscience↗

Counterfactual MRI Generation with Denoising Diffusion Models for Interpretable Alzheimer's Disease Effect Detection

Generative AI models have recently achieved mainstream attention with the advent of powerful approaches such as stable diffusion, DALL-E and MidJourney. The underlying breakthrough generative mechanism of denoising diffusion modeling can generate high quality synthetic images and can learn the underlying distribution of complex, high-dimensional data. Recent research has begun to extend these models to medical and specifically neuroimaging data. Typical neuroimaging tasks such as diagnostic classification and predictive modeling often rely on deep learning approaches based on convolutional neural networks (CNNs) and vision transformers (ViTs), with additional steps to help in interpreting the results. In our paper, we train conditional latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) to provide insight into Alzheimers disease (AD) effects on the brains anatomy at the individual level. We first created diffusion models that could generate synthetic MRIs, by training them on real 3D T1-weighted MRI scans, and conditioning the generative process on the clinical diagnosis as a context variable. We conducted experiments to overcome limitations in training dataset size, compute time and memory resources, testing different model sizes, effects of pretraining, training duration, and latent diffusion models. We tested the sampling quality of the disease-conditioned diffusion using metrics to assess realism and diversity of the generated synthetic MRIs. We also evaluated the ability of diffusion models to conditionally sample MRI brains using a 3D CNN-based disease classifier relative to real MRIs. In our experiments, the diffusion models generated synthetic data that helped to train an AD classifier (using only 500 real training scans) -and boosted its performance by over 3% when tested on real MRI scans. Further, we used implicit classifier-free guidance to alter the conditioning of an encoded individual scan to its counterfactual (representing a healthy subject of the same age and sex) while preserving subject-specific image details. From this counterfactual image (where the same person appears healthy), a personalized disease map was generated to identify possible disease effects on the brain. Our approach efficiently generates realistic and diverse synthetic data, and may create interpretable AI-based maps for neuroscience research and clinical diagnostic applications.

bioinformatics↗