Biology subjects

Gray, J. W.

Publications and source records attributed to Gray, J. W..

At least 19 recordsLinked to original sources

bioRxiv2026

Tumor-immune trajectory context connects static tissue architecture to clinical outcomes

Multiplexed tissue imaging (MTI) has revealed recurrent tumor microenvironment (TME) architectures with prognostic value, yet these measurements are inherently static, obscuring dynamic changes in the TME that govern therapeutic response. Here, we introduce a trajectory-centric framework that reconstructs continuous TME dynamics by integrating agent-based mathematical modeling and simulation with state space analysis. This approach yields a mechanistically constrained reference landscape built entirely from in silico simulation, and onto which static patient biospecimens can be projected and mapped onto simulated TME trajectories. Systematic simulation of tumor-immune interactions in triple-negative breast cancer identifies six metastable TME states connected by transition pathways spanning immune control to immune escape. Mapping MTI data from two independent patient cohorts, including longitudinal samples from a randomized immunotherapy trial, validates this landscape by positioning individual biospecimens along inferred TME trajectories rather than in static states. We show that treatment-phase TME states, but not pre-treatment configurations, robustly predict immunotherapy response, and identical terminal states can arise from distinct trajectory histories corresponding to immune failure or resolved inflammation. Thus, this framework enables mechanistic simulations to define a reference dynamical landscape that serves as a coordinate system for interpreting static clinical spatial data, providing a principled basis for evaluating consistency, predictiveness, and clinical relevance across independent patient cohorts. Altogether, this study advances spatial tumor profiling from static state classification of human tissues to dynamic trajectory inference, establishing a quantitative framework for trajectory-informed, state-guided, and temporally adaptive immunotherapy strategies.

cancer biology↗

bioRxiv2023

Towards Generalizability and Robustness in Biological Object Detection in Electron Microscopy Images

Machine learning approaches have the potential for meaningful impact in the biomedical field. However, there are often challenges unique to biomedical data that prohibits the adoption of these innovations. For example, limited data, data volatility, and data shifts all compromise model robustness and generalizability. Without proper tuning and data management, deploying machine learning models in the presence of unaccounted for corruptions leads to reduced or misleading performance. This study explores techniques to enhance model generalizability through iterative adjustments. Specifically, we investigate a detection tasks using electron microscopy images and compare models trained with different normalization and augmentation techniques. We found that models trained with Group Normalization or texture data augmentation outperform other normalization techniques and classical data augmentation, enabling them to learn more generalized features. These improvements persist even when models are trained and tested on disjoint datasets acquired through diverse data acquisition protocols. Results hold true for transformerand convolution-based detection architectures. The experiments show an impressive 29% boost in average precision, indicating significant enhancements in the models generalizibality. This underscores the models capacity to effectively adapt to diverse datasets and demonstrates their increased resilience in real-world applications.

bioengineering↗

bioRxiv2023

Efficient semi-supervised semantic segmentation of electron microscopy cancer images with sparse annotations

Electron microscopy (EM) enables imaging at nanometer resolution and can shed light on how cancer evolves to develop resistance to therapy. Acquiring these images has become a routine task; however, analyzing them is now the bottleneck, as manual structure identification is very time-consuming and can take up to several months for a single sample. Deep learning approaches offer a suitable solution to speed up the analysis. In this work, we present a study of several state-of-the-art deep learning models for the task of segmenting nuclei and nucleoli in volumes from tumor biopsies. We compared previous results obtained with the ResUNet architecture to the more recent UNet++, FracTALResNet, SenFormer, and CEECNet models. In addition, we explored the utilization of unlabeled images through semi-supervised learning with Cross Pseudo Supervision. We have trained and evaluated all of the models on sparse manual labels from three fully annotated in-house datasets that we have made available on demand, demonstrating improvements in terms of 3D Dice score. From the analysis of these results, we drew conclusions on the relative gains of using more complex models, semi-supervised learning as well as next steps for the mitigation of the manual segmentation bottleneck.

bioengineering↗

bioRxiv2023

Longitudinal and multimodal auditing of tumor adaptation to CDK4/6 inhibitors in HR+ metastatic breast cancers

CDK4/6 inhibitors (CDK4/6i) have transformed the treatment of hormone receptor-positive (HR+), HER2-negative (HR+) breast cancers as they are effective across all clinicopathological, age, and ethnicity subgroups for metastatic HR+ breast cancer. In metastatic ER+ breast cancer, CDK4/6i lead to strong and consistent improvement in survival across different lines of therapy. To improve understanding of how metastatic HR+ breast cancers become refractory to CDK4/6i, we have created a multimodal and longitudinal tumor atlas to investigate therapeutic adaptations in malignant cells and in the tumor immune microenvironment. This atlas is part of the NCI Cancer Moonshot Human Tumor Atlas Network and includes seven pairs of pre- and on-progression biopsies from five metastatic HR+ breast cancer patients treated with CDK4/6i. Biopsies were profiled with bulk genomics, transcriptomics, and proteomics as well as single-cell ATAC-seq and multiplex tissue imaging for spatial, single-cell resolution. These molecular datasets were then linked with detailed clinical metadata to create an atlas for understanding tumor adaptations during therapy. Analysis of our atlas datasets suggests a diverse set of tumor adaptations to CDK4/6i therapy. Malignant cells may adapt to therapy via mTORC1 activation, cell cycle bypass, and increased replication stress. The tumor immune microenvironment displayed evidence of both immune activation and immune suppression during therapy. Together, our metastatic ER+ breast cancer atlas represents a rich multimodal resource to better understand HR+ breast cancer tumor therapeutic adaptations to CDK4/6i therapy.

cancer biology↗

bioRxiv2022

3D multiplexed tissue imaging reconstruction and optimized region-of-interest (ROI) selection through deep learning model of channels embedding

Tissue-based sampling and diagnosis are defined as the extraction of information from certain limited spaces and its diagnostic significance of a certain object. Pathologists deal with issues related to tumor heterogeneity since analyzing a single sample does not necessarily capture a representative depiction of cancer, and a tissue biopsy usually only presents a small fraction of the tumor. Many multiplex tissue imaging platforms (MTIs) make the assumption that tissue microarrays (TMAs) containing small core samples of 2-dimensional (2D) tissue sections are a good approximation of bulk tumors although tumors are not 2D. However, emerging whole slide imaging (WSI) or 3D tumor atlases that employ MTIs like cyclic immunofluorescence (CyCIF) strongly challenge this assumption. In spite of the additional insight gathered by measuring the tumor microenvironment in WSI or 3D, it can be prohibitively expensive and time-consuming to process tens or hundreds of tissue sections with CyCIF. Even when resources are not limited, the criteria for region-of-interest (ROI) selection in tissues for downstream analysis remain largely qualitative and subjective as stratified sampling requires the knowledge of objects and evaluates their features. Despite the fact TMAs fail to adequately approximate whole tissue features, a theoretical subsampling of tissue exists that can best represent the tumor in the whole slide image. To address these challenges, we propose deep learning approaches to learn multi-modal image translation tasks from two aspects: 1) generative modeling approach to reconstruct 3D CyCIF representation and 2) co-embedding CyCIF image and Hematoxylin and Eosin (H&E) section to learn multi-modal mappings by a cross-domain translation for minimum representative ROI selection. We demonstrate that generative modeling enables a 3D virtual CyCIF reconstruction of a colorectal cancer specimen given a small subset of the imaging data at training time. By co-embedding histology and MTI features, we propose a simple convex optimization for objective ROI selection. We demonstrate the potential application of ROI selection and the efficiency of its performance with respect to cellular heterogeneity.

bioinformatics↗

bioRxiv2022

A Novel Mouse Model that Recapitulates the Heterogeneity of Human Triple Negative Breast Cancer

Triple-negative breast cancer (TNBC) patients have a poor prognosis and few treatment options. Mouse models of TNBC are important for development of new targeted therapies, but few TNBC mouse models exist. Here, we developed a novel TNBC murine model by mimicking two common TNBC mutations with high co-occurrence: amplification of the oncogene MYC and deletion of the tumor suppressor PTEN. This Myc;Ptenfl murine model develops TN mammary tumors that display histological and molecular features commonly found in human TNBC. We performed deep omic analyses on Myc;Ptenfl tumors including machine learning for morphologic features, bulk and single-cell RNA-sequencing, multiplex immunohistochemistry and single-cell phenotyping. Through comparison with human TNBC, we demonstrated that this new genetic mouse model develops mammary tumors with differential survival that closely resemble the inter- and intra-tumoral and microenvironmental heterogeneity of human TNBC; providing a unique pre-clinical tool for assessing the spectrum of patient TNBC biology and drug response. Statement of significanceThe development of cancer models that mimic triple-negative breast cancer (TNBC) microenvironment complexities is critical to develop effective drugs and enhance disease understanding. This study addresses a critical need in the field by identifying a murine model that faithfully mimics human TNBC heterogeneity and establishing a foundation for translating preclinical findings into effective human clinical trials.

cancer biology↗

bioRxiv2022

Computational Multiplex Panel Reduction to Maximize Information Retention in Breast Cancer Tissue Microarrays

Recent state-of-the-art multiplex imaging techniques have expanded the depth of information that can be captured within a single tissue sample by allowing for panels with dozens of markers. Despite this increase in capacity, space on the panel is still limited due to technical artifacts, tissue loss, and long imaging acquisition time. As such, selecting which markers to include on a panel is important, since removing important markers will result in a loss of biologically relevant information, but identifying redundant markers will provide a room for other markers. To address this, we propose computational approaches to determine the amount of shared information between markers and select an optimally reduced panel that captures maximum amount of information with the fewest markers. Here we examine several panel selection approaches and evaluate them based on their ability to reconstruct the full panel images and information within breast cancer tissue microarray datasets using cyclic immunofluorescence as a proof of concept. We show that all methods perform adequately and can re-capture cell types using only 18 of 25 markers (72% of the original panel size). The correlation-based selection methods achieved the best single-cell marker mean intensity predictions with a Spearman correlation of 0.90 with the reduced panel. Using the proposed methods shown here, it is possible for researchers to design more efficient multiplex imaging panels that maximize the amount of information retained with the limited number of markers with respect to certain evaluation metrics and architecture biases. Author SummaryMultiplex tissue imaging techniques utilize large panels of markers that attempt to gather as much information as possible, but increasing the number of stains does come with the downsides of increased autofluorescence and tissue degradation. There exists a theoretical subsampling of markers that is able to recreate the same information as a full panel; therefore, removing the self-correlating information with such a subset would increase the efficiency of the imaging process and maximize the information collected. By selecting an idealized subsample of markers, a deep learning model can be trained to predict the same information as a full dataset with fewer rounds of staining. Here we evaluate several methods of subsample marker selection and demonstrate their ability to reconstruct the full panels information.

bioinformatics↗

bioRxiv2021

A framework for multiplex imaging optimization and reproducible analysis

Multiplex imaging technologies are increasingly used for single-cell phenotyping and spatial characterization of tissues; however, transparent methods are needed for comparing the performance of platforms, protocols and analytical pipelines. We developed a python software, mplexable, for reproducible image processing and utilize Jupyter notebooks to share our optimization of signal removal, antibody specificity, background correction and batch normalization of the multiplex imaging with a focus on cyclic immunofluorescence (CyCIF). Our work both improves the CyCIF methodology and provides a framework for multiplexed image analytics that can be easily shared and reproduced.

cancer biology↗

bioRxiv2021

Multiplex spatial systems analysis of local nanodose drug responses predicts effective treatment combinations of immunotherapies and targeted agents in mammary carcinoma

Better methods are needed to identify effective combinations of immunotherapies with chemotherapies and targeted anti-cancer agents. Here we present a Multiplex Implantable Microdevice Assay (MIMA) system for rapid in vivo assessment of the effects of multiple, spatially separate anticancer drugs directly in the complex tumor microenvironment. In prototypic experiments, olaparib, lenvatinib, palbociclib, venetoclax, panobinostat, doxorubicin, and paclitaxel and combinations thereof were administered simultaneously to murine mammary tumor models. Quantitative multiplex immunohistochemistry and spatial systems analyses of each local drug response defined cellular relations of fibroblasts, endothelial cells, immune lineages, immunogenic cell death, tumor proliferation and/or cancer stem cells that were used to predict effective drug combinations. A predicted combination of panobinostat, venetoclax and anti-CD40 showed long-term anti-tumor efficacy in multiple mouse models with no observable toxicity when administered systemically. Future MIMA use promises to design effective drug combinations for tumor cell control and immune activation on a personalized basis.

cancer biology↗

bioRxiv2021

A LINCS microenvironment perturbation resource for integrative assessment of ligand-mediated molecular and phenotypic responses

The phenotype of a cell and its underlying molecular state is strongly influenced by extracellular signals, including growth factors, hormones, and extracellular matrix. While these signals are normally tightly controlled, their dysregulation leads to phenotypic and molecular states associated with diverse diseases. To develop a detailed understanding of the linkage between molecular and phenotypic changes, we generated a comprehensive dataset that catalogs the transcriptional, proteomic, epigenomic and phenotypic responses of MCF10A mammary epithelial cells after exposure to the ligands EGF, HGF, OSM, IFNG, TGFB and BMP2. Systematic assessment of the molecular and cellular phenotypes induced by these ligands comprise the LINCS Microenvironment (ME) perturbation dataset, which has been curated and made publicly available for community-wide analysis and development of novel computational methods (synapse.org/LINCS_MCF10A). In illustrative analyses, we demonstrate how this dataset can be used to discover functionally related molecular features linked to specific cellular phenotypes.

systems biology↗

bioRxiv2021

Robust Segmentation of Cellular Ultrastructure on Sparsely Labeled 3D Electron Microscopy Images using Deep Learning

A deeper understanding of the cellular and subcellular organization of tumor cells and their interactions with the tumor microenvironment will shed light on how cancer evolves and guide effective therapy choices. Electron microscopy (EM) images can provide detailed view of the cellular ultrastructure and are being generated at an ever-increasing rate. However, the bottleneck in their analysis is the delineation of the cellular structures to enable interpretable rendering. We have mitigated this limitation by using deep learning, specifically, the ResUNet architecture, to segment cells and subcellular ultrastructure. Our initial prototype focuses on segmenting nuclei and nucleoli in 3D FIB-SEM images of tumor biopsies obtained from patients with metastatic breast and pancreatic cancers. Trained with sparse manual labels, our method results in accurate segmentation of nuclei and nucleoli with best Dice score of 0.99 and 0.98 respectively. This method can be extended to other cellular structures, enabling deeper analysis of inter- and intracellular state and interactions.

cancer biology↗

bioRxiv2021

Noise Reconstruction & Removal Network: A New Architecture to Denoise FIB-SEM Images

Recent advances in Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM) allows the imaging and analysis of cellular ultrastructure at nanoscale resolution, but the collection of labels and/or noise-free data sets has several challenges, often immutable. Reasons range from time consuming manual annotations, requiring highly trained specialists, to introducing imaging artifacts from the prolonged scanning during acquisition. We propose a fully unsupervised Noise Reconstruction and Removal Network for denoising scanning electron microscopy images. The architecture, inspired by gated recurrent units, reconstructs and removes the noise by synthesizing the sequential data. At the same time the fully unsupervised training guides the network in distinguishing true signal from noise and gives comparable results to supervised architectures. We demonstrate that this new network specialized on 3D electron microscopy data sets, achieves comparable and even better results than supervised networks.

bioengineering↗

bioRxiv2021

ME-VAE: Multi-Encoder Variational AutoEncoder for Controlling Multiple Transformational Features in Single Cell Image Analysis

Image-based cell phenotyping relies on quantitative measurements as encoded representations of cells; however, defining suitable representations that capture complex imaging features is challenged by the lack of robust methods to segment cells, identify subcellular compartments, and extract relevant features. Variational autoencoder (VAE) approaches produce encouraging results by mapping an image to a representative descriptor, and outperform classical hand-crafted features for morphology, intensity, and texture at differentiating data. Although VAEs show promising results for capturing morphological and organizational features in tissue, single cell image analyses based on VAEs often fail to identify biologically informative features due to uninformative technical variation. Herein, we propose a multi-encoder VAE (ME-VAE) in single cell image analysis using transformed images as a self-supervised signal to extract transform-invariant biologically meaningful features, including emergent features not obvious from prior knowledge. We show that the proposed architecture improves analysis by making distinct cell populations more separable compared to traditional VAEs and intensity measurements by enhancing phenotypic differences between cells and by improving correlations to other analytic modalities.

bioinformatics↗

bioRxiv2021

Transfer Learning for Inference of Metastatic Origin from Whole Slide Histology

Accurate diagnosis of metastatic cancer is essential for prescribing optimal control strategies to halt further spread of metastasizing disease. While pathological inspection aided by immunohistochemistry staining provides a valuable gold standard for clinical diagnostics, deep learning methods have emerged as powerful tools for identifying clinically relevant features of whole slide histology relevant to a tumors metastatic origin. Although deep learning models require significant training data to learn effectively, transfer learning paradigms provide mechanisms to circumvent limited training data by first training a model on related data prior to fine-tuning on smaller data sets of interest. In this work we propose a transfer learning approach that trains a convolutional neural network to infer the metastatic origin of tumor tissue from whole slide images of hematoxylin and eosin (H&E) stained tissue sections and illustrate the advantages of pre-training network on whole slide images of primary tumor morphology. We further characterize statistical dissimilarity between primary and metastatic tumors of various indications on patch-level images to highlight limitations of our indication-specific transfer learning approach. Using a primary-to-metastatic transfer learning approach, we achieved mean class-specific areas under receiver operator characteristics curve (AUROC) of 0.779, which outperformed comparable models trained on only images of primary tumor (mean AUROC of 0.691) or trained on only images of metastatic tumor (mean AUROC of 0.675), supporting the use of large scale primary tumor imaging data in developing computer vision models to characterize metastatic origin of tumor lesions.

pathology↗

bioRxiv2021

Relevance of Circulating Hybrid Cells as a Non-Invasive Biomarker for Myriad Solid Tumors

AbstractMetastatic progression defines the final stages of tumor evolution and underlies the majority of cancer-related deaths. The heterogeneity in disseminated tumor cell populations capable of seeding and growing in distant organ sites contributes to the development of treatment resistant disease. We recently reported the identification of a novel tumor-derived cell population, circulating hybrid cells (CHCs), harboring attributes from both macrophages and neoplastic cells, including functional characteristics important to metastatic spread. These disseminated hybrids outnumber conventionally defined circulating tumor cells (CTCs) in cancer patients. It is unknown if CHCs represent a generalized cancer mechanism for cell dissemination, or if this population is relevant to the metastatic cascade. Herein, we detect CHCs in the peripheral blood of patients with cancer in myriad disease sites encompassing epithelial and non-epithelial malignancies. Further, we demonstrate that in vivo-derived hybrid cells harbor tumor-initiating capacity in murine cancer models and that CHCs from human breast cancer patients express stem cell antigens, features consistent with the ability to seed and grow at metastatic sites. Finally, we reveal heterogeneity of CHC phenotypes reflect key tumor features, including oncogenic mutations and functional protein expression. Importantly, this novel population of disseminated neoplastic cells opens a new area in cancer biology and renewed opportunity for battling metastatic disease. Simple SummaryThere is an incomplete understanding of circulating neoplastic cell populations and the fundamental mechanisms that drive dissemination, immune evasion, and growth --all critical information to more effectively prevent and treat cancer progression. A novel disseminated tumor cell population, circulating hybrid cells, are detected across many cancer types and carry functional tumor-initiating properties. Additionally, circulating hybrid cells are found at significantly higher levels than conventionally defined circulating tumor cells. Our study demonstrates that neoplastic hybrid cells harbor phenotypic and genetic characteristics of tumor and immune cells, display stem features, and are a generalizable phenomenon in solid tumors. Circulating hybrid cells therefore have relevance as a novel biomarker and open a new field of study in malignancy.

cancer biology↗

bioRxiv2020

Toward reproducible, scalable, and robust data analysis across multiplex tissue imaging platforms

The emergence of megascale single-cell multiplex tissue imaging (MTI) datasets necessitates reproducible, scalable, and robust tools for cell phenotyping and spatial analysis. We developed open-source, graphics processing unit (GPU)-accelerated tools for intensity normalization, phenotyping, and microenvironment characterization. We deploy the toolkit on a human breast cancer (BC) tissue microarray stained by cyclic immunofluorescence and benchmark our cell phenotypes against a published MTI dataset. Finally, we demonstrate an integrative analysis revealing BC subtype-specific features.

systems biology↗

bioRxiv2020

An Integrated Clinical, Omic, and Image Atlas of an Evolving Metastatic Breast Cancer

Mechanisms of therapeutic resistance manifest in metastatic cancers as tumor cell intrinsic alterations and extrinsic microenvironmental influences that can change during treatment. To support the development of methods for the identification of these mechanisms in individual patients, we present here an Omic and Multidimensional Spatial (OMS) Atlas generated from four serial biopsies of a metastatic breast cancer patient during 3.5 years of therapy. This resource links detailed, longitudinal clinical metadata including treatment times and doses, anatomic imaging, and blood-based response measurements to exploratory analytics including comprehensive DNA, RNA, and protein profiles, images of multiplexed immunostaining, and 2- and 3-dimensional scanning electron micrographs. These data reveal aspects of therapy-associated heterogeneity and evolution of the cancers genome, signaling pathways, immune microenvironment, cellular composition and organization, and ultrastructure. We present illustrative examples showing how integrative analyses of these data provide insights into potential mechanisms of response and resistance, and suggest novel therapeutic vulnerabilities.

cancer biology↗

bioRxiv2020

VISTA: Virtual ImmunoSTAining for pancreatic disease quantification in murine cohorts

Mechanistic studies of pancreatic disease progression using animal models require objective and quantifiable assessment of tissue changes among animal cohorts. Disease state quantification, however, relies heavily on tissue immunostaining, which can be expensive, labor- and time-intensive, and all too often produces uneven staining that is prone to variable interpretation between experts and inaccurate quantification. Here we develop a fully automated semantic segmentation tool using deep learning for the rapid and objective quantification of histologic features using hematoxylin and eosin (H&E) stained pancreatic tissue sections acquired from murine pancreatic cancer models. The tool was successfully trained to segment and quantify multiple histopathologic features of pancreatic pre-cancer evolution, including normal acinar structures, the ductal phenotype of acinar-to ductal metaplasia (ADM), dysplasia, and the expanding stromal compartment. Disease quantifications produced by our computational tool were highly correlated to the results obtained by immunostaining markers of normal and diseased tissue (DAPI, amylase, and cytokeratins; correlation score= 0.9, 0.95, and 0.91, respectively) and were able to accurately reproduce immunostain patterns. Moreover, our tool was able to distinguish ADM from dysplasia, which are not reliably distinguished by immunostaining, and avoid the pitfalls of uneven or poor-quality staining. Using this tool, we quantified the changes in histologic feature abundance for murine cohorts with oncogenic Kras-driven disease at 2 months and 5 months of age (n=12, n=13). The calculated changes in histologic feature abundance were consistent with biological expectations, showing an expansion of the stromal compartment, a reduction of normal acinar tissue, and an increase in both ADM and dysplasia as disease progresses (p= 2e-6, 6e-7, 4e-4, and 3e-5, respectively). These results demonstrate the tools efficacy for accurate and rapid quantification of multiple histologic features using an objective and automated platform. Our tool promises to rapidly accelerate and improve the quantification of altered pancreatic disease progression in animal studies.

bioinformatics↗