bioRxiv Science⌕ Search

Biology subjects

Warne, D. J.

Publications and source records attributed to Warne, D. J..

7 recordsLinked to original sources

An explainable machine learning consensus framework for robust estimations of environmental effects on population dynamics

Explainable machine learning (ML) methods are gaining increasing attention in environmental and ecological research for their ability to reveal relationships between environmental drivers and population dynamics. However, there remain questions on the reliability of these tools, especially given recent research shows that these explanations can be highly sensitive to model architecture. In ecology, it is typical to use a single ML model, and a comparative evaluation of sensitivity of explainability for different ML approaches is overlooked. In this paper, we develop a novel framework that quantifies explanation consistency between multiple ML model architectures. This framework provides a discrepancy measure for each model prediction, with high discrepancy indicating substantive explanation disagreement across models and low discrepancy indicating strong consensus in explanations across models. We then demonstrate that low explanation discrepancy aligns well with ground truth mechanism. Furthermore, high explanation discrepancy provide a mechanism to identify areas for model refinement and further investigation by domain experts. We do this by using a simulation study based on synthetic coral cover data that incorporate spatio-temporal variability driven by known disturbance effects. Our method provides a quantitative approach to assess the sensitivity of explainable ML in the absence of ground truth. As a result, this enhances the utility of ML approaches in conservation and ecological management. While we focus primarily on ecological modelling for coral reefs, our methods are generally applicable to other ecological and environmental modelling settings.

ecology↗

Parameter estimation and identifiability analysis of stability and tipping points in potentially bistable ecosystems

Ecological regime shifts are potentially a common property of ecosystems, describing transitions between alternative stable states that can represent healthy or unhealthy conditions under the same environmental drivers. Once a tipping point, defined as a critical threshold separating alternative stable states, is crossed, the system may degrade and recovery can be difficult, making early detection essential for effective ecosystem management. Predicting these tipping points requires models that exhibit bistability, representing systems that can exist in two alternative stable states under identical environmental conditions. A key question is whether standard ecological monitoring data can be used to identify bistability and accurately estimate tipping points. Using the Carpenter model of lake eutrophication, which expresses bistability between clear and polluted water states, we generate synthetic data under known stability regimes. Profile likelihood analysis is then applied to assess parameter identifiability and detect system stability and tipping points. Our results show that standard monitoring data do not always provide sufficient information to distinguish bistable from stable regimes. Importantly, bistability and tipping points become practically identifiable only when data are collected very close to the tipping point.

ecology↗

A multilevel hierarchical framework for quantification of experimental heterogeneity

Biological systems exhibit substantial heterogeneity: that is, variation in specific characteristics of individuals within a population. As a result, it is of critical importance to appropriately account for biological heterogeneity when calibrating mathematical models to infer cellular processes and predict behaviour. Recent approaches consider ordinary differential equations with random parameters to quantify heterogeneity in dynamical processes of cells. In this setting, statistical inference is performed to characterise the distribution of these random parameters within a cell population. One significant limitation of this approach is the tacit assumption that there are no substantial deviations in these distributions across experimental replicates. In this work, we propose a flexible Bayesian hierarchical differential equation modelling framework that quantifies and distinguishes both inter-experimental heterogeneity (heterogeneity between experimental replicates) and intra-experimental heterogeneity (biological heterogeneity within replicate populations). We consider two recent studies that employ mathematical models to interpret flow cytometry snap-shot data and quantify heterogeneity in nano-particle cell interactions and cell internalisation processes. Using simulation data, we demonstrate that substantial inaccuracy in the inferred dynamics can arise when experimental heterogeneity is not accounted for. By contrast, our hierarchical approach is robust to variability in inter-experimental and intra-experimental heterogeneity and our method simplifies to previous methods when inter-experimental heterogeneity is negligible. Our approach is flexible and widely applicable to applications involving replicate populations and snapshot data.

cell biology↗

Parameter-wise predictions and sensitivity analysis forrandom walk models in the life sciences

Sensitivity analysis characterises input-output relationships for mathematical models, and has been widely applied to deterministic models across many applications in the life sciences. In contrast, sensitivity analysis for stochastic models has received less attention, with most previous work focusing on well-mixed, non-spatial problems. For explicit spatio-temporal stochastic models, such as random walk models (RWMs), sensitivity analysis has received far less attention. Here we present a new type of sensitivity analysis, called parameter-wise prediction, for two types of biologically-motivated and computationally expensive RWMs. To overcome the limitations of directly analysing stochastic simulations, we employ continuum-limit partial differential equation (PDE) descriptions as surrogate models, and we link these efficient surrogate descriptions to the RWMs using a range of biophysically-motivated measurement error models. Our approach is likelihood-based, which means that we also consider likelihood-based parameter estimation and identifiability analysis along with parameter sensitivity. The new approach is presented for two important classes of lattice-based RWM including a classical model where crowding effects are neglected, and an exclusion process model that explicitly incorporates crowding. Our workflow illustrates how different process models can be combined with different measurement error models to reveal how each parameter impacts the outcome of the expensive stochastic simulation. Open-access software to replicate all results is available on GitHub.

biophysics↗

Computationally efficient framework for diagnosing, understanding, and predicting biphasic population growth

Throughout the life sciences, biological populations undergo multiple phases of growth, often referred to as biphasic growth for the commonly-encountered situation involving two phases. Biphasic population growth occurs over a massive range of spatial and temporal scales, ranging from microscopic growth of tumours over several days, to decades-long re-growth of corals in coral reefs that can extend for hundreds of kilometres. Different mathematical models and statistical methods are used to diagnose, understand, and predict biphasic growth. Common approaches can lead to inaccurate predictions of future growth that may result in inappropriate management and intervention strategies being implemented. Here we develop a very general computationally efficient framework, based on profile likelihood analysis, for diagnosing, understanding, and predicting biphasic population growth. The two key components of the framework are: (i) an efficient method to form approximate confidence intervals for the change point of the growth dynamics and model parameters; and, (ii) parameter-wise profile predictions that systematically reveal the influence of individual model parameters on predictions. To illustrate our framework we explore real-world case studies across the life sciences.

systems biology↗

Parameter identifiability and model selection for sigmoid population growth models

Sigmoid growth models, such as the logistic, Gompertz and Richards models, are widely used to study population dynamics ranging from microscopic populations of cancer cells, to continental-scale human populations. Fundamental questions about model selection and parameter estimation are critical if these models are to be used to make practical inferences. However, the question of parameter identifiability - whether a data set contains sufficient information to give unique or sufficiently precise parameter estimates - is often overlooked. We use a profile-likelihood approach to explore practical parameter identifiability using data describing the re-growth of hard coral. With this approach, we explore the relationship between parameter identifiability and model misspecification, finding that the logistic growth model does not suffer identifiability issues for the type of data we consider whereas the Gompertz and Richards models encounter practical non-identifiability issues. This analysis of parameter identifiability and model selection is important because different growth models are used within areas of the biological modelling literature without necessarily considering whether parameters are identifiable, or checking statistical assumptions underlying model adequacy. Standard practices that do not consider parameter identifiability can lead to unreliable or imprecise parameter estimates and potentially misleading mechanistic interpretations. While tools developed here focus on three standard sigmoid growth models only, our theoretical developments are applicable to any sigmoid growth model and any relevant data set. MATLAB implementations of all software are available on GitHub.

ecology↗

Listen to the noise: identifiability analysis for stochastic differential equation models in systems biology

Mathematical models are routinely calibrated to experimental data, with goals ranging from building predictive models to quantifying parameters that cannot be measured. Whether or not reliable parameter estimates are obtainable from the available data can easily be overlooked. Such issues of parameter identifiability have important ramifications for both the predictive power of a model, and the mechanistic insight that can be obtained. Identifiability analysis is well-established for deterministic, ordinary differential equation (ODE) models, but there are no commonly-adopted methods for analysing identifiability in stochastic models. We provide an accessible introduction to identifiability analysis and demonstrate how existing ideas for analysis of ODE models can be applied to stochastic differential equation (SDE) models through four practical case studies. To assess structural identifiability, we study ODEs that describe the statistical moments of the stochastic process using open-source software tools. Using practically-motivated synthetic data and Markov-chain Monte Carlo (MCMC) methods, we assess parameter identifiability in the context of available data. Our analysis shows that SDE models can often extract more information about parameters than deterministic descriptions. All code used to perform the analysis is available on Github.

systems biology↗