Biology subjects

Penny, W. D.

Publications and source records attributed to Penny, W. D..

3 recordsLinked to original sources

bioRxiv2022

Cluster-Based Inference for Memory-Based Cognition

This paper proposes a model of hippocampal-based category learning using a cluster-based inference framework which produces two systems (i) an extendable cluster-based memory module (CMM) that provides representations of learning episodes with strong pattern separation, and supports online decision making during that learning, (ii) cluster-based task modules (CTMs) which consolidate clusters learnt by CMM to support higher-accuracy decision making in the mid-term. Learning in CMMs optimises the joint probability of stimuli and category labels, whereas learning in CTMs optimises the probability of categories given stimuli. The latter system learns from the former via a process of "cluster consolidation". We apply the model to data from a behavioral learning task and find that, as well as improving categorisation performance, cluster consolidation decreases recognition scores for old cues but increases them for novel cues. This model-based perspective explains forgetting and false memory effects as serving future categorisation performance. The paper also expresses a view that models of memorybased cognition should provide human-level performance on complex categorisation tasks, and do so with minimal labelled data. In working toward this goal we therefore compared the accuracy of CMM- and CTM-based decision making to standard Softmax Regression approaches on benchmark machine learning datasets. This produced mixed results. We found some significant improvements of CMM over Softmax Regression and of CTM over CMM. Overall, our framework reconciles complementary learning systems theory with more recent findings from cognitive neuroscience of generative replay and hippocampal-based generalisation.

neuroscience↗

bioRxiv2019

Retrospective inference as a form of bounded rationality, and its beneficial influence on learning

Probabilistic models of cognition typically assume that agents make inferences about current states by combining new sensory information with fixed beliefs about the past, an approach known as Bayesian filtering. This is computationally parsimonious, but, in general, leads to suboptimal beliefs about past states, since it ignores the fact that new observations typically contain information about the past as well as the present. This is disadvantageous both because knowledge of past states may be intrinsically valuable, and because it impairs learning about fixed or slowly changing parameters of the environment. For these reasons, in offline data analysis it is usual to infer on every set of states using the entire time series of observations, an approach known as (fixed-interval) Bayesian smoothing. Unfortunately, however, this is impractical for real agents, since it requires the maintenance and updating of beliefs about an ever-growing set of states. We propose an intermediate approach, finite retrospective inference (FRI), in which agents perform update beliefs about a limited number of past states. (Formally, this represents online fixed-lag smoothing with a sliding window.) This can be seen as a form of bounded rationality in which agents seek to optimise the accuracy of their beliefs subject to computational and other resource costs. We show through simulation that this approach has the capacity to significantly increase the accuracy of both inference and learning, using a simple variational scheme applied to both randomly generated Hidden Markov models (HMMs), and a specific application of the HMM, in the form of the widely used probabilistic reversal task. Our proposal thus constitutes a theoretical contribution to normative accounts of bounded rationality, which makes testable empirical predictions that can be explored in future work.

neuroscience↗

bioRxiv2018

Thermodynamic integration for dynamic causal models

In generative modeling of neuroimaging data, such as dynamic causal modeling (DCM), one typically considers several alternative models, either to determine the most plausible explanation for observed data (Bayesian model selection) or to account for model uncertainty (Bayesian model averaging). Both procedures rest on estimates of the model evidence, a principled trade-off between model accuracy and complexity. In DCM, the log evidence is usually approximated using variational Bayes (VB) under the Laplace approximation (VBL). Although this approach is highly efficient, it makes distributional assumptions and can be vulnerable to local extrema. An alternative to VBL is Markov Chain Monte Carlo (MCMC) sampling, which is asymptotically exact but orders of magnitude slower than VB. This has so far prevented its routine use for DCM.\n\nThis paper makes four contributions. First, we introduce a powerful MCMC scheme - thermodynamic integration (TI) - to neuroimaging and present a derivation that establishes a theoretical link to VB. Second, this derivation is based on a tutorial-like introduction to concepts of free energy in physics and statistics. Third, we present an implementation of TI for DCM that rests on population MCMC. Fourth, using simulations and empirical functional magnetic resonance imaging (fMRI) data, we compare log evidence estimates obtained by TI, VBL, and other MCMC-based estimators (prior arithmetic mean and posterior harmonic mean). We find that model comparison based on VBL gives reliable results in most cases, justifying its use in standard DCM for fMRI. Furthermore, we demonstrate that for complex and/or nonlinear models, TI may provide more robust estimates of the log evidence. Importantly, accurate estimates of the model evidence can be obtained with TI in acceptable computation time. This paves the way for using DCM in scenarios where the robustness of single-subject inference and model selection becomes paramount, such as differential diagnosis in clinical applications.

neuroscience↗