bioRxiv Science⌕ Search

Biology subjects

Lizier, J. T.

Publications and source records attributed to Lizier, J. T..

6 recordsLinked to original sources

Inferring Effective Networks of Spiking Neurons Using a Continuous-Time Estimator of Transfer Entropy

When analysing high-dimensional time-series datasets, the inference of effective networks has proven to be a valuable modelling technique. This technique produces networks where each target node is associated with a set of source nodes that are capable of providing explanatory power for its dynamics. Multivariate Transfer Entropy (TE) has proven to be a popular and effective tool for inferring these networks. Recently, a continuous-time estimator of TE for event-based data such as spike trains has been developed which, in more efficiently representing event data in terms of inter-event intervals, is significantly more capable of measuring multivariate interactions. The new estimator thus presents an opportunity to more effectively use TE for the inference of effective networks from spike trains, and we demonstrate in this paper for the first time its efficacy at this task. Using data generated from models of spiking neurons -- for which the ground-truth connectivity is known -- we demonstrate the accuracy of this approach in various dynamical regimes. We further show that it exhibits far superior inference performance to a pairwise TE-based approach as well as a recently-proposed convolutional neural network approach. Moreover, comparison with Generalised Linear Models (GLMs), which are commonly applied to spike-train data, showed clear benefits, particularly in cases of high synchrony. Finally, we demonstrate its utility in revealing the patterns by which effective connections develop from recordings of developing neural cell cultures.

neuroscience↗

Early lock-in of structured and specialised information flows during neural development

The brains of many organisms are capable of complicated distributed computation underpinned by a highly advanced information processing capacity. Although substantial progress has been made towards characterising the information flow component of this capacity in mature brains, there is a distinct lack of work characterising its emergence during neural development. This lack of progress has been largely driven by the lack of effective estimators of information processing operations for the spiking data available for developing neural networks. Here, we leverage recent advances in this estimation task in order to quantify the changes in information flow during development. We do so by studying the changes in the intrinsic dynamics of the spontaneous activity of developing dissociated neural cell cultures. We find that the quantity of information flowing across these networks undergoes a dramatic increase across development. Moreover, the spatial structure of these flows is locked-in during early development, after which there is a substantial temporal correlation in the information flows across recording days. We analyse the flow of information during the crucial periods of population bursts. We find that, during these bursts, nodes undertake specialised computational roles as either transmitters, mediators or receivers of information, with these roles tending to align with their spike ordering -- either early, mid or late in the bursts. Further, we find that the specialised computational roles occupied by nodes during bursts tend to be locked-in early. Finally, we briefly compare these results to information flows in a model network developing according to an STDP learning rule from a state of independent firing to synchronous bursting. The phenomena of large increases in information flow, early lock-in of information flow spatial structure and computational roles based on burst position were also observed in this model, hinting at the broader generality of these phenomena. AUTHOR SUMMARYThis paper studies the development of computation in biological systems by analysing changes in the flow of information in developing neural cell cultures. Although there have been a number of previous studies of information flows in neural cell cultures, this work represents the first study which compares information flows in the intrinsic dynamics across development time. Moreover, we make use of a recently proposed continuous-time transfer entropy estimator for spike trains, which, in comparison to the discrete-time estimator used previously, is able to capture important effects occurring on both small and large timescales simultaneously. We find that information flows begin to emerge after 5-10 days of activity, and crucially, the spatial structure of information flows remains significantly temporally correlated over the first month of recording. Furthermore, the magnitude of information flows across the culture are strongly related to burst position, and the roles of regions as information flow sources, sinks and mediators are found to remain consistent across development. Finally, we confirm that these early lock-ins also occur in a simple model network developing under an STDP update rule, suggesting a plausible mechanism undergirding this phenomenon.

neuroscience↗

Self-organization and information transfer in Antarctic krill swarms

Antarctic krill swarms are one of the largest known animal aggregations. However, despite being the keystone species of the Southern Ocean, little is known about how swarms are formed and maintained, and we lack a detailed understanding of the local interactions between individuals that provide the basis for these swarms. Here we analyzed the trajectories of captive, wild-caught krill in 3D to determine individual level interaction rules and quantify patterns of information flow. Our results suggest krill operate a novel form of collective organization, with measures of information flow and individual movement adjustments expressed most strongly in the vertical dimension, a finding not seen in other swarming species. In addition, local directional alignment with near neighbors, and strong regulation of both direction and speed relative to the positions of groupmates suggest social factors are vital to the formation and maintenance of swarms. This research represents a first step in understanding the fundamentally important swarming behavior of krill.

animal behavior and cognition↗

Topological Augmentation of Latent Information Streams in Feed-Forward Neural Networks

Network neuroscience has yielded crucial insights into the systems-level organisation of the brain, however the indirect nature of neuroimaging recordings has rendered the discovery of generative mechanisms for a given function inherently challenging. In parallel, neural network machine-learning models have exhibited breakthrough performance in tackling a range of complex problems, however the principles that govern learning-induced modifications to network structure remain poorly understood, in part due to a lack of analytic tools to quantify the dynamics of network structure. While the question of how network reconfiguration supports learning is mirrored in machine learning and network neuroscience, the different contexts of these fields provides a timely opportunity to bring them together synergistically to investigate the problem. Here we combine these two approaches to reveal connections between the brains network structure and the emerging network structure of an artificial neural network. Specifically, we train a shallow, feedforward neural network to classify handwritten digits and then used a combination of systems neuroscience and information theoretic tools to perform virtual brain analytics on the resultant edge weights and activity patterns of each node. We identify three distinct phases of network reconfiguration across learning, each of which are characterised by unique topological and information-theoretic signatures. Each phase involves aligning the connections of the neural network with patterns of information contained in the input dataset or preceding layers (as relevant). We also observe a process of low-dimensional category separation in the network as a function of learning. Our results offer a systems-level perspective of how artificial neural networks function - in terms of multi-stage reorganization of edge weights and activity patterns to effectively exploit the information content of input data during edge-weight training - while simultaneously enriching our understanding of the methods used by systems neuroscience.

neuroscience↗

Transitions in brain-network level information processing dynamics are driven by alterations in neural gain

A key component of the flexibility and complexity of the brain is its ability to dynamically adapt its functional network structure between integrated and segregated brain states depending on the demands of different cognitive tasks. Integrated states are prevalent when performing tasks of high complexity, such as maintaining items in working memory, consistent with models of a global workspace architecture. Recent work has suggested that the balance between integration and segregation is under the control of ascending neuromodulatory systems, such as the noradrenergic system. In a previous large-scale nonlinear oscillator model of neuronal network dynamics, we showed that manipulating neural gain led to a critical transition in phase synchrony that was associated with a shift from segregated to integrated topology, thus confirming our original prediction. In this study, we advance these results by demonstrating that the gain-mediated phase transition is characterized by a shift in the underlying dynamics of neural information processing. Specifically, the dynamics of the subcritical (segregated) regime are dominated by information storage, whereas the supercritical (integrated) regime is associated with increased information transfer (measured via transfer entropy). Operating near to the critical regime with respect to modulating neural gain would thus appear to provide computational advantages, offering flexibility in the information processing that can be performed with only subtle changes in gain control. Our results thus link studies of whole-brain network topology and the ascending arousal system with information processing dynamics, and suggest that the constraints imposed by the ascending arousal system constrain low-dimensional modes of information processing within the brain.\n\nAuthor summaryHigher brain function relies on a dynamic balance between functional integration and segregation. Previous work has shown that this balance is mediated in part by alterations in neural gain, which are thought to relate to projections from ascending neuromodulatory nuclei, such as the locus coeruleus. Here, we extend this work by demonstrating that the modulation of neural gain alters the information processing dynamics of the neural components of a biophysical neural model. Specifically, we find that low levels of neural gain are characterized by high Active Information Storage, whereas higher levels of neural gain are associated with an increase in inter-regional Transfer Entropy. Our results suggest that the modulation of neural gain via the ascending arousal system may fundamentally alter the information processing mode of the brain, which in turn has important implications for understanding the biophysical basis of cognition.

neuroscience↗

Activating task relevant prior knowledge increases active information storage in content specific brain areas

Predictive coding suggests that the brain infers the causes of its sensations by combining sensory evidence with internal predictions based on available prior knowledge. However, the neurophysiological correlates of (pre-)activated prior knowledge serving these predictions are still unknown. Based on the idea that such pre-activated prior knowledge must be maintained until needed we measured the amount of maintained information in neural signals via the active information storage (AIS) measure. AIS was calculated on whole-brain beamformer-reconstructed source time-courses from magnetoencephalography (MEG) recordings of 52 human subjects during the baseline of a Mooney face/house detection task. Pre-activation of prior knowledge for faces showed as alpha- and beta-band related AIS increases in content specific areas; these AIS increases were behaviourally relevant in brain area FFA. Further, AIS allowed decoding of the cued category on a trial-by-trial basis. Moreover, top-down transfer of predictions estimated by transfer entropy was associated with beta frequencies. Our results support accounts that activated prior knowledge and the corresponding predictions are signalled in low-frequency activity (<30 Hz).\n\nSignificance statementOur perception is not only determined by the information our eyes/retina and other sensory organs receive from the outside world, but strongly depends also on information already present in our brains like prior knowledge about specific situations or objects. A currently popular theory in neuroscience, predictive coding theory, suggests that this prior knowledge is used by the brain to form internal predictions about upcoming sensory information. However, neurophysiological evidence for this hypothesis is rare - mostly because this kind of evidence requires making strong a-priori assumptions about the specific predictions the brain makes and the brain areas involved. Using a novel, assumption-free approach we find that face-related prior knowledge and the derived predictions are represented and transferred in low-frequency brain activity.

neuroscience↗