Noel, J.-P. G. | bioRxiv Science

bioRxiv2024

Dorsolateral prefrontal cortex drives strategic aborting by optimizing long-run policy extraction

Real world choices often involve balancing decisions that are optimized for the short-vs. long-term. Here, we reason that apparently sub-optimal single trial decisions in macaques may in fact reflect long-term, strategic planning. We demonstrate that macaques freely navigating in VR for sequentially presented targets will strategically abort offers, forgoing more immediate rewards on individual trials to maximize session-long returns. This behavior is highly specific to the individual, demonstrating that macaques reason about their own long-run performance. Reinforcement-learning (RL) models suggest this behavior is algorithmically supported by modular actor-critic networks with a policy module not only optimizing long-term value functions, but also informed of specific state-action values allowing for rapid policy optimization. The behavior of artificial networks suggests that changes in policy for a matched offer ought to be evident as soon as offers are made, even if the aborting behavior occurs much later. We confirm this prediction by demonstrating that single units and population dynamics in macaque dorsolateral prefrontal cortex (dlPFC), but not parietal area 7a or dorsomedial superior temporal area (MSTd), reflect the upcoming reward-maximizing aborting behavior upon offer presentation. These results cast dlPFC as a specialized policy module, and stand in contrast to recent work demonstrating the distributed and recurrent nature of belief-networks.

neuroscience↗

bioRxiv2020

Inflexible Updating of the Self-Other Divide During a Social Context in Autism; Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Autism spectrum disorder (ASD) is a heterogenous disorder predominantly characterized by social and communicative differences, but increasingly recognized to also alter (multi)sensory function. To face the heterogeneity and ubiquity of ASD, researchers have proposed models of statistical inference operating at the level of computations. Here, we attempt to bridge both across domains - from social to sensory - and levels of description - from behavioral computations to neural ensemble activity to a biologically-plausible artificial neural network - in furthering our understanding of autism. We do so by mapping visuo-tactile peri-personal space (PPS), and examining its electroencephalography (EEG) correlates, in individuals with ASD and neurotypical individuals during both a social and non-social context given that (i) the sensory coding of PPS is well understood, (ii) this space is thought to distinguish between self and other, and (iii) PPS is known to remap during social interactions. In contrast to their neurotypical counterparts, psychophysical and EEG evidence suggested that PPS does not remap in ASD during a social context. To account for this observation, we then employed a neural network model of PPS and demonstrate that PPS remapping may be driven by changes in neural gain operating at the level of multisensory neurons. Critically, under the anomalous excitation-inhibition (E/I) regime of ASD, this gain modulation does not result in PPS resizing. Overall, our findings are in line with recent statistical inference accounts suggesting diminished flexibility in ASD, and further these accounts by demonstrating within an example relevant for social cognition that such inflexibility may be due to E/I imbalances.

neuroscience↗