bioRxiv Science⌕ Search

bioRxiv · 10.1101/2023.12.13.571560

Enhanced neural representation of reach target direction for high reward magnitude but not high target probability.

Abstract

Many characteristics of goal-directed movements, such as their initiation time, initial direction, and speed, are influenced both by the details of previously executed movements (i.e. action history), and by the degree to which previous movements were rewarded or punished (i.e. reward history). In reinforcement learning terms, when movements are externally cued, action and reward history jointly define the probability and magnitude of positive/negative outcomes of available options, and therefore their pre-stimulus expected value. To dissociate which of these neurocomputational variables influence sensorimotor brain processing, we studied how reach behaviour and evoked brain responses are affected by independent manipulations of action and reward history. We found that movements were initiated earlier both for more frequently repeated targets and targets associated with higher reward magnitude, but only movements to highly rewarded targets had higher movement speeds. Classical visually-evoked encephalographic (EEG) potentials (P1/N1) were not affected by either reward magnitude or target probability. There were, however, amplified midline ERP responses at centroparietal electrodes for rewarded targets and movements compared to control, but no differences between more frequently presented targets and control. Critically, the spatial precision of decoded target locations extracted from a multivariate linear decoding model of EEG data was greater for target locations associated with higher reward magnitude than for control target locations ([~]150-300ms after target presentation). Again, there were no differences in the precision of decoded target direction representations between more frequent target locations and control target locations. These data suggest that the expected reward magnitude associated with an action, rather than its long-run expected value, determines the precision of early sensorimotor processing. Significance StatementWe move more quickly and more accurately toward goals that we value more highly, and this is due partly to enhanced motor preparation. However, our expectations about the value of an action depend both on the probability of its requirement and the magnitude of the reward associated with it. Here we disentangled the influence of reward magnitude and probability on early sensorimotor processing via a multivariate linear decoding approach to extract target direction from scalp encephalograms. We found that the spatial precision of decoded target direction was greater for high reward targets but not for more probable targets. Thus, early sensorimotor processing is sharpened when the magnitude of reward associated with movement to a cued target is high. HighlightsO_LIThe direction of movement can be reliably decoded from the scalp EEG from [~]80ms after target presentation. C_LIO_LIThe neural representation of movement direction is more precise for targets that are associated with high reward, but not for targets that are more probable. C_LIO_LIThe magnitude of reward associated with movement to a presented target, rather than the long-run expected value of the movement, sharpens the spatial precision of early sensorimotor processing. C_LI

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Keane, B., Reuter, E., Manzone, J., Miller-Mills, B., Leow, L.-A., Welsh, T., Carroll, T. J.. 2023-12-14. Enhanced neural representation of reach target direction for high reward magnitude but not high target probability.. https://doi.org/10.1101/2023.12.13.571560

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Same Movements, Different Skills: How Context Shapes Learning in Humans and Neural Networks

What determines whether experiences are integrated into shared representations or split? Motor skill learning offers a revealing test: when two tasks require an identical sequence of movements, both intuition and theory suggest that practice in one should generalize to the other. Yet we find that changing context can make identical movements different skills. In simple recurrent networks trained on the same sequence across contexts, splitting was greatest when strong contextual inputs coincided with a high initial weight scale; neither alone sufficed. Greater representational separation coincided with separate context-specific learning curves. Humans practicing the same finger sequence while alternating between two performance-irrelevant contexts likewise exhibited context-specific curves, rather than the single continuous trajectory observed when practicing in a single context. State-space modeling favored split learning states in humans and very weakly coupled states in the most context-dependent networks. These findings have broader implications for understanding how learning generalizes across contexts.

neuroscience↗

Postpartum resource scarcity reshapes maternal care, offspring prioritization, and the steroid-sensitive medial preoptic area

Parental care requires balancing offspring needs with environmental constraints, yet how resource scarcity alters the organization of maternal responses remains poorly understood. Here, we examined maternal behavior, offspring prioritization, and steroid receptor-associated extracellular matrix organization in postpartum rats exposed to limited bedding and nesting (LBN) or control conditions with ample nesting materials. LBN increased pup-directed and reduced self-directed behaviors but also increased behavioral entropy, a measure of behavioral fragmentation, indicating less predictable caregiving sequences. LBN dams preferentially retrieved male pups first, whereas control dams preferentially retrieved females first. LBN also increased the proportion of pup-investigation time directed toward males compared with controls. In offspring on postnatal day 10, corticosterone was elevated in female but not male LBN pups, a pattern that paralleled the maternal male bias. To identify associated neurobiological changes, we assessed steroid receptors and extracellular matrix organization in the medial preoptic area (mPOA), a key region for maternal behavior. LBN increased numbers of estrogen receptor (ER)- and androgen receptor (AR)-immunoreactive cells, reduced perineuronal net (PNN) abundance, and decreased receptor-positive cell enwrapment. Because PNNs constrain structural plasticity, these findings suggest that the postpartum environment alters the organization of steroid receptor-associated extracellular matrix, potentially modulating experience-dependent plasticity in neurosteroid-sensitive circuits. In sum, LBN increases the levels of maternal engagement while reshaping its temporal organization and allocation, accompanied by selective remodeling of steroid-sensitive preoptic architecture. Therefore, maternal adaptation to adversity may be better understood as changes in caregiving allocation strategies rather than a simple gain or loss of maternal care.

neuroscience↗

The Computational Grammar of Human Behaviour in a Biological Environment

Human behaviour unfolds as an extended stream of spontaneous actions shaped by environmental demands and the agent's goals. The organisation of these actions, situated between setting abstract goals and concrete movement execution, remains poorly characterised. Here, we introduce DynaClade, an unsupervised temporal action segmentation algorithm for human full-body motion capture data, and apply it to freely moving participants navigating ecologically realistic risky foraging environments in virtual reality. DynaClade identifies discrete actions whose kinematic characteristics and spatial distributions correspond to environmental affordances, supporting the validity of the approach. Among these actions, we discovered a hitherto undescribed movement pattern defined by increased body sway without locomotion. Action sequences were highly non-random and showed clear history dependence beyond first-order Markov structure, most of which was explained by a second-order prediction. This higher-order structure was well captured in a hidden Markov model, in which some of the observed actions were associated with more than one latent state. Each of these latent states corresponded to the same action in a distinct action context. These findings suggest that spontaneous human actions are predominantly selected based on the current action and context, rather than following pre-planned or habitually assembled sequences.

neuroscience↗