Pellencin, E. | bioRxiv Science

bioRxiv2019

Rapid Recalibration of Peri-Personal Space; Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Interactions between individuals and the environment are mediated by the body and occur within the peri-personal space (PPS) - the space surrounding the body. The multisensory encoding of this space plastically adapts to different bodily constraints and stimuli features. However, these remapping effects have only been demonstrated on the time-scale of days, hours, or minutes. Yet, if PPS mediates human-environment interactions in an adaptive manner, its representation should be altered by sensory history on trial-to-trial timescale. Here we test this idea first via a visuo-tactile reaction time paradigm in augmented reality where participants are asked to respond as fast as possible to touch, as visual object approach them. Results demonstrate that reaction times to touch are facilitated as a function of visual proximity, and the sigmoidal function describing this facilitation shifts closer to the body if the immediately precedent trial had indexed a smaller visuo-tactile disparity (i.e., positive serial dependency). Next, we derive the electroencephalographic correlates of PPS and demonstrate that this measure is equally shaped by recent sensory history. Finally, we demonstrate that a validated neural network model of PPS is able to account for the present results via a simple Hebbian plasticity rule. The present findings suggest that PPS encoding remaps on a very rapid time-scale and is sensitive to recent sensory history.

neuroscience↗

bioRxiv2018

Predictive coding of action intentions in dorsal and ventral visual stream is based on visual anticipations, memory-based information and motor preparation

Predictions of upcoming movements are based on several types of neural signals that span the visual, somatosensory, motor and cognitive system. Thus far, pre-movement signals have been investigated while participants viewed the object to be acted upon. Here, we studied the contribution of information other than vision to the classification of preparatory signals for action, even in absence of online visual information. We used functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA) to test whether the neural signals evoked by visual, memory-based and somato-motor information can be reliably used to predict upcoming actions in areas of the dorsal and ventral visual stream during the preparatory phase preceding the action, while participants were lying still. Nineteen human participants (nine women) performed one of two actions towards an object with their eyes open or closed. Despite the well-known role of ventral stream areas in visual recognition tasks and the specialization of dorsal stream areas in somato-motor processes, we decoded action intention in areas of both streams based on visual, memory-based and somato-motor signals. Interestingly, we could reliably decode action intention in absence of visual information based on neural activity evoked when visual information was available, and vice-versa. Our results show a similar visual, memory and somato-motor representation of action planning in dorsal and ventral visual stream areas that allows predicting action intention across domains, regardless of the availability of visual information.

neuroscience↗