Sabatini, S. P. | bioRxiv Science

bioRxiv2022

Active Fixation as an Efficient Coding Strategy for Neuromorphic Vision

Contrary to a photographer, who puts a great effort in keeping the lens still, eyes insistently move even during fixation. This benefits signal decorrelation, which underlies an efficient encoding of visual information. Yet, camera motion is not sufficient alone; it must be coupled with a sensor specifically selective to temporal changes. Indeed, motion induced on standard imagers only results in burring effects. Neuromorphic sensors represent a valuable solution. Here we characterize the response of an event-based camera equipped with Fixational Eye Movements (FEMs) on both synthetic and natural images. Our analyses prove that the system starts an early stage of redundancy suppression, as a precursor of subsequent whitening processes on the amplitude spectrum. This does not come at the price of corrupting structural information contained in local spatial phase across oriented axes. Isotropy of FEMs ensures proper representations of image features without introducing biases towards specific contrast orientations.

bioengineering↗

bioRxiv2020

Self-operated stimuli improve subsequent visual motion processing

Proper interpretation of visual information requires capturing the structural regularities in the visual signal and this frequently occurs in conjunction with movement. Perceptual interpretation is complicated both by transient perceptual changes that accompany motor activity, and as found in audition and somatosensation, by more persistent changes that accompany the learning of new movements. Here we asked whether motor learning also results in sustained changes to visual perception. We designed a reaching task in which participants directly controlled the visual information they received, which we term self-operated stimuli. Specifically, they trained to make movements in a number of directions. Directional information was provided by the motion of an intrinsically ambiguous moving stimulus which was directly tied to motion of the hand. We find that movement training improves perception of coherent stimulus motion, and that changes in movement are correlated with the perceptual change. No perceptual changes are observed in passive observers even when they are provided with an explicit strategy to solve perceptual grouping. Comparison of empirical perceptual data with simulations based on a Bayesian generative model of motion perception suggests that movement training promotes the fine-tuning of the internal representation of stimulus geometry. These results emphasize the role of sensorimotor interaction in determining the persistent properties in space and time that define a percept.

neuroscience↗