bioRxiv Science⌕ Search

Biology subjects

Mannella, F.

Publications and source records attributed to Mannella, F..

2 recordsLinked to original sources

Interactions between supervised and reinforcement learning processes in a neurorobotic model

Several influential works propose that the acquisition of motor behavior involves different learning mechanisms in the brain, in particular supervised and reinforcement learning, that are respectively associated with cerebellar-thalamocortical and basal ganglia-thalamocortical networks. Despite increasing evidence suggesting anatomical and functional interactions between these circuits, the learning processes operating within them are studied in isolation, neglecting their strong interdependence. This article proposes a bio-inspired neurorobotic model implementing a possible cooperation mechanism between supervised and reinforcement learning. The model, validated with empirical data from healthy participants and patients with cerebellar ataxia, shows how the integration of the two learning processes could lead to benefit both learning performance and movement accuracy.

bioengineering↗

Active inference through whiskers

Rodents use whisking to probe actively their environment and to locate objects in space, hence providing a paradigmatic biological example of active sensing. Numerous studies show that the control of whisking has anticipatory aspects. For example, rodents target their whisker protraction to the distance at which they expect objects, rather than just reacting fast to contacts with unexpected objects. Here we characterize the anticipatory control of whisking in rodents as an active inference process. In this perspective, the rodent is endowed with a prior belief that it will touch something at the end of the whisker protraction, and it continuously modulates its whisking amplitude to minimize (proprioceptive and somatosensory) prediction errors arising from an unexpected whisker-object contact, or from a lack of an expected contact. We will use the model to qualitatively reproduce key empirical findings about the ways rodents modulate their whisker amplitude during exploration and the scanning of (expected or unexpected) objects. Furthermore, we will discuss how the components of active inference model can in principle map to the neurobiological circuits of rodent whisking.

animal behavior and cognition↗