Deep bidirectional interplay between sensory integration and latent rule discovery

Abstract

Deciphering the structure of variable sensory input is key to building an accurate model of ones environment. Humans can integrate stimulus sequences to estimate their sensory statistics, predict the timing of upcoming stimuli, but also discover rules governing sequence generation. However, whether these three forms of inference operate independently or synergistically remains untested. Here we report selective interactions between sensory integration, temporal prediction, and rule discovery in humans. Participants were exposed to rhythmic sequences of 10 stimuli governed or not by a latent rule - a predictable change in stimulus statistics after 5 stimuli - and then asked to predict the 10th stimulus from incomplete sequences. Individual differences in sensory integration timescale for rule-free sequences predicted efficient rule discovery. Conversely, discovering the latent rule shaped the timescale and format of sensory integration for rule-based sequences. Tampering with the rhythmicity of stimulus presentation impaired rule discovery without affecting sensory integration accuracy. Selective perturbations of recurrent neural networks (RNNs) trained in the same conditions confirmed these specific interactions. Together, these findings provide novel insights into the flexibility of human inferences based on variable yet predictable sensory input.