bioRxiv Science⌕ Search

Biology subjects

Al Roumi, F.

Publications and source records attributed to Al Roumi, F..

7 recordsLinked to original sources

An ordinal Language of Thought supports human memory for regular sequences

How do humans store sequences that far exceed working memory capacity? Using visuo-spatial and binary auditory sequences, we previously showed that a Language of Thought (LoT) architecture -- in which simple primitives are recursively combined into hierarchical programs -- enables efficient storage of structured sequences. Here we ask whether this principle extends to purely ordinal structure: sequences defined by how items repeat and in what order, as in AABBCCAABBCC, independently of their spatial content. Across three experiments, participants reproduced 12-item sequences of spatial locations with various ordinal structures. The minimal description length derived from the LoT model predicted recall accuracy with remarkable precision (r = .96), substantially outperforming Shannon entropy, Lempel-Ziv complexity, chunking models and subjective complexity ratings. Critically, fine-grained analyses of participants inter-click intervals during reproduction revealed systematic slowdowns at the hierarchical boundaries predicted by the LoT programs, providing a behavioral signature of the underlying mental syntax. These results identify a compact vocabulary of mental primitives -- repetition, mirroring, and interleaving -- whose composition accounts for the symbolic compression of ordinal structures. For ordinal regularities, human sequence memory operates as a form of program induction, leveraging a domain-general capacity for hierarchical compression to encode complex structured information. Author SummaryHuman short-term memory is heavily limited, holding no more than a few items at once. Yet humans routinely memorize complex sequences that far exceed this capacity. How is this possible? We propose that the brain acts like a programmer: rather than storing each element individually, it compresses sequences into short mental "programs." Just as a programmer writes "repeat ABC four times" instead of typing ABCABCABCABC, the brain leverages regularities such as repetitions (ABC-ABC) or mirror patterns (ABC-CBA) to encode sequences efficiently. We tested this idea across three experiments: two in which participants memorized and reproduced sequences of spatial positions on a screen, one where they only rated their perceived complexity. Sequences described by shorter programs were remembered far better and judged as simpler -- even when they were the same length as less structured sequences. When reproducing sequences, participants paused longer at structural boundaries, revealing the internal organization of their mental programs. Strikingly, program length predicted memory performance better than participants own complexity ratings, suggesting that these mental representations are not fully accessible to conscious awareness. Finally, we identified key new patterns -- including temporal inversion and interleaving -- that extend the Language of Thought framework. Together, these findings suggest that a compositional Language of Thought is a fundamental aspect of how the human brain efficiently store and represent structured information.

neuroscience↗

A proposal for unifying statistical learning at different scales: Long-Horizon Associative Learning

Sensory inputs are rich with temporal patterns that unfold across multiple timescales. Discovering these regularities is essential for predicting future events and navigating the environment efficiently. Numerous models have been proposed to account for learning at specific temporal scales; however, they are often designed in isolation and rely on narrowly tuned statistical measures, limiting their generalizability to other paradigms. In contrast, humans typically learn without prior knowledge of the underlying structure or the relevant timescale at which regularities occur. Here, we present a unifying account of statistical learning that spans a wide range of temporal dependencies, from adjacent and non-adjacent transitions to complex network structures. This model, Long-Horizon Associative Learning (L-HAL), offers a biologically grounded implementation of the successor representation, or equivalently, the Free Energy Minimization Model. Reanalyzing data from 11 previously published studies, we show that a single neural mechanism, based on graded temporal overlap of associative traces and governed by a single free parameter ({beta}), captures both local statistical regularities and higher-order structural properties. This initial domain-general associative learning process, emerging from the graded structure of associations, may later scaffold to higher-level operations such as grouping, categorization, rule abstraction, and memory formation. Overall, this framework offers a conceptual synthesis that bridges disparate strands of the statistical learning literature and reframes apparent paradigm-specific effects as different expressions of a common underlying computation

neuroscience↗

Two brain systems for the perception of geometric shapes

The perception and production of regular geometric shapes, a characteristic trait of human cultures since prehistory, has unknown neural mechanisms. Behavioral studies suggest that humans are attuned to discrete regularities such as symmetries and parallelism, and rely on their combinations to encode regular geometric shapes in a compressed form. To identify the brain systems underlying this ability, as well as their dynamics, we collected functional MRI in both adults and six-year-olds, and magnetoencephalography data in adults, during the perception of simple shapes such as hexagons, triangles and quadrilaterals. The results revealed that geometric shapes, relative to other visual categories, induce a hypoactivation of ventral visual areas and an overactivation of the intraparietal and inferior temporal regions also involved in mathematical processing, whose activation is modulated by geometric regularity. While convolutional neural networks captured the early visual activity evoked by geometric shapes, they failed to account for subsequent dorsal parietal and prefrontal signals, which could only be captured by discrete geometric features or by bigger deep-learning models of vision. We propose that the perception of abstract geometric regularities engages an additional symbolic mode of visual perception.

neuroscience↗

Long-horizon associative learning explains human sensitivity to statistical and network structures in auditory sequences

Networks are a useful mathematical tool for capturing the complexity of the world. In a previous behavioral study, we showed that human adults were sensitive to the high-level network structure underlying auditory sequences, even when presented with incomplete information. Their performance was best explained by a mathematical model compatible with associative learning principles, based on the integration of the transition probabilities between adjacent and non-adjacent elements with a memory decay. In the present study, we explored the neural correlates of this hypothesis via magnetoencephalography (MEG). Participants passively listened to sequences of tones organized in a sparse community network structure comprising two communities. An early difference (~150 ms) was observed in the brain responses to tone transitions with similar transition probability but occurring either within or between communities. This result implies a rapid and automatic encoding of the sequence structure. Using time-resolved decoding, we estimated the duration and overlap of the representation of each tone. The decoding performance exhibited exponential decay, resulting in a significant overlap between the representations of successive tones. Based on this extended decay profile, we estimated a long-horizon associative learning novelty index for each transition and found a correlation of this measure with the MEG signal. Overall, our study sheds light on the neural mechanisms underlying human sensitivity to network structures and highlights the potential role of Hebbian-like mechanisms in supporting learning at various temporal scales.

neuroscience↗

Compression of binary sound sequences in human working memory

According to the language of thought hypothesis, regular sequences are compressed in human memory using recursive loops akin to a mental program that predicts future items. We tested this theory by probing memory for 16-item sequences made of two sounds. We recorded brain activity with functional MRI and magneto-encephalography (MEG) while participants listened to a hierarchy of sequences of variable complexity, whose minimal description required transition probabilities, chunking, or nested structures. Occasional deviant sounds probed the participants knowledge of the sequence. We predicted that task difficulty and brain activity would be proportional to the complexity derived from the minimal description length in our formal language. Furthermore, activity should increase with complexity for learned sequences, and decrease with complexity for deviants. These predictions were upheld in both fMRI and MEG, indicating that sequence predictions are highly dependent on sequence structure and become weaker and delayed as complexity increases. The proposed language recruited bilateral superior temporal, precentral, anterior intraparietal and cerebellar cortices. These regions overlapped extensively with a localizer for mathematical calculation, and much less with spoken or written language processing. We propose that these areas collectively encode regular sequences as repetitions with variations and their recursive composition into nested structures.

neuroscience↗

Humans parsimoniously represent auditory sequences by pruning and completing the underlying network structure

Successive auditory inputs are rarely independent, their relationships ranging from local transitions between elements to hierarchical and nested representations. In many situations, humans retrieve these dependencies even from limited datasets. However, this learning at multiple scale levels is poorly understood. Here We used the formalism proposed by network science to study the representation of local and higher order structures, and their interaction, in auditory sequences. We show that human adults exhibited biases in their perception of local transitions between elements, which made them sensitive to high-order structures such as network communities. This behavior is consistent with the creation of a parsimonious simplified model from the evidence they receive, achieved by pruning and completing relationships between network elements. This observation suggests that the brain does not rely on exact memories but compressed representations of the world. Moreover, this bias can be analytically modeled by a memory/efficiency trade-off. This model correctly account for previous findings, including local transition probabilities as well as high order network structures, unifying statistical learning across scales. We finally propose putative brain implementations of such bias.

neuroscience↗

An abstract language of thought for spatial sequences in humans

How does the human brain store sequences of spatial locations? The standard view is that each consecutive item occupies a distinct slot in working memory. Here, we formulate and test the alternative hypothesis that the human brain compresses the whole sequence using an abstract, language-like code that captures the numerical and geometrical regularities of the sequence at multiple nested levels. We exposed participants to spatial sequences of fixed length but variable regularity, and asked them to remember the sequence in order to detect deviants, while their brain activity was recorded using magneto-encephalography. Using multivariate decoders, each successive location could be decoded from brain signals, and upcoming locations were anticipated prior to their actual onset. Crucially, sequences with lower complexity, defined as the minimal description length provided by the formal language, and whose memory representation was therefore predicted to be more compressed, led to lower error rates and to increased anticipations. Furthermore, neural codes specific to the numerical and geometrical primitives of the postulated language could be detected, both in isolation and within the sequences. These results suggest that the human brain detects sequence regularities at multiple nested levels and uses them to compress long sequences in working memory.

neuroscience↗