Sihn, D. | bioRxiv Science

bioRxiv2026

Spatiotemporal transformation of neural data reveals representations of erroneous behaviors

Abnormal states such as erroneous behaviors are generally difficult to represent from neural data. However, such states are also known to have specific spatiotemporal features, indicating a feasibility of developing a method to focus on them. If a method can highlight these spatiotemporal features, it may effectively represent such abnormal states, helping evaluate abnormal brain functions. In the present study, we proposed the hierarchy of supported modules (HSM) to highlight spatiotemporal features that can represent abnormal states. HSM spatiotemporally transforms multidimensional neural time-series based on their spatiotemporal context. We evaluated HSM through decoding and similarity analyses using multiple publicly available datasets. In the HSM results, decoding accuracies were higher for erroneous behaviors than for normal behaviors, and similarities were lower between erroneous behaviors and normal behaviors than between normal behaviors, demonstrating the ability of HSM to capture the spatiotemporal features of erroneous behaviors. Surprisingly, many parts of these results were also present even before HSM learning, showing the virtue of HSM as a simple-to-use method. The proposed HSM method may help elucidate the mechanisms underlying erroneous behaviors.

neuroscience↗

bioRxiv2021

Spatio-temporally efficient coding assigns functions to hierarchical structures of the visual system

Hierarchical structures constitute a wide array of brain areas, including the visual system. One of the important questions regarding visual hierarchical structures is to identify computational principles for assigning functions that represent the external world to hierarchical structures of the visual system. Given that visual hierarchical structures contain both bottom-up and top-down pathways, the derived principles should encompass these bidirectional pathways. However, existing principles such as predictive coding do not provide an effective principle for bidirectional pathways. Therefore, we propose a novel computational principle for visual hierarchical structures as spatio-temporally efficient coding underscored by the efficient use of given resources in both neural activity space and processing time. This coding principle optimises bidirectional information transmissions over hierarchical structures by simultaneously minimising temporal differences in neural responses and maximising entropy in neural representations. Simulations demonstrated that the proposed spatio-temporally efficient coding was able to assign the function of appropriate neural representations of natural visual scenes to visual hierarchical structures. Furthermore, spatio-temporally efficient coding was able to predict well-known phenomena, including deviations in neural responses to unlearned inputs and bias in preferred orientations. Our proposed spatio-temporally efficient coding may facilitate deeper mechanistic understanding of the computational processes of hierarchical brain structures.

neuroscience↗