bioRxiv Science⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.03.21.586134

Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.

BANERJEE, S.
View original source ↗Export metadata ↓

Abstract

We live in a multisensory world, where all our senses work together for giving us a fulfilling experience of the environment that we are in or during our use of immersive technologies. For gaining more insight into the temporal scale understanding of the integration phenomenon EEG based BCI can give us the understanding of the transient changes in the brain. In this study, we investigated the potential of incorporating haptics into crossmodal correspondence based research to induce MSI effect through either the active touch users feedback or crossmodal correspondences with visual and auditory modalities, such as Kiki Bouba effect. We designed two experiments: O_LIVisual stimuli were presented on a standard computer monitor, and auditory stimuli were delivered through computer dynamics. Participants responded using left or right hand by pressing either CapsLock or Enter buttons respectively. Visual cue consisted of a red circle displayed randomly either on the left or on the right side of the screen. Auditory cue was a brief high tone presented through left or right headphones for 500 ms. Text stimuli that appeared on the screen instructed participants to respond with their left or right hand. Before each trial there was a fixation central cross displayed for 500 ms. C_LIO_LIThis experiment was inspired by previous studies on Kiki-Bouba correspondence. Visual stimuli consisted of 4 shapes - circle, triangle, polygon with 6 vertices, and star - presented on a computer screen. Locations of the visual stimuli were randomized. Auditory stimuli were generated using the Online Tone Generator website (https://onlinetonegenerator.com/). 2 sets of sounds were used: the first set included sine, triangle, square, and sawtooth waveforms, each at a frequency of 500 Hz; the second set included sawtooth waveforms at frequencies of 50 Hz, 300 Hz, 600 Hz, and 2000 Hz (summarised in Table 2). C_LI O_TBL View this table: org.highwire.dtl.DTLVardef@4b63fdorg.highwire.dtl.DTLVardef@191b6cborg.highwire.dtl.DTLVardef@177e6f4org.highwire.dtl.DTLVardef@dba414org.highwire.dtl.DTLVardef@1f13b3c_HPS_FORMAT_FIGEXP M_TBL O_FLOATNOTable 2:C_FLOATNO O_TABLECAPTIONVisual and auditory stimuli used in Experiment 2 C_TABLECAPTION C_TBL Results suggested that it is indeed possible to achieve this type of integration without relying on complex haptic devices. Introducing haptics into BCI technologies through feedback touch or crossmodal correspondances holds potential to improve the user experience and information transfer rate (ITR). Participants, as expected, showed the lowest reaction times in congruent sequential test and the highest - in incongruent HAV cues based test. This indicates the importance preference for sequential cue presentation over simultaneous one. The time was significantly higher in case of Incongruent Haptic cues.

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

BANERJEE, S.. 2024-03-27. Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.. https://doi.org/10.1101/2024.03.21.586134

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

A comparison of female competitive traits: Female aggression peaks at nest building but female song spans multiple contexts in a temperate songbird

Female-female competition is increasingly recognized as a key driver of female ornamentation, including birdsong, which often functions in intrasexual competition. However, the specific resources females use elaborate traits to compete for remain unclear. In addition, few studies have simultaneously investigated the use of multiple competitive traits in females, despite growing independent interest in these traits (e.g., female song and aggression). We investigated the competitive contexts of female song, aggression and calling behavior in northern house wrens (Troglodytes aedon) to determine which resources females compete for across the breeding season. We simulated conspecific territorial intrusions using female song at three breeding stages representing different contexts: arrival (mate and territory acquisition), nest building (nest site and breeding status defense), and egg laying (brood defense). We tested whether female song and physical aggression varied as reproductive resources shifted across the breeding cycle. Females were significantly more aggressive during nest building, showing 5.8 times greater odds of a higher-intensity aggressive response during nest building compared to arrival. Female song output was similar across early stages but declined during egg laying, though this was not statistically significant after correction for multiple comparisons and individuals varied substantially in overall singing propensity. Non-song vocalizations varied by call type and breeding stage. Calls associated with aggression occurred most frequently during nest building, consistent with peak physical aggression responses. Together, these results identify nest building as the stage of highest female aggression, consistent with heightened competition over nest cavities and associated breeding status in this cavity-nesting species. In contrast, female song occurred across all stages and appears to function in multiple competitive contexts. This study provides evidence for context and mode-specific female signaling in a temperate songbird and highlights that females strategically use aggression, calls, and song to mediate social conflict across breeding contexts.

animal behavior and cognition↗
bioRxiv2026

Tracking human foragers and their prey reveals adaptive predator-prey dynamics

Hunting for mobile prey is thought to have played a key role in hominin evolution, by providing high-quality nutrition that supported the development of the exceptionally large human brain. However, human-prey dynamics remain poorly understood because studies have not yet tracked human foragers and their prey simultaneously. Here, we employ high resolution tracking of groups of human foragers (ice-fishers) and their prey (fish shoals) to study human-prey dynamics. Our results show that foragers adaptively combined personal and social information in deciding where to forage and for how long, closely matching the prey distribution. Prey responded dynamically to human exploitation, showing increased attraction to fishing activity, alongside decreased biting probability. Furthermore, we found that foragers adaptively relied on memory, preferentially returning to areas with high prey presence, particularly when their current return rate was low. Our results show how human foragers overcome the challenges of extracting invisible, mobile and reactive prey by tightly tuning patch-selection, patch-leaving and patch-return decisions to the distribution and behaviour of their prey.

animal behavior and cognition↗
bioRxiv2026

4-Dimensional Chess: Acoustic Localisation Reveals Nested Spatio-temporal Strategies in an Arboreal Communication Network

1. Adaptive behavioural strategies require animals to simultaneously navigate social and ecological domains across multiple spatial and temporal scales. Although drones and computer vision have recently transformed the study of wild animal societies, many nocturnal species and those occupying structurally complex habitats remain inaccessible to these approaches, limiting our understanding of behaviour in natural settings. 2. We aimed to determine how behavioural strategies are organised across nested spatial and temporal scales within a wild communication network. 3. We used three-dimensional acoustic localisation and source separation to track individual male Hyperolius sp. A, a nocturnal African reed frog, within a natural rainforest chorus and quantify patterns of site fidelity, movement, spatial organisation, and call-timing interactions. 4. Males exhibited significant site fidelity across nights, while chorus spatial structure varied with local caller density. Within nights, individuals followed a stereotyped behavioural sequence, descending from elevated arboreal refugia before settling into lower calling positions near breeding sites. At finer temporal scales, call-timing interactions varied according to both local competitor density and the proximity of neighbouring rivals. 5. These findings demonstrate that behavioural strategies emerge across nested spatial and temporal scales and that long-term spatial positioning, short-term movement decisions, and moment-to-moment signalling interactions are tightly linked within natural communication networks. More broadly, acoustic localisation provides a powerful framework for studying behaviour in species and habitats that remain difficult to observe using conventional approaches.

animal behavior and cognition↗