Biology subjects

Senkowski, D.

Publications and source records attributed to Senkowski, D..

7 recordsLinked to original sources

bioRxiv2025

Observing being touched enhances the neural processing and perception of digital gentle stroking

Observing touch activates brain regions similar to those activated by experiencing actual touch, suggesting that visual information can cross-modally influence tactile perception. In this electroencephalography (EEG) study, we investigated how viewing visual displays of an arm being touched may affect the perception and processing of digitally rendered touch patterns designed to resemble either stroking or tapping. Thirty-one participants experienced touch patterns delivered to their left forearm via a wearable sleeve while viewing either a photo of an arm or spatiotemporally aligned videos of an arm being touched in synchrony with either of the two touch patterns. Continuity and pleasantness ratings of touch stimuli were higher for stroking than for tapping. Correlations between continuity and pleasantness ratings were stronger when touch was accompanied by videos of touch than by the photo of an arm. Analysis of evoked brain responses revealed visual modulation of touch processing at centroparietal electrodes beginning at around 0.9 s, with the cross-modal effects diverging between stroking and tapping at about 1.6 s. Furthermore, the interaction effects of cross-modal influences between stroking and tapping at the neural level positively correlated with the visual modulation of pleasantness ratings in two right frontal clusters at around 1.4 s and 1.8 s. These results suggest that observing touch influences the perception and processing of touch through initial sensory integration at centroparietal sites, followed by later frontal valuation processes. This extends previous findings on affective touch by demonstrating that visual inputs can cross-modally shape the hedonic evaluation of digitally actuated touch.

neuroscience↗

bioRxiv2025

Causal role of the individual alpha phase in multisensory perception

The phase of alpha oscillations is proposed to reflect perceptual cycles. Yet, human EEG/MEG studies have yielded inconsistent results, perhaps because they used correlative approaches that did not consider causal phase-perception relationships. In a multi-day computational EEG study, we developed the neurobehavioral link function (NBLF) as a new approach to model individual sinusoidal relationships between the alpha phase and multisensory perception and to test for causality. Rhythmic 10 Hz visual stimulation entrained the alpha phase at 0{degrees} or 180{degrees} relative to audiovisual target onset. Entrainment effects on multisensory integration only emerged when individual NBLFs, which were related to alpha phase coupling between early audio-visual cortices, were included in the analysis. A follow-up psychophysical experiment confirmed individual phase-dependent effects at 5 and 10 Hz, but not 15 Hz. Our results suggest that the individual alpha phase causally modulates perceptual cycles in multisensory integration and advocate for personalized, phase-targeting strategies in neurotechnologies.

neuroscience↗

bioRxiv2025

Causal inference shapes crossmodal postdictive perception within the temporal window of multisensory integration

1.In our environment, stimuli from different sensory modalities are processed within a temporal window of multisensory integration that spans several hundred milliseconds. During this window, stimulus processing is influenced not only by preceding and current information, but also by input that follows the stimulus. The computational mechanisms underlying crossmodal backward processing, which we refer to as crossmodal postdiction, are not well understood. We examined crossmodal postdiction in the audiovisual (AV) rabbit illusion, in which postdiction occurs when flash-beep pairs are presented shortly before and shortly after a single flash or a single beep. We collected behavioral data from 32 participants and fitted four competing models: a Bayesian causal inference (BCI), a forced-fusion, a forced-segregation, and a non-postdictive BCI model. The BCI model fit the data well and outperformed all other models. Building on findings demonstrating causal inference during non-postdictive multisensory integration, our study shows that the BCI framework is also effective in explaining crossmodal postdiction. Observers accumulate causal evidence that influences their perception of preceding stimuli following a causal decision. Our study shows that crossmodal postdiction in the AV rabbit illusion is formed within a temporal window of multisensory integration that encompasses past, present, and future input, which can be effectively explained by the BCI framework.

neuroscience↗

bioRxiv2021

Early evoked brain activity underlies auditory and audiovisual speech recognition deficits in schizophrenia

ObjectivesPeople with Schizophrenia (SZ) show deficits in auditory and audiovisual speech recognition. It is possible that these deficits are related to aberrant early sensory processing, combined with an impaired ability to utilize visual cues to improve speech recognition. In this electroencephalography study we tested this by having SZ and healthy controls (HC) identify different unisensory auditory and bisensory audiovisual syllables at different auditory noise levels. MethodsSZ (N = 24) and HC (N = 21) identified one of three different syllables (/da/, /ga/, /ta/) at three different noise levels (no, low, high). Half the trials were unisensory auditory and the other half provided additional visual input of moving lips. Task-evoked mediofrontal N1 and P2 brain potentials triggered to the onset of the auditory syllables were derived and related to behavioral performance. ResultsIn comparison to HC, SZ showed speech recognition deficits for unisensory and bisensory stimuli. These deficits were primarily found in the no noise condition. Paralleling these observations, reduced N1 amplitudes to unisensory and bisensory stimuli in SZ were found in the no noise condition. In HC the N1 amplitudes were positively related to the speech recognition performance, whereas no such relationships were found in SZ. Moreover, no group differences in multisensory speech recognition benefits and N1 suppression effects for bisensory stimuli were observed. ConclusionOur study shows that reduced N1 amplitudes relate to auditory and audiovisual speech processing deficits in SZ. The findings that the amplitude effects were confined to salient speech stimuli and the attenuated relationship with behavioral performance, compared to HC, indicates a diminished decoding of the auditory speech signals in SZs. Our study also revealed intact multisensory benefits in SZs, which indicates that the observed auditory and audiovisual speech recognition deficits were primarily related to aberrant auditory speech processing. HighlightsSpeech processing deficits in schizophrenia related to reduced N1 amplitudes Audiovisual suppression effect in N1 preserved in schizophrenia Schizophrenia showed weakened P2 components in specifically audiovisual processing

neuroscience↗

bioRxiv2021

Early and late evoked brain responsesdifferentially reflect feature encoding andperception in the flash-lag illusion

In the flash-lag illusion (FLI), the position of a flash presented ahead of a moving bar is mislocalized, so the flash appears to lag the bar. Currently it is not clear whether this effect is due to early perceptual-related neural processes such as motion extrapolation or reentrant processing, or due to later feedback processing relating to postdiction, i.e. retroactively altered perception. We presented 17 participants with the FLI paradigm while recording EEG. A central flash occurred either 51ms ("early") or 16ms ("late") before the bar moving from left to right reached the screen center. Participants judged whether the flash appeared to the right ("no flash lag illusion") or to the left ("flash-lag illusion") of the bar. Using single-trial linear modelling, we examined the influence of timing ("early" vs. "late") and perception ("illusion" vs. "no illusion") on flash-evoked brain responses, and estimated the cortical sources underlying the FLI. Perception of the FLI was associated with a late window (368-452ms) in the ERP, with larger deflections for illusion than no illusion trials, localized to the left fusiform gyrus. An earlier frontal and occipital component (200-276ms) differentiated time-locked early vs. late stimulus presentation. Our results suggest a postdiction-related reconstruction of ambiguous sensory stimulation involving late processes in the occipito-temporal cortex, previously associated with temporal integration phenomena. This indicates that perception of the FLI relies on an interplay between ongoing stimulus encoding of the moving bar and feedback processing of the flash, which takes place at later integration stages. HighlightsFlash-lag illusion relates primarily to late evoked brain potentials (>300ms) Illusion vs. no-illusion trials showed difference in fusiform gyrus Flash-lag illusion could involve postdiction-driven integration of ongoing stimuli

neuroscience↗

bioRxiv2021

Early beta oscillations in multisensory association areas underlie crossmodal performance enhancement

The combination of signals from different sensory modalities can enhance perception and facilitate behavioral responses. While previous research described crossmodal influences in a wide range of tasks, it remains unclear how such influences drive performance enhancements. In particular, the neural mechanisms underlying performance-relevant crossmodal influences, as well as the latency and spatial profile of such influences are not well understood. Here, we examined data from high-density electroencephalography (N = 30) and electrocorticography (N = 4) recordings to characterize the oscillatory signatures of crossmodal facilitation of response speed, as manifested in the speeding of visual responses by concurrent task-irrelevant auditory information. Using a data-driven analysis approach, we found that individual gains in response speed correlated with reduced beta power (13-25 Hz) in the audiovisual compared with the visual condition, starting within 80 ms after stimulus onset in multisensory association and secondary visual areas. In addition, the electrocorticography data revealed a beta power suppression in audiovisual compared with visual trials in the superior temporal gyrus (STG). Our data suggest that the crossmodal facilitation of response speed is associated with early beta power in multisensory association and secondary visual areas, presumably reflecting the enhancement of early sensory processing through selective attention. This finding furthers our understanding of the neural correlates underlying crossmodal response speed facilitation and highlights the critical role of beta oscillations in mediating behaviorally relevant audiovisual processing. Significance StatementThe use of complementary information across multiple senses can enhance perception. Previous research established a central role of neuronal oscillations in multisensory perception, but it remains poorly understood how they relate to multisensory performance enhancement. To address this question, we recorded electrophysiological signals from scalp and intracranial electrodes (implanted for presurgical monitoring) in response to simple visual and audiovisual stimuli. We then associated the difference in oscillatory power between the two conditions with the speeding of responses in the audiovisual trials. We demonstrate, that the crossmodal facilitation of response speed is associated with beta power in multisensory association areas during early stages of sensory processing. This finding highlights the importance of beta oscillations in mediating behaviorally relevant audiovisual processing.

neuroscience↗

bioRxiv2020

Multisensory processes can compensate for attention deficits in schizophrenia

Studies on schizophrenia (SCZ) and aberrant multisensory integration (MSI) show conflicting results. These divergent results are potentially confounded by attention deficits in SCZ. To test this, we examined the interplay between MSI and intersensory attention (IA) in healthy controls (N=27) and in SCZ (N=27). Evoked brain potentials to unisensory-visual (V), unisensory-tactile (T) or bisensory VT stimuli were measured with high density electroencephalography, whilst participants attended block-wise to either visual or tactile inputs. Behaviourally, IA effects in SCZ are uncompromised for bisensory stimuli, but diminished for unisensory stimuli. At the neural level, we observed reduced IA effects for bisensory stimuli over mediofrontal scalp regions (230-320ms) in SCZ. The analysis of MSI revealed multiple phases of integration over occipital and frontal scalp regions (240-364ms), with comparable performance between HC and SCZ. The magnitudes of IA and MSI effects were both positively related to the behavioural performance in SCZ, indicating that IA and MSI mutually facilitate bisensory stimulus processing. Our study suggests that widely intact MSI, which facilitates stimulus processing, can compensate for top-down attention deficits in SCZ. Further, the interplay of IA and MSI implies that differences in attentional demands may account for previous conflicting findings on MSI in schizophrenia.

neuroscience↗