Biology subjects

Salmela, V.

Publications and source records attributed to Salmela, V..

4 recordsLinked to original sources

bioRxiv2026

Neural Representations of Embodied Musical Emotions

Bodily sensations shape the emotional experience of music, yet the neural underpinnings of embodied musical emotions remain poorly understood. Here we investigated the correspondence between neural activity patterns and self-reported bodily sensations induced by emotional music. Participants (n=74) listened to emotionally engaging (aggressive, happy, sad, scary) music while their hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI). Music-induced bodily sensations were measured after imaging. Representational similarity analysis (RSA) was used to identify brain regions where the representational geometries of neural responses to music align with the topographical patterns of the corresponding bodily sensations, emotions, and musical features. Bodily sensations maps (BSMs) showed emotion-specific topographies. Univariate general linear model (GLM) analysis revealed increased neural activity within motor, somatosensory, interoceptive, limbic, and auditory brain regions during music listening, with little difference between the emotion categories. In contrast, RSA revealed significant correspondence between the representational geometries of neural activity patterns and emotion category-specific bodily sensations in motor, somatosensory, emotion-related and auditory brain regions. Multivariate pattern (MVP) classification analysis showed that activity in the auditory cortex accurately predicted the emotion categories. Our results indicate neural correspondence to bodily sensations in somatomotor and somatosensory brain regions, providing novel evidence for the neural basis of embodied music-induced emotions.

neuroscience↗

bioRxiv2023

Selective attention to audiovisual speech is associated with recurrent feedback-feedforward loops in the ventral processing stream

Selective attention related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both EEG (high temporal resolution) and fMRI (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilize the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

neuroscience↗

bioRxiv2019

Modulation of brain activity by selective attention to audiovisual dialogues

In real-life noisy situations, we can selectively attend to conversations in the presence of irrelevant voices, but neurocognitive mechanisms in such natural listening situations remaiin largely unexplored. Previous research has shown distributed activity in the mid superior temporal gyrus (STG) and sulcus (STS) while listening to speech and human voices, in the posterior STS and fusiform gyrus when combining auditory, visual and linguistic information, as well as in lefthemisphere temporal and frontal cortical areas during comprehension. In the present functional magnetic resonance imaging (fMRI) study, we investigated how selective attention modulates neural responses to naturalistic audiovisual dialogues. Our healthy adult participants (N = 15) selectively attended to video-taped dialogues between a man and woman in the presence of irrelevant continuous speech in the background. We modulated the auditory quality of dialogues with noise vocoding and their visual quality by masking speech-related facial movements. Both increased auditory quality and increased visual quality were associated with bilateral activity enhancements in the STG/STS. In addition, decreased audiovisual stimulus quality elicited enhanced fronto-parietal activity, presumably reflecting increased attentional demands. Finally, attention to the dialogues, in relation to a control task where a fixation cross was attended and the dialogue ignored, yielded enhanced activity in the left planum polare, angular gyrus, the right temporal pole, as well as in the orbitofrontal/ventromedial prefrontal cortex and posterior cingulate gyrus. Our findings suggest that naturalistic conversations effectively engage participants and reveal brain networks related to social perception in addition to speech and semantic processing networks.

neuroscience↗

bioRxiv2019

Spatio-temporal dynamics of face perception

The temporal and spatial neural processing of faces have been studied rigorously, but few studies have unified these dimensions to reveal the spatio-temporal dynamics postulated by the models of face processing. We used support vector machine decoding and representational similarity analysis to combine information from different locations (fMRI), timepoints (EEG), and theoretical models. By correlating information matrices derived from pair-wise decodings of neural responses to different facial expressions (neutral, happy, fearful, angry), we found early EEG timepoints (110-150 ms) to match fMRI data from early visual cortex (EVC), and later timepoints (170 - 250 ms) to match data from occipital and fusiform face areas (OFA/FFA) and posterior superior temporal sulcus (pSTS). The earliest correlations were driven by information from happy faces, and the later by more accurate decoding of fearful and angry faces. Model comparisons revealed systematic changes along the processing hierarchy, from emotional distance and visual feature coding in EVC to coding of intensity of expressions in right pSTS. The results highlight the importance of multimodal approach for understanding functional roles of different brain regions.

neuroscience↗