Biology subjects

Nentwich, M.

Publications and source records attributed to Nentwich, M..

6 recordsLinked to original sources

bioRxiv2026

During natural vision, semantic novelty modulates fixation-related processing in primate cortex

We sample visual scenes with short gaze fixations separated by saccades. While low-level integration is known, semantic integration of foveal vision across fixations remains unclear. We hypothesized that the brain responds to changes in semantic information from one fixation to the next, and therefore postulated a neural signal associated with semantic novelty for each saccade. Novelty was measured from different layers of a deep network on foveal vision. Only semantic, and not low- or mid-level, novelty modulated frontal and occipital fixation-related potentials in male and female human scalp EEG during natural viewing of full-length movies (3.4x106 saccades). Intracranial recordings in male and female humans (9.0x104 saccades) and female non-human primates (Macaca mulatta; 3.3x104 saccades) revealed broadband high-frequency activity modulations in scene-specific ventral visual and frontal brain areas only for semantic novelty. This modulation was stronger for movies than static images, and frontal modulation occurred early alongside occipital modulation, suggesting top-down effects. This modulation of fixation-related activity with novelty suggests that foveal representations are integrated across fixations to construct scene representations during natural viewing in primates.

neuroscience↗

bioRxiv2024

Motifs of human hippocampal and cortical high frequency oscillations structure processing and memory of naturalistic stimuli

The discrete events of our narrative experience are organized by the neural substrate that underlies episodic memory. This narrative process is segmented into discrete units by event boundaries. This permits a replay process that acts to consolidate each event into a narrative memory. High frequency oscillations (HFOs) are a potential mechanism for synchronizing neural activity during these processes. Here, we use intracranial recordings from participants viewing and freely recalling a naturalistic stimulus. We show that hippocampal HFOs increase following event boundaries and that coincident hippocampal-cortical HFOs (co-HFOs) occur in cortical regions previously shown to underlie event segmentation (inferior parietal, precuneus, lateral occipital, inferior frontal cortices). We also show that event-specific patterns of co-HFOs that occur during event viewing re-occur following the subsequent three event boundaries (in decaying fashion) and also during recall. This is consistent with models that support replay as a mechanism for memory consolidation. Hence, HFOs may coordinate activity across brain regions serving widespread event segmentation, encode naturalistic memory, and bind representations to assemble memory of a coherent, continuous experience.

neuroscience↗

bioRxiv2024

Intrinsic dynamics shape responses to external stimulation in the human brain

Sensory stimulation of the brain reverberates in its recurrent neural networks. However, current computational models of brain activity do not separate immediate sensory responses from this intrinsic dynamic. We apply a vector-autoregressive model with external input (VARX), combining the concepts of "functional connectivity" and "encoding models", to intracranial recordings in humans. This model captures the extrinsic effect of the stimulus and separates that from the intrinsic effect of the recurrent brain dynamic. We find that the intrinsic dynamic enhances and prolongs the neural responses to scene cuts, eye movements, and sounds. Failing to account for these extrinsic inputs, leads to spurious recurrent connections that govern the intrinsic dynamic. We also find that the recurrent connectivity during rest is reduced during movie watching. The model shows that an external stimulus can reduce intrinsic noise. It also shows that sensory areas have mostly outward, whereas higher-order brain areas mostly incoming connections. We conclude that the response to an external audiovisual stimulus can largely be attributed to the intrinsic dynamic of the brain, already observed during rest.

neuroscience↗

bioRxiv2022

Naturalistic viewing: An open-access dataset using simultaneous EEG-fMRI

In this work, we present a dataset that combines functional magnetic imaging (fMRI) and electroencephalography (EEG) to use as a resource for understanding human brain function in these two imaging modalities. The dataset can also be used for optimizing preprocessing methods for simultaneously collected imaging data. The dataset includes simultaneously collected recordings from 22 individuals (ages: 23-51) across various visual and naturalistic stimuli. In addition, physiological, eye tracking, electrocardiography, and cognitive and behavioral data were collected along with this neuroimaging data. Visual tasks include a flickering checkerboard collected outside and inside the MRI scanner (EEG-only) and simultaneous EEG-fMRI recordings. Simultaneous recordings include rest, the visual paradigm Inscapes, and several short video movies representing naturalistic stimuli. Raw and preprocessed data are openly available to download. We present this dataset as part of an effort to provide open-access data to increase the opportunity for discoveries and understanding of the human brain and evaluate the correlation between electrical brain activity and blood oxygen level-dependent (BOLD) signals.

neuroscience↗

bioRxiv2022

Semantic novelty modulates neural responses to visual change across the human brain

Our continuous visual experience in daily life is dominated by change. Previous research has focused on visual change due to stimulus motion, eye movements or unfolding events, but not their combined impact across the brain, or their interactions with semantic novelty. We investigate the neural responses to these sources of novelty during film viewing. We analyzed intracranial recordings in humans across 6328 electrodes from 23 individuals. Responses associated with saccades and film cuts were dominant across the entire brain. Film cuts at semantic event boundaries were particularly effective in the temporal and medial temporal lobe. Saccades to visual targets with high visual novelty were also associated with strong neural responses. Specific locations in higher-order association areas showed selectivity to either high or low-novelty saccades. We conclude that neural activity associated with film cuts and eye movements is widespread across the brain and is modulated by semantic novelty.

neuroscience↗

bioRxiv2022

Saccadic modulation of neural excitability in auditory areas of the neocortex

SummaryIn natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In this process, nonretinal signals linked to saccades shift visual cortical neurons to a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas, with a pattern complementary to that seen in visual areas. Bi-directional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. By using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

neuroscience↗