bioRxiv Science⌕ Search

Biology subjects

Verwoert, M.

Publications and source records attributed to Verwoert, M..

11 recordsLinked to original sources

Insular error network enables self-correcting intracranial brain-computer interface

Error recognition is fundamental to adaptive behavior, enabling rapid compensatory action when outcomes deviate from expectations. Central to this function are neural circuits for performance monitoring, encoding cognitive signals that could support more reliable neural interfaces. Here, we recorded intracranial electroencephalography (iEEG) in epilepsy patients to enable a motor brain-computer interface (BCI) while sampling error-related activity across a distributed network. Our work reveals high-frequency population dynamics emerging in the anterior insula and propagating to the prefrontal cortex as the interface fails to follow the users intention. We identify spatially organized insular responses to error processing and movement feedback, highlighting it as a heterogeneous hub linking action and outcome. Real-time integration of error responses enables a self-correcting neural interface that enhances usability by reducing the need for manual user intervention. Together, our work demonstrates a human intracranial BCI harnessing insular brain activity, integrating cognitive processes directly into device control.

neuroscience↗

Decoding brain-wide signatures of uninformed choices for BCI assisted decision-making

Decision-making is an essential cognitive function. It can be impaired due to a number of neurological and psychiatric disorders as well as external factors such as time pressure or stress. To assist users during decision-making, we propose a decision-making brain computer interface (BCI) that can alert to uninformed decision-making, prompt additional information seeking and therefore improve decision-making quality. To this aim, we establish the feasibility of decoding uninformed decision-making from local field potentials recorded with implanted stereo-electroencephalography (sEEG) electrodes in 6 participants. We show that decoding of available information above chance level is possible for all participants, both after stimulus presentation, as well as before task response. Starting from stimulus onset, the temporal processing hierarchy of informed vs. uninformed decision-making spans from visual processing through hippocampal memory processes to frontal control network shifting. The anterior insula, known to be a decision-making hub, codes available information during the decision phase prior to button press. These results further elucidate the neural basis of coded information availability and confirm the feasibility of a decision-making BCI.

neuroscience↗

Decoding continuous goal-directed movement from human brain-wide intracranial recordings.

Reaching out your hand is an effortless yet complex behavior that is indispensable in daily life. Restoring arm functionality is therefore rated a top priority by people with tetraplegia. Recently, neural correlates of movement have been observed and decoded beyond the motor cortex, but the degree and granularity of movement representation is not fully understood. Here, we explore the neural content of brain-wide movement-related neural activity by decoding neural correlates into 12 different kinematics of goal-directed reaching behavior. Eighteen participants implanted with stereotactic electroencephalography electrodes performed a gamified 3D goal-directed movement task. We demonstrate that continuous movement kinematics can be decoded from distributed recordings using low, mid and high frequency information in all participants using preferential subspace identification (PSID). The neural correlates of movement were distributed throughout the brain, including deeper structures such as the basal ganglia and insula. Moreover, we show that hand position could only be decoded using a goal-directed reference frame, indicating that widespread low-frequency activity is involved in higher-order processing of movements. Our results strengthen the evidence that widespread motor-related dynamics exist across numerous brain regions and can be used to continuously decode movement. The results may provide new opportunities for motor brain-computer interfaces for individuals with a compromised motor cortex, e.g. after stroke, or for control signals in adaptive closed-loop systems.

neuroscience↗

Moving beyond the motor cortex: a brain-wide evaluation of target locations for intracranial speech neuroprostheses

Speech is the fastest and most natural form of communication, which can be impaired in certain disorders. Speech brain- computer interfaces (BCIs) offer a solution by decoding brain activity into speech. Current neuroprosthetic devices focus on the motor cortex, which might not be usable in all patient populations. Fortunately, many other brain regions have been associated with the speech production process. Here, we investigate which regions are potential (alternative) targets for a speech BCI across a brain-wide distribution within a single study. The distribution includes sulci and subcortical areas, sampled with both a high temporal and a high spatial resolution. Thirty participants were recorded with intracranial electroencephalography during speech production, resulting in 3249 recorded contacts across the brain. We trained machine learning models to continuously predict speech from a brain-wide global to a single-channel local scale. Within each scale we examined a variation of selected electrode contacts based on anatomical features within participants. We found significant speech detection in both gray and white matter tissue, no significant difference between gyri and sulci at any of the analysis scales and limited contribution from subcortical areas. The best potential targets in terms of decoding accuracy and consistency are located within the depth of and surrounding the lateral fissure bilaterally, such as the (sub)central sulcus, transverse temporal gyrus (Heschls gyrus), the supramarginal cortex and parts of the insula. These results highlight the potential benefits of extending beyond the motor cortex and reaching the sulcal depth for speech neuroprostheses.

bioengineering↗

Whole-brain dynamics of articulatory, acoustic and semantic speech representations

Speech production is a complex process that traverses several representations, from the meaning of spoken words (semantic), through the movement of articulatory muscles (articulatory) and, finally, to the produced audio waveform (acoustic). In our study, we aimed to identify how these different representations of speech are spatially and temporally distributed throughout the depth of the brain. By considering multiple representations from the same exact data, we can limit potential con-founders to better understand the different aspects of speech production and acquire crucial complementary information for speech brain-computer interfaces (BCIs). Intracranial speech production data was collected of 15 participants, recorded from 1647 electrode contacts, while they overtly spoke 100 unique words. The electrodes were distributed across the entire brain, including sulci and subcortical areas. We found a bilateral spatial distribution for all three representations, although there was a stronger tuning in the left hemisphere with a more widespread and temporally dynamic distribution than in the right hemisphere. The articulatory and acoustic representations share a similar spatial distribution surrounding the Sylvian fissure, while the semantic representation appears to be widely distributed across the brain in a mostly distinct network. These results highlight the distributed nature of the speech production process and the potential of non-motor representations for speech BCIs.

neuroscience↗

Global motor dynamics - Invariant neural representations of motor behavior in distributed brain-wide recordings

Neural activity is presumed to be correlated with motor behavior almost everywhere in the brain, implying that many different brain processes are involved in generating a behavioral output. Recent studies in multiple non-human species have observed pervasive brain-wide neural activity directly related to motor output. However, similar brain-wide investigations in humans with high-temporal resolution are lacking to date. Here, we recorded invasive data from brain-wide distributed electrodes in humans and reveal global neural dynamics that are predictive of movement across tasks and across participants. The dynamics are remarkably stable between participants with substantially varying electrode configurations and to loss of information. We demonstrate that these global neural dynamics are near brain-wide and present in all participants. Uncovering these global neural dynamics may allow for a more holistic and network-based perspective on motor-related neural activity.

neuroscience↗

Decoding Arbitrary and Informed Decisions from Intracranial Recordings in Humans

Ideally, decisions are made based on prior knowledge, which allows for informed choices. Real life, however, often requires us to make decisions arbitrarily, without sufficient information. Decoding decision making processes from neural activity could allow for cognitive neuroprostheses and Brain-Computer Interfaces (BCIs) to support decision processes in rapid human-machine interactions, weigh decision-making confidence, and further enable neuromodulation protocols for the treatment of reward-related dysfunctions. To understand the differences between the decision-making processes in arbitrary and informed decisions, we recorded intracranial electroencephalography in a large number of cortical and subcortical areas from 5 patients during a categorization task. We demonstrate that individual decisions can be decoded from Local Field Potentials (LFPs) before motor response, in both arbitrary and informed conditions. Our analysis revealed dissimilar spatio-temporal patterns between arbitrary and informed decision-making, with arbitrary decisions being decodable in fewer brain regions and earlier in time compared to informed decisions.

neuroscience↗

T-Rex: sTandalone Recorder of EXperiments; An easy and versatile neural recording platform

AO_SCPLOWBSTRACTC_SCPLOWRecording time in invasive neuroscientific empirical research is short and must be used as efficiently as possible. Time is often lost due to long setup times and errors by the researcher. Minimizing the number of manual actions reduces both and can be achieved by automating as much as possible. Importantly, automation should not reduce the flexibility of the system. Currently, recording setups are either custom-made by the researchers or provided as a module in comprehensive neuroscientific toolboxes, and no platforms exist focused explicitly on recording. Therefore, we developed a lightweight, flexible, platform- and measurement-independent recording system that can start and record experiments with a single press of a button. Data synchronization and recording are based on Lab Streaming Layer to ensure that all major programming languages and toolboxes can be used to develop and execute experiments. We have minimized the user restrictions as much as possible and imposed only two requirements on the experiment: The experiment should include a Lab Streaming Layer stream, and it should be able to run from a command line call. Further, we provided an easy-to-use interface that can be adjusted to specific measurement modalities, amplifiers, and participants. The presented system provides a new way of setting up and recording experiments for researchers and participants. Because of the automation and easy-to-use interface, the participant could even start and stop experiments by themselves, thus potentially providing data without the experimenters presence.

neuroscience↗

Executed and imagined grasping movements can be decoded from lower dimensional representation of distributed non-motor brain areas.

Using brain activity directly as input for assistive tool control can circumvent muscular dysfunction and increase functional independence for physically impaired people. Most invasive motor decoding studies focus on decoding neural signals from the primary motor cortex, which provides a rich but superficial and spatially local signal. Initial non-primary motor cortex decoding endeavors have used distributed recordings to demonstrate decoding of motor activity by grouping electrodes in mesoscale brain regions. While these studies show that there is relevant and decodable movement related information outside the primary motor cortex, these methods are still exclusionary to other mesoscale areas, and do not capture the full informational content of the motor system. In this work, we recorded intracranial EEG of 8 epilepsy patients, including all electrode contacts except those contacts in or adjacent to the central sulcus. We show that executed and imagined movements can be decoded from non-motor areas; combining all non-motor contacts into a lower dimensional representation provides enough information for a Riemannian decoder to reach an area under the curve of 0.83 {+/-} 0.11. Additionally, by training our decoder on executed and testing on imagined movements, we demonstrate that between these two conditions there exists shared distributed information in the beta frequency range. By combining relevant information from all areas into a lower dimensional representation, the decoder was able to achieve high decoding results without information from the primary motor cortex. This representation makes the decoder more robust to perturbations, signal non-stationarities and neural tissue degradation. Our results indicate to look beyond the motor cortex and open up the way towards more robust and more versatile brain-computer interfaces.

neuroscience↗

Speech Production in Intracranial Electroencephalography: iBIDS Dataset

Speech production is an intricate process involving a large number of muscles and cognitive processes. The neural processes underlying speech production are not completely understood. As speech is a uniquely human ability, it can not be investigated in animal models. High-fidelity human data can only be obtained in clinical settings and is therefore not easily available to all researchers. Here, we provide a dataset of 10 participants reading out individual words while we measured intracranial EEG from a total of 1103 electrodes. The data, with its high temporal resolution and coverage of a large variety of cortical and sub-cortical brain regions, can help in understanding the speech production process better. Simultaneously, the data can be used to test speech decoding and synthesis approaches from neural data to develop speech Brain-Computer Interfaces and speech neuroprostheses.

neuroscience↗

Modulation of brain activity by selective attention to audiovisual dialogues

In real-life noisy situations, we can selectively attend to conversations in the presence of irrelevant voices, but neurocognitive mechanisms in such natural listening situations remaiin largely unexplored. Previous research has shown distributed activity in the mid superior temporal gyrus (STG) and sulcus (STS) while listening to speech and human voices, in the posterior STS and fusiform gyrus when combining auditory, visual and linguistic information, as well as in lefthemisphere temporal and frontal cortical areas during comprehension. In the present functional magnetic resonance imaging (fMRI) study, we investigated how selective attention modulates neural responses to naturalistic audiovisual dialogues. Our healthy adult participants (N = 15) selectively attended to video-taped dialogues between a man and woman in the presence of irrelevant continuous speech in the background. We modulated the auditory quality of dialogues with noise vocoding and their visual quality by masking speech-related facial movements. Both increased auditory quality and increased visual quality were associated with bilateral activity enhancements in the STG/STS. In addition, decreased audiovisual stimulus quality elicited enhanced fronto-parietal activity, presumably reflecting increased attentional demands. Finally, attention to the dialogues, in relation to a control task where a fixation cross was attended and the dialogue ignored, yielded enhanced activity in the left planum polare, angular gyrus, the right temporal pole, as well as in the orbitofrontal/ventromedial prefrontal cortex and posterior cingulate gyrus. Our findings suggest that naturalistic conversations effectively engage participants and reveal brain networks related to social perception in addition to speech and semantic processing networks.

neuroscience↗