bioRxiv Science⌕ Search

Biology subjects

Vansteensel, M. J.

Publications and source records attributed to Vansteensel, M. J..

4 recordsLinked to original sources

Optimal positioning and size of high-density electrocorticography grids for speech brain-computer interfaces

Speech-based brain-computer interfaces (BCIs) can offer an intuitive means of communication for those who have lost the ability to speak due to paralysis. Significant progress has been made in classifying individual words from high numbers of electrocorticographic (ECoG) electrodes on the sensorimotor cortex (SMC). As implantations of larger grids with more ECoG electrodes are associated with higher surgical risk, we here examined whether confined electrode configurations can match the classification accuracy of larger grids. To this end, we analyzed data from eight able-bodied participants with high-density ECoG grids (64 to 128 electrodes) who performed a task that involved speaking 12 Dutch words. Word pronunciation was associated with changes in high frequency band activity in two SMC foci, one in the ventral SMC and another in the dorsal SMC. Using a combinatorics approach, we found that a smaller, rectangular, configuration with a surface area of 325 mm2 to 561 mm2 (32 electrodes) could achieve a word classification accuracy similar to that of the larger grids: 76{+/-}16% versus 75{+/-}17% across participants, respectively (practical chance level 16.7%). The best configurations were oriented vertically and centered on the central sulcus. These findings indicate that a 32-electrode ECoG grid placed optimally can be sufficient for achieving high word classification accuracy on a closed set of words. We conclude that targeted placement of small ECoG grids can reduce surgical demands on end users and justify energy- and complexity-efficient designs of fully implantable BCI devices for individuals with severe paralysis.

neuroscience↗

Direct Speech Reconstruction from Sensorimotor Brain Activity with Optimized Deep Learning Models

Development of brain-computer interface (BCI) technology is key for enabling communication in individuals who have lost the faculty of speech due to severe motor paralysis. A BCI control strategy that is gaining attention employs speech decoding from neural data. Recent studies have shown that a combination of direct neural recordings and advanced computational models can provide promising results. Understanding which decoding strategies deliver best and directly applicable results is crucial for advancing the field. In this paper, we optimized and validated a decoding approach based on speech reconstruction directly from high-density electrocorticography recordings from sensorimotor cortex during a speech production task. We show that 1) dedicated machine learning optimization of reconstruction models is key for achieving the best reconstruction performance; 2) individual word decoding in reconstructed speech achieves 92-100% accuracy (chance level is 8%); 3) direct reconstruction from sensorimotor brain activity produces intelligible speech. These results underline the need for model optimization in achieving best speech decoding results and highlight the potential that reconstruction-based speech decoding from sensorimotor cortex can offer for development of next-generation BCI technology for communication.

neuroscience↗

Open multimodal iEEG-fMRI dataset from naturalistic stimulation with a short audiovisual film

Intracranial human recordings are a valuable and rare resource that the whole neuroscience community can benefit from. Making such data available to the neuroscience community not only helps tackle the reproducibility issues in science, it also helps make more use of this valuable data. The latter is especially true for data collected using naturalistic tasks. Here, we describe a dataset collected from a large group of human subjects while they watched a short audiovisual film. The dataset is characterized by several unique features. First, it combines a large amount of intracranial data from 51 intracranial electroencephalography (iEEG) participants, who all did the same task. Second, the intracranial data are accompanied by fMRI recordings acquired for the same task in 30 functional magnetic resonance imaging (fMRI) participants. Third, the data were acquired using a rich audiovisual stimulus, for which we provide detailed speech and video annotations. This multimodal dataset can be used to address questions about neural mechanisms of multimodal perception and language comprehension as well as the nature of the neural signal acquired during the same task across brain recording modalities.

neuroscience↗

Electrocorticographic dissociation of alpha and beta rhythmic activity in the human sensorimotor system

This study uses electrocorticography in humans to assess how alpha- and beta-band rhythms modulate excitability of the sensorimotor cortex during movement selection, as indexed through a psychophysically-controlled movement imagery task. Both rhythms displayed effector-specific modulations, tracked spectral markers of action potentials in the local neuronal population, and showed spatially systematic phase relationships (traveling waves). Yet, alpha- and beta-band rhythms differed in their anatomical and functional properties, were weakly correlated, and traveled along opposite directions across the sensorimotor cortex. Increased alpha-band power in the somatosensory cortex ipsilateral to the selected arm was associated with spatially-unspecific inhibition. Decreased beta-band power over contralateral motor cortex was associated with a focal shift from relative inhibition to excitation. These observations indicate the relevance of both inhibition and disinhibition mechanisms for precise spatiotemporal coordination of neuronal populations during movement selection. Those mechanisms are implemented through the substantially different neurophysiological properties of sensorimotor alpha- and beta-band rhythms.

neuroscience↗