bioRxiv Science⌕ Search

bioRxiv · 10.1101/2022.04.06.487388

Stabilizing brain-computer interfaces through alignment of latent dynamics

Abstract

Intracortical brain-computer interfaces (iBCIs) restore motor function to people with paralysis by translating brain activity into control signals for external devices. In current iBCIs, instabilities at the neural interface result in a degradation of decoding performance, which necessitates frequent supervised recalibration using new labeled data. One potential solution is to use the latent manifold structure that underlies neural population activity to facilitate a stable mapping between brain activity and behavior. Recent efforts using unsupervised approaches have improved iBCI stability using this principle; however, existing methods treat each time step as an independent sample and do not account for latent dynamics. Dynamics have been used to enable high performance prediction of movement intention, and may also help improve stabilization. Here, we present a platform for Nonlinear Manifold Alignment with Dynamics (NoMAD), which stabilizes iBCI decoding using recurrent neural network models of dynamics. NoMAD uses unsupervised distribution alignment to update the mapping of nonstationary neural data to a consistent set of neural dynamics, thereby providing stable input to the iBCI decoder. In applications to data from monkey motor cortex collected during motor tasks, NoMAD enables accurate behavioral decoding with unparalleled stability over weeks-to months-long timescales without any supervised recalibration.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Karpowicz, B. M., Ali, Y. H., Wimalasena, L. N., Sedler, A. R., Keshtkaran, M. R., Bodkin, K., Ma, X., Miller, L. E., Pandarinath, C.. 2022-04-08. Stabilizing brain-computer interfaces through alignment of latent dynamics. https://doi.org/10.1101/2022.04.06.487388

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Novel Tau Interaction Partners as Potential Biomarkers and Therapeutic Targets in Neurodegenerative Diseases

Alzheimers disease is a progressive neurodegenerative disorder leading to cognitive decline and ultimately death. One of the main hallmarks of this disease is the accumulation of pathological tau protein into neurofibrillary tangles. To better understand these pathological mechanisms, it is essential to characterize the tau protein interactome in health and disease. In this study, we performed a yeast two-hybrid screening using a human brain cDNA library, from which we identified 15 novel tau-interacting proteins that bind to full-length human tau, or its fragments: the N-terminus, microtubule-binding domain, or C-terminus. We subsequently validated these novel interactions using in vitro co-immunoprecipitation and colocalization assays with both physiological and pathological tau isoforms. Furthermore, their interactions with the human tau protein were analyzed using surface plasmon resonance. Finally, an in silico interactome analysis of these newly discovered tau-binding partners revealed several additional interactors that can link them to downstream processes critical to neurodegenerative pathways Our findings offer fresh insights into tau biology and highlight novel targets for therapeutic intervention and biomarker development.

neuroscience↗

Early visual cortex is not functionally necessary for temporal attention: A TMS study

Temporal attention enhances the selective processing of information at a specific point in time and improves perception. Previous neuroimaging studies investigating its neural mechanisms have either conflated temporal attention with temporal expectation or provided correlational evidence. Thus, whether early visual cortex is functionally necessary for temporal attention remains unknown. Here, we combined psychophysics with transcranial magnetic stimulation (TMS) to examine whether V1/V2 are functionally necessary and play a causal role in temporal attention. Observers performed an orientation-discrimination task in which two consecutive stimuli, T1 and T2, were presented in the periphery, preceded by a precue providing either valid or neutral temporal information. Double-pulse TMS was delivered under four conditions: at T1 (T1-TMS), at T2 (T2-TMS), at both T1 and T2 (both-TMS), or not at all (none-TMS), to assess its effects on temporal attention and the efficacy of the stimulation was verified by pupil size analysis. Behavioral results revealed robust temporal attention benefits on d', reaction time, and the Balanced Integration Score (BIS) across all four TMS conditions, indicating that the benefits of temporal attention were unaffected by occipital TMS. Furthermore, pupil dilation was largest in the both-TMS condition, followed by the T1-TMS and T2-TMS conditions, and smallest in the none-TMS condition, providing physiological verification of the stimulation protocol. Together, these findings reveal the first causal evidence that the early visual cortex is not functionally necessary for endogenous temporal attention.

neuroscience↗

Disentanglement of persistent and dynamic neural substrates of working memory

Competing theories of working memory have alternatively emphasized the importance of persistent and dynamic substrates of this cognitive function. Here, we directly tested these theories by computationally isolating the contributions of persistent and dynamic activity to working memory. We analyzed neuronal population activity recordings in macaques doing match/non-match working memory tasks. We first extracted signatures of persistent and dynamic activity through cue-specific temporal means, temporal principal components, and correlations of activity patterns across task epochs. We then generated synthetic data constrained by these signatures, and decoded cue stimuli from these data, separately from persistent and non-persistent neurons. We found that high decoding performance arose from a nuanced interplay of persistent and dynamic activity. Specifically, we could decode stimuli at empirical or above-chance levels across all tasks only from persistent neurons, but only after constraining correlations of activity patterns across epochs. In this way, we showed distinct roles for persistent and dynamic neuronal activity that help to unify two competing theories of working memory. More broadly, we also advanced computational controlled experiments as a principled framework for adjudicating between competing models of neuronal population activity.

neuroscience↗