Biology subjects

Collinger, J.

Publications and source records attributed to Collinger, J..

4 recordsLinked to original sources

bioRxiv2023

Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity

The neural population spiking activity recorded by intracortical brain-computer interfaces (iBCIs) contain rich structure. Current models of such spiking activity are largely prepared for individual experimental contexts, restricting data volume to that collectable within a single session and limiting the effectiveness of deep neural networks (DNNs). The purported challenge in aggregating neural spiking data is the pervasiveness of context-dependent shifts in the neural data distributions. However, large scale unsupervised pretraining by nature spans heterogeneous data, and has proven to be a fundamental recipe for successful representation learning across deep learning. We thus develop Neural Data Transformer 2 (NDT2), a spatiotemporal Transformer for neural spiking activity, and demonstrate that pretraining can leverage motor BCI datasets that span sessions, subjects, and experimental tasks. NDT2 enables rapid adaptation to novel contexts in downstream decoding tasks and opens the path to deployment of pretrained DNNs for iBCI control. Code: https://github.com/joel99/context_general_bci

neuroscience↗

bioRxiv2023

Tessellation Of Artificial Touch Via Microstimulation Of Human Somatosensory Cortex

When we interact with objects, we rely on signals from the hand that convey information about the object and our interaction with it. A basic feature of these interactions, the locations of contacts between the hand and object, is often only available via the sense of touch. Information about locations of contact between a brain-controlled bionic hand and an object can be signaled via intracortical microstimulation (ICMS) of somatosensory cortex (S1), which evokes touch sensations that are localized to a specific patch of skin. To provide intuitive location information, tactile sensors on the robotic hand drive ICMS through electrodes that evoke sensations at skin locations matching sensor locations. This approach requires that ICMS-evoked sensations be focal, stable, and distributed over the hand. To systematically investigate the localization of ICMS-evoked sensations, we analyzed the projected fields (PFs) of ICMS-evoked sensations - their location and spatial extent - from reports obtained over multiple years from three participants implanted with microelectrode arrays in S1. First, we found that PFs vary widely in their size across electrodes, are highly stable within electrode, are distributed over large swaths of each participants hand, and increase in size as the amplitude or frequency of ICMS increases. Second, while PF locations match the locations of the receptive fields (RFs) of the neurons near the stimulating electrode, PFs tend to be subsumed by the corresponding RFs. Third, multi-channel stimulation gives rise to a PF that reflects the conjunction of the PFs of the component channels. By stimulating through electrodes with largely overlapping PFs, then, we can evoke a sensation that is experienced primarily at the intersection of the component PFs. To assess the functional consequence of this phenomenon, we implemented multi-channel ICMS-based feedback in a bionic hand and demonstrated that the resulting sensations are more localizable than are those evoked via single-channel ICMS.

neuroscience↗

bioRxiv2023

Biomimetic multi-channel microstimulation of somatosensory cortex conveys high resolution force feedback for bionic hands

AO_SCPLOWBSTRACTC_SCPLOWManual interactions with objects are supported by tactile signals from the hand. This tactile feedback can be restored in brain-controlled bionic hands via intracortical microstimulation (ICMS) of somatosensory cortex (S1). In ICMS-based tactile feedback, contact force can be signaled by modulating the stimulation intensity based on the output of force sensors on the bionic hand, which in turn modulates the perceived magnitude of the sensation. In the present study, we gauged the dynamic range and precision of ICMS-based force feedback in three human participants implanted with arrays of microelectrodes in S1. To this end, we measured the increases in sensation magnitude resulting from increases in ICMS amplitude and participants ability to distinguish between different intensity levels. We then assessed whether we could improve the fidelity of this feedback by implementing "biomimetic" ICMS-trains, designed to evoke patterns of neuronal activity that more closely mimic those in natural touch, and by delivering ICMS through multiple channels at once. We found that multi-channel biomimetic ICMS gives rise to stronger and more distinguishable sensations than does its single-channel counterpart. Finally, we implemented biomimetic multi-channel feedback in a bionic hand and had the participant perform a compliance discrimination task. We found that biomimetic multi-channel tactile feedback yielded improved discrimination over its single-channel linear counterpart. We conclude that multi-channel biomimetic ICMS conveys finely graded force feedback that more closely approximates the sensitivity conferred by natural touch.

neuroscience↗

bioRxiv2022

Microstimulation of human somatosensory cortex evokes task-dependent, spatially patterned responses in motor cortex

AO_SCPLOWBSTRACTC_SCPLOWMotor (M1) and somatosensory (S1) cortex play a critical role in motor control but the nature of the signaling between these structures is not known. To fill this gap, we recorded - in three human participants whose hands were paralyzed as a result of a spinal cord injury - the responses evoked in the hand and arm representations of primary motor cortex (M1) while we delivered ICMS to the somatosensory cortex (S1). We found that ICMS of S1 activated some M1 neurons at short, fixed latencies, locked to each pulse in a manner consistent with monosynaptic activation. However, most of the changes in M1 firing rates were much more variable in time, suggesting a more indirect effect of the stimulation. The spatial pattern of M1 activation varied systematically depending on the stimulating electrode: S1 electrodes that elicited percepts at a given hand location tended to activate M1 neurons with movement fields at the same location. However, the indirect effects of S1 ICMS on M1 were strongly context dependent, such that the magnitude and even sign relative to baseline varied across tasks. We tested the implications of these effects for brain-control of a virtual hand, in which ICMS was used to convey tactile feedback about object interactions. While ICMS-evoked activation of M1 disrupted decoder performance, this disruption could be minimized with biomimetic stimulation, which emphasizes contact transients at the onset and offset of grasp, reduces sustained stimulation, and has been shown to convey useful contact-related information. SO_SCPLOWIGNIFICANCEC_SCPLOWMotor (M1) and somatosensory (S1) cortex play a critical role in motor control but the nature of the signaling between these structures is not known. To fill this gap, we recorded from M1 while delivering intracortical microstimulation (ICMS) to S1 of three human participants, whose hands were paralyzed by spinal cord injury. We found that ICMS activates M1 and that the motor fields of activated M1 neurons match the sensory fields of the stimulated S1 electrodes. These findings have important implications for using ICMS to convey tactile feedback for brain-controlled bionic hands. Indeed, the ICMS-evoked M1 activity worsens control of the hand. Fortunately, this effect is minimized by using biomimetic tactile feedback, which emphasizes contact transients and reduces sustained ICMS.

neuroscience↗