bioRxiv Science⌕ Search

Biology subjects

Collinger, J.

Publications and source records attributed to Collinger, J..

8 recordsLinked to original sources

Real-time intracortical decoding from human motor cortex reveals a task-independent commitment to act that aligns with conscious intent

Preparatory neural signals that precede movement onset are well established. However, whether they mark a commitment to act, align with conscious intention, or are subject to voluntary control remains under debate. We addressed these questions with a closed-loop experiment: a strategic timing game where a virtual opponent monitored intracortical sensorimotor activity and preempted participants' actions when their intention to move was detected. In three people with tetraplegia and preserved wrist extension, movement onset was reliably predicted from motor cortex 250-400 ms before action. Although participants attempted to act unpredictably, they were preempted on 94% of trials -and movement output generally followed despite the opponent's interruption. Participants reported intending to act on 88% of preemptions. The same decoder accurately predicted participants' actions in a non-competitive task, without retraining. These findings identify a late, task-independent motor-cortical state marking a voluntary commitment to act, which participants report as an intention when interrupted.

neuroscience↗

Enabling Skilled Human-Computer Interaction After Paralysis via a Wearable sEMG Interface

Most individuals with tetraplegia retain some myoelectric function in their forearms, which offers the possibility of using surface electromyographic (sEMG) control for human-computer interaction (HCI). We demonstrate the potential of this approach by showing that people with motor-complete (n=5) and motor-incomplete (n=2) tetraplegia can accurately control myoelectric activity in their forearm to perform discrete button-click and continuous positioning tasks. These control inputs were mapped to the firing rate of motor units detected by a wireless wristband sensor designed for everyday use. Participants completed four testing sessions to assess their speed and accuracy. Motor units that displayed a wide dynamic range in their firing rate performed best during tasks requiring continuous, single-axis control. Interestingly, the level of impairment did not affect performance on the clicking and 1D cursor control tasks. However, those with motor-incomplete injuries showed greater independent control over two motor units than participants with motor-complete injuries, who exhibited stronger coupling between units. Participants also confirmed the practical utility of the device, successfully placing and removing the sEMG wristband on their own and consistently rating it as comfortable and easy to manage. These findings are significant because they offer the first demonstration of motor unit-based control in individuals with cervical spinal cord injury (SCI) using a fully wearable wristband interface, highlighting the feasibility of moving these systems out of the lab and into daily life. One-Sentence SummaryPeople with tetraplegia used a wristband sensor to detect forearm motor unit firing and perform human-computer interaction tasks.

bioengineering↗

Mapping the Causal Roles of Non-Primary Motor Areas in Human Reach Planning and Execution

Non-primary motor areas, including the dorsal premotor cortex (PMd), ventral premotor cortex (PMv), and posterior parietal cortex (PPC), are involved in movement planning, but their precise contributions remain unclear. We used functional magnetic resonance imaging (fMRI), transcranial magnetic stimulation (TMS), and kinematic assessments to explore how these areas influence reaching performance in neurologically intact adults. Participants performed a reaching task using the KINARM exoskeleton robot. Brief TMS pulse trains were initiated before movement onset to perturb cortical activity at subthreshold and suprathreshold intensities targeting bilateral PMd, PMv, and PPC. Subthreshold stimulation of contralateral PMd and PMv reduced reach efficiency and smoothness, while suprathreshold stimulation of contralateral PPC increased deviation error and reduced smoothness. Among ipsilateral targets, PMd showed consistent TMS-induced effects, and was the only target where resting-state connectivity predicted behavioral response. Stronger interhemispheric connectivity in the primary motor cortex and weaker interhemispheric PPC connectivity were associated with greater reductions in straightness and smoothness during subthreshold ipsilateral PMd stimulation. These findings show that perturbation of premotor and parietal areas during early movement execution alters reach trajectories, and differences in network organization explain variability in behavioral response. Identifying contributions of cortical areas and connectivity patterns may help personalize interventions after stroke. This study was registered at ClinicalTrials.gov under ID NCT04286516.

bioengineering↗

A Generalist Intracortical Motor Decoder

Mapping the relationship between neural activity and motor behavior is a central aim of sensori-motor neuroscience and neurotechnology. While most progress to this end has relied on restricting complexity, the advent of foundation models instead proposes integrating a breadth of data as an alternate avenue for broadly advancing downstream modeling. We quantify this premise for motor decoding from intracortical microelectrode data, pretraining an autoregressive Transformer on 2000 hours of neural population spiking activity paired with diverse motor covariates from over 30 monkeys and humans. The resulting model is broadly useful, benefiting decoding on 8 downstream decoding tasks and generalizing to a variety of neural distribution shifts. However, we also highlight that scaling autoregressive Transformers seems unlikely to resolve limitations stemming from sensor variability and output stereotypy in neural datasets. Code: https://github.com/joel99/ndt3

neuroscience↗

Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity

The neural population spiking activity recorded by intracortical brain-computer interfaces (iBCIs) contain rich structure. Current models of such spiking activity are largely prepared for individual experimental contexts, restricting data volume to that collectable within a single session and limiting the effectiveness of deep neural networks (DNNs). The purported challenge in aggregating neural spiking data is the pervasiveness of context-dependent shifts in the neural data distributions. However, large scale unsupervised pretraining by nature spans heterogeneous data, and has proven to be a fundamental recipe for successful representation learning across deep learning. We thus develop Neural Data Transformer 2 (NDT2), a spatiotemporal Transformer for neural spiking activity, and demonstrate that pretraining can leverage motor BCI datasets that span sessions, subjects, and experimental tasks. NDT2 enables rapid adaptation to novel contexts in downstream decoding tasks and opens the path to deployment of pretrained DNNs for iBCI control. Code: https://github.com/joel99/context_general_bci

neuroscience↗

Tessellation Of Artificial Touch Via Microstimulation Of Human Somatosensory Cortex

When we interact with objects, we rely on signals from the hand that convey information about the object and our interaction with it. A basic feature of these interactions, the locations of contacts between the hand and object, is often only available via the sense of touch. Information about locations of contact between a brain-controlled bionic hand and an object can be signaled via intracortical microstimulation (ICMS) of somatosensory cortex (S1), which evokes touch sensations that are localized to a specific patch of skin. To provide intuitive location information, tactile sensors on the robotic hand drive ICMS through electrodes that evoke sensations at skin locations matching sensor locations. This approach requires that ICMS-evoked sensations be focal, stable, and distributed over the hand. To systematically investigate the localization of ICMS-evoked sensations, we analyzed the projected fields (PFs) of ICMS-evoked sensations - their location and spatial extent - from reports obtained over multiple years from three participants implanted with microelectrode arrays in S1. First, we found that PFs vary widely in their size across electrodes, are highly stable within electrode, are distributed over large swaths of each participants hand, and increase in size as the amplitude or frequency of ICMS increases. Second, while PF locations match the locations of the receptive fields (RFs) of the neurons near the stimulating electrode, PFs tend to be subsumed by the corresponding RFs. Third, multi-channel stimulation gives rise to a PF that reflects the conjunction of the PFs of the component channels. By stimulating through electrodes with largely overlapping PFs, then, we can evoke a sensation that is experienced primarily at the intersection of the component PFs. To assess the functional consequence of this phenomenon, we implemented multi-channel ICMS-based feedback in a bionic hand and demonstrated that the resulting sensations are more localizable than are those evoked via single-channel ICMS.

neuroscience↗

Biomimetic multi-channel microstimulation of somatosensory cortex conveys high resolution force feedback for bionic hands

AO_SCPLOWBSTRACTC_SCPLOWManual interactions with objects are supported by tactile signals from the hand. This tactile feedback can be restored in brain-controlled bionic hands via intracortical microstimulation (ICMS) of somatosensory cortex (S1). In ICMS-based tactile feedback, contact force can be signaled by modulating the stimulation intensity based on the output of force sensors on the bionic hand, which in turn modulates the perceived magnitude of the sensation. In the present study, we gauged the dynamic range and precision of ICMS-based force feedback in three human participants implanted with arrays of microelectrodes in S1. To this end, we measured the increases in sensation magnitude resulting from increases in ICMS amplitude and participants ability to distinguish between different intensity levels. We then assessed whether we could improve the fidelity of this feedback by implementing "biomimetic" ICMS-trains, designed to evoke patterns of neuronal activity that more closely mimic those in natural touch, and by delivering ICMS through multiple channels at once. We found that multi-channel biomimetic ICMS gives rise to stronger and more distinguishable sensations than does its single-channel counterpart. Finally, we implemented biomimetic multi-channel feedback in a bionic hand and had the participant perform a compliance discrimination task. We found that biomimetic multi-channel tactile feedback yielded improved discrimination over its single-channel linear counterpart. We conclude that multi-channel biomimetic ICMS conveys finely graded force feedback that more closely approximates the sensitivity conferred by natural touch.

neuroscience↗

Microstimulation of human somatosensory cortex evokes task-dependent, spatially patterned responses in motor cortex

AO_SCPLOWBSTRACTC_SCPLOWMotor (M1) and somatosensory (S1) cortex play a critical role in motor control but the nature of the signaling between these structures is not known. To fill this gap, we recorded - in three human participants whose hands were paralyzed as a result of a spinal cord injury - the responses evoked in the hand and arm representations of primary motor cortex (M1) while we delivered ICMS to the somatosensory cortex (S1). We found that ICMS of S1 activated some M1 neurons at short, fixed latencies, locked to each pulse in a manner consistent with monosynaptic activation. However, most of the changes in M1 firing rates were much more variable in time, suggesting a more indirect effect of the stimulation. The spatial pattern of M1 activation varied systematically depending on the stimulating electrode: S1 electrodes that elicited percepts at a given hand location tended to activate M1 neurons with movement fields at the same location. However, the indirect effects of S1 ICMS on M1 were strongly context dependent, such that the magnitude and even sign relative to baseline varied across tasks. We tested the implications of these effects for brain-control of a virtual hand, in which ICMS was used to convey tactile feedback about object interactions. While ICMS-evoked activation of M1 disrupted decoder performance, this disruption could be minimized with biomimetic stimulation, which emphasizes contact transients at the onset and offset of grasp, reduces sustained stimulation, and has been shown to convey useful contact-related information. SO_SCPLOWIGNIFICANCEC_SCPLOWMotor (M1) and somatosensory (S1) cortex play a critical role in motor control but the nature of the signaling between these structures is not known. To fill this gap, we recorded from M1 while delivering intracortical microstimulation (ICMS) to S1 of three human participants, whose hands were paralyzed by spinal cord injury. We found that ICMS activates M1 and that the motor fields of activated M1 neurons match the sensory fields of the stimulated S1 electrodes. These findings have important implications for using ICMS to convey tactile feedback for brain-controlled bionic hands. Indeed, the ICMS-evoked M1 activity worsens control of the hand. Fortunately, this effect is minimized by using biomimetic tactile feedback, which emphasizes contact transients and reduces sustained ICMS.

neuroscience↗