bioRxiv Science⌕ Search

Biology subjects

Collinger, J. L.

Publications and source records attributed to Collinger, J. L..

12 recordsLinked to original sources

Intracortical BCI Performance is Robust to Changes in Attentional Load During Dual-Tasking

High performance intracortical brain-computer interface (iBCI) control has been demonstrated in research settings, but performance can still vary within and between sessions. One potential source of this variability is the change in attentional load that comes from processing naturally occurring distractors such as thoughts, sounds, fatigue, or pain. To improve the consistency of iBCI performance in real-world environments where this sort of multi-tasking is inevitable, we must understand how shifts in attention can impact performance. Here we examined the effect of attentional load on iBCI performance and movement-related neural activity using a 2D cursor translation + click iBCI task paired with an N-Back working memory task to increase attentional load during dual-task performance. Two participants (P2 and P4) with tetraplegia completed the study while enrolled in a long-term clinical trial of an iBCI device (NCT1894802). Common neural correlates of attention (theta and alpha band power) were measured with simultaneously recorded scalp electroencephalography (EEG). While the EEG recordings and difficulty ratings suggested increased attentional load during dual tasking, iBCI performance was quite robust across the various dual tasking conditions. One participant, P2, experienced a small but significant increase in trial completion time and normalized path length during the mild attentional load condition. Signal quality differences between the two participants may have impacted the results, as P2 had lower signal quality and was therefore likely more vulnerable to attentional load. P4s higher signal quality likely allowed him to accommodate increased attentional load without a drop in performance. Overall, iBCI performance appears to be robust to attentional load, but the complex trends observed here reflect a need for continued investigation of BCI use under different cognitive states to elucidate potential challenges and compensatory mechanisms across participants.

bioengineering↗

Overlap in neural representations of coordinated wrist and finger movements in human motor cortex

Dexterous hand function underlies many essential human activities, from tool use to expression through gestures. Coordinated digit movements are enabled by the intricate musculature of the hand and forearm, which also imposes mechanical coupling between the digits and wrist, constraining their independent control. It remains unclear whether motor cortex inherits these constraints in its activity or encodes digit and wrist independently. To address this problem, we asked individuals with intracortical microelectrode arrays implanted in motor cortex to attempt flexion and extension of individual digits, either in isolation or in combination with attempted wrist movements. We could accurately decode which digit was moving based on cortical recordings, and channels selective for digit identity were arranged somatotopically across the recording arrays. Nevertheless, the activity during flexion or extension overlapped between digits, and movement direction of a given digit could be reliably inferred by a decoder trained on movements of other digits. This directional signal was largely invariant to the digits initial posture. The population axis describing digit movement direction was aligned with the axes associated with wrist flexion-extension or pronation-supination. This alignment persisted during simultaneous wrist and digit movements, which complicated efforts to control them individually. However, by decoding wrist and digit motion from activity orthogonal to the shared direction axis, a participant was able to achieve continuous control of virtual hand movements with improved speed and reduced unintended movements. Together, the results identify both a code for digit identity and a low-dimensional flexion-extension signal which is shared across the digits and wrist. This arrangement is consistent with muscle-like biomechanical constraints on motor cortical activity, which must be accounted for to improve coordinated BCI control.

neuroscience↗

Closed-loop error damping in human BCI using pre-error motor cortex activity

Intracortical brain-computer interfaces (BCIs) are used to decode motor intent from neural population activity; their main clinical application is to restore function for individuals with motor or communication deficits. However, when trying to reconstruct movement trajectories, such as in computer cursor control, even state-of-the-art decoders fall short of able-bodied performance during online BCI control. This calls for alternative approaches to improve the usability of motor BCIs. Here, we leveraged an error signal, i.e. a neural correlate of faulty motor control that can be detected from neural activity. By detecting this error signal in parallel to performing movement decoding, it is possible to perform error modulation, i.e. real-time error detection and correction during a closed-loop motor BCI task. We analyzed data from four individuals with upper limb impairment due to cervical spinal cord injury who each used an intracortical BCI to perform a continuous cursor control task with visual feedback. A classifier was trained to detect the error signal and was used to perform online error detection during BCI control to limit ongoing errors (defined as movement of the controller away from its target) without requiring any specific action from the participants. Our contribution is three-fold. First, we show that the error signal has a pre-error component. Cortical activity was already significantly modulated before the onset of the kinematically-defined error, theoretically allowing for earlier detection. Second, we show that error modulation significantly improves performance during online BCI control of cursor kinematics. Finally, we show that the error signal can be robustly leveraged across contexts, as error modulation improves performance in more complex motor tasks (involving for instance grasp and drag actions) or other environments without task-specific calibration. Overall, our results suggest that the error signal can be robustly disentangled from motor intent in cortical activity, and that even a simple linear classifier can enable error modulation in parallel to a continuous kinematic decoder, yielding more reliable and accurate BCI control.

neuroscience↗

Distinct neural modes carry information about grasp force and phase in the sensorimotor cortex

Humans perform a variety of complex hand movements to manipulate objects, requiring precise control of changing forces. Understanding the role of sensorimotor cortex and the cortical dynamics underlying these actions is crucial for developing interventions that restore dexterous hand function after injury or disease. In this study, two individuals with tetraplegia resulting from cervical spinal cord injury attempted a series of isometric grasps. Neural activity was recorded from the motor and somatosensory cortices using intracortical microelectrode arrays while participants attempted to exert a static force or to ramp force up and down. Despite their inability to execute movement, and with limited afferent input, the spiking activity in motor and somatosensory cortex was modulated with the task. Within the neural response we identified independent neural modes - distinct patterns of population-level neural activity - that were informative about both the timing and magnitude of the force. Moreover, distinct neural modes were observed during static and dynamic grasping conditions, suggesting independent control schemes for maintaining and changing forces. These modes were related to phases of the task, including the onset, offset, holding periods, as well as phases of increasing and decreasing force. These results will inform the design of intracortical brain-computer interface (iBCI) systems that can leverage these naturally occurring patterns of grasp and force control to restore dexterous hand function. Significance StatementRestoring dexterous hand function after injury remains a major challenge, partly due to an incomplete understanding of the cortical dynamics underlying grasping and force control. In this study, we investigated neural activity within the motor and somatosensory cortices of individuals with tetraplegia attempting to perform grasps to different target forces with varying temporal profiles. We identified distinct neural modes modulated during specific phases of grasp that encode force information throughout the task. These findings suggest that brain-computer interfaces could leverage these native neural modes to restore grasping and force modulation.

neuroscience↗

Finite element model predicts micromotion-induced strain profiles that correlate with the functional performance of Utah arrays in humans and non-human primates

ObjectiveUtah arrays are widely used in both humans and non-human primates (NHPs) for intracortical brain-computer interfaces (BCIs), primarily for detecting electrical signals from cortical tissue to decode motor commands. Recently, these arrays have also been applied to deliver electrical stimulation aimed at restoring sensory functions. A key challenge limiting their longevity is the micromotion between the array and cortical tissue, which may induce mechanical strain in surrounding tissue and contribute to performance decline. This strain, due to mechanical mismatch, can exacerbate glial scarring around the implant, reducing the efficacy of Utah arrays in recording neuronal activity and delivering electrical stimulation. ApproachTo investigate this, we employed a finite element model (FEM) to predict tissue strains resulting from micromotion. Main ResultsOur findings indicated that strain profiles around edge and corner electrodes were greater than those around interior shanks, affecting both maximum and average strains within 50 {micro}m of the electrode tip. We then correlated these predicted tissue strains with in-vivo electrode performance metrics. We found negative correlations between 1 kHz impedance and tissue strains in human motor arrays and NHP area V4 arrays at 1-mo, 1-yr, and 2-yrs post-implantation. In human motor arrays, the peak-to-peak waveform voltage (PTPV) and signal-to-noise ratio (SNR) of spontaneous activity were also negatively correlated with strain. Conversely, we observed a positive correlation between the evoked SNR of multi-unit activity and strain in NHP area V4 arrays. SignificanceThis study establishes a spatial dependence of electrode performance in Utah arrays that correlates with tissue strain.

neuroscience↗

Few-shot Algorithms for Consistent Neural Decoding (FALCON) Benchmark

Intracortical brain-computer interfaces (iBCIs) can restore movement and communication abilities to individuals with paralysis by decoding their intended behavior from neural activity recorded with an implanted device. While this activity yields high-performance decoding over short timescales, neural data are often nonstationary, which can lead to decoder failure if not accounted for. To maintain performance, users must frequently recalibrate decoders, which requires the arduous collection of new neural and behavioral data. Aiming to reduce this burden, several approaches have been developed that either limit recalibration data requirements (few-shot approaches) or eliminate explicit recalibration entirely (zero-shot approaches). However, progress is limited by a lack of standardized datasets and comparison metrics, causing methods to be compared in an ad hoc manner. Here we introduce the FALCON benchmark suite (Few-shot Algorithms for COnsistent Neural decoding) to standardize evaluation of iBCI robustness. FALCON curates five datasets of neural and behavioral data that span movement and communication tasks to focus on behaviors of interest to modern-day iBCIs. Each dataset includes calibration data, optional few-shot recalibration data, and private evaluation data. We implement a flexible evaluation platform which only requires user-submitted code to return behavioral predictions on unseen data. We also seed the benchmark by applying baseline methods spanning several classes of possible approaches. FALCON aims to provide rigorous selection criteria for robust iBCI decoders, easing their translation to real-world devices. https://snel-repo.github.io/falcon/

neuroscience↗

How different immersive environments affect intracortical brain computer interfaces

AO_SCPLOWBSTRACTC_SCPLOWAs brain-computer interface (BCI) research advances, many new applications are being developed. Tasks can be performed in different environments, and whether a BCI user can switch environments seamlessly will influence the ultimate utility of a clinical device. Here we investigate the importance of the immersiveness of the virtual environment used to train BCI decoders on the resulting decoder and its generalizability between environments. Two participants who had intracortical electrodes implanted in their precentral gyrus used a BCI to control a virtual arm, either viewed immersively through virtual reality goggles or at a distance on a flat television monitor. Each participant performed better with a decoder trained and tested in the environment they had used the most prior to the study, one for each environment type. The neural tuning to the desired movement was minimally influenced by the immersiveness of the environment. Finally, in further testing with one of the participants, we found that decoders trained in one environment generalized well to the other environment, but the order in which the environments were experienced within a session mattered. Overall, experience with an environment was more influential on performance than the immersiveness of the environment, but BCI performance generalized well after accounting for experience.

neuroscience↗

Motor cortex retains and reorients neural dynamics during motor imagery

The most prominent role of motor cortex is generating patterns of neural activity that lead to movement, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioral and imaging studies, it is unknown how the specific activity patterns and temporal dynamics within motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people with residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population-level activity into orthogonal subspaces such that one set of components was similarly active during both action and imagery, and others were only active during a single task type--action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamical features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by recreating the missing components related to motor output and/or feedback within a unique imagery-only subspace.

neuroscience↗

Perceptual responses to microstimulation frequency are spatially organized in human somatosensory cortex

Microstimulation in the somatosensory cortex can evoke artificial tactile percepts and can be incorporated into bidirectional brain-computer interfaces (BCIs) to restore function after injury or disease. However, little is known about how stimulation parameters themselves affect perception. Here, we stimulated through microelectrode arrays implanted in the somatosensory cortex of a human participant with a cervical spinal cord injury and varied the stimulus amplitude, duration, and frequency. Increasing the amplitude and duration increased the perceived intensity on all tested electrodes. Surprisingly, we found that increasing the frequency evoked more intense percepts on some electrodes but evoked less intense percepts on most electrodes. Electrodes divided into three groups which evoked distinct perceptual qualities that depended on the stimulus frequency and were spatially organized in cortex. These results contribute to our growing understanding of the structure and function of the somatosensory cortex and will facilitate principled development of stimulation strategies for bidirectional BCIs.

neuroscience↗

Functional and Structural Moment Arm Validation for Musculoskeletal Models: A Study of the Human Forearm and Hand

The development of realistic musculoskeletal models is a fundamental goal for the theoretical progress in sensorimotor control and its engineering applications, e.g., in the biomimetic control of artificial limbs. Yet, accurate models require extensive experimental measures to validate structural and functional parameters describing muscle state over the full physiological range of motion. However, available experimental measurements of, for example, muscle moment arms are sparse and often disparate. Validation of these models is not trivial because of the highly complex anatomy and behavior of human limbs. In this study, we developed a method to validate and scale kinematic muscle parameters using posture-dependent moment arm profiles, isometric force measurements, and a computational detection of assembly errors. We used a previously published model with 18 degrees of freedom (DOFs) and 32 musculotendon actuators with force generated from a Hill-type muscle model. The muscle path from origin to insertion with wrapping geometry was used to model the muscle lengths and moment arms. We simulated moment arm profiles across the full physiological range of motion and compared them to an assembled dataset of published and merged experimental profiles. The muscle paths were adjusted using custom metrics based on root-mean-square and correlation coefficient of the difference between simulated and experimental values. Since the available measurements were sparse and the examination of high-dimensional muscles is challenging, we developed analyses to identify common failures, i.e., moment arm functional flipping due to the sign reversal in simulated moments and the imbalance of force generation between antagonistic groups in postural extremes. The validated model was used to evaluate the expected errors in torque generation with the assumption of constant instead of the posture-dependent moment arms at the wrist flexion-extension DOF, which is the critical joint in our model with the largest number of crossing muscles. We found that there was a reduction of joint torques by about 35% in the extreme quartiles of the wrist DOF. The use of realistic musculoskeletal models is essential for the reconstruction of hand dynamics. These models may improve the understanding of muscle actions and help in the design and control of artificial limbs in future applications. New & NoteworthyRealistic models of human limbs are a development goal required for the understanding of motor control and its applications in biomedical fields. However, developing accurate models is restrained by the lack of accurate and reliable musculoskeletal measurements in humans. Here, we have overcome this challenge by using multi-stage validation of simulated structures using both experimental data and the identification of structural failures in the high-dimensional muscle paths. We demonstrate that the rigorous structural and functional validation method is essential for the understanding of force generation at the wrist.

neuroscience↗

The effect of wrist posture on extrinsic finger muscle activity during single joint movements

Wrist posture impacts the muscle lengths and moment arms of the extrinsic finger muscles that cross the wrist. As a result, the electromyographic (EMG) activity associated with digit movement at different wrist postures may also change. Therefore, we sought to quantify the posture-dependence of extrinsic finger muscle activity. Fine-wire bipolar electrodes were inserted in the extrinsic hand muscles of able-bodied subjects to record EMG activity during wrist and finger movements in various postures. EMG activity of all the recorded finger muscles were significantly different (p<.05, ANOVA) when performing the same movement in five different wrist postures. EMG activity varied by up to 70%, with the highest levels of activity observed in finger extensors when the wrist was extended. Similarly, finger flexors were most active when the wrist was flexed. For the finger flexors, EMG variations with wrist posture were most prominent for index finger muscles, while the EMG activity of all finger extensor muscles were similarly modulated. The extrinsic finger muscles also showed significant activity during wrist movements with the digits held still regardless of finger posture, suggesting that they may play a role in generating torque during wrist movements. Finally, we developed a pair of generalized classifiers that show that finger muscle EMG can be used to predict wrist posture. These results may impact the design of biomimetic control algorithms for myoelectric prosthetic hands, but further work in transradial amputees is necessary to determine whether this phenomenon persists after amputation.

bioengineering↗

Restored tactile sensation improves neuroprosthetic arm control

Summary paragraphThe sense of touch is critical for skillful hand control1-3, but is largely missing for people who use prosthetic devices. Instead, prosthesis users rely heavily on visual feedback, even though state transitions that are necessary to skillfully interact with objects, such as object contact, are relayed more precisely through tactile feedback4-6. Here we show that restoring tactile sensory feedback, through intracortical microstimulation of the somatosensory cortex7, enables a person with a bidirectional intracortical brain-computer interface to improve their performance on functional object transport tasks completed with a neurally-controlled prosthetic limb. The participant had full visual feedback and had practiced the task for approximately two years prior to these experiments. Nevertheless, successful trial times on a commonly used clinical upper limb assessment task were reduced from a median time of 20.9 s (13.1 - 40.5 s interquartile range) to 10.2 s (5.4 - 18.1 s interquartile range) when vision was supplemented with microstimulation-evoked cutaneous percepts that were referred to different fingers and were graded in intensity based on real-time prosthesis contact forces. Faster completion times were primarily due to a reduction in the amount of time spent attempting to grasp objects. These results demonstrate the importance of tactile sensations in upper-limb control and the utility of creating bidirectional brain-computer interfaces to restore this stream of information using intracortical microstimulation.

clinical trials↗