bioRxiv Science⌕ Search

Biology subjects

Allcroft, S.

Publications and source records attributed to Allcroft, S..

2 recordsLinked to original sources

Observation-Related Activity in Human Motor Cortex Increases with Effector Anthropomorphicity

Neurons in motor cortex can be engaged not only in motor execution but also during observation of movements performed by other anthropomorphic agents (i.e. humans or monkeys). However, it is unknown how motor cortical neurons respond during observation of the range of assistive or prosthetic devices controlled by people using intracortical brain-computer interfaces (iBCIs). We recorded single-unit activity in the precentral gyrus while iBCI users viewed grasp-like movements performed by a spectrum of virtual effectors that included human, robotic, and hand-like dot stimuli. We found a relationship between neural modulation and effector anthropomorphicity (i.e. human-likeness) that existed on an ensemble-wide and individual neuron level, suggesting that human motor cortex activity incrementally increases in response to the visually observed agents human-likeness. Both solicited and spontaneous feedback from the participant indicated a relationship between neural activity and subjective assessments of anthropomorphicity, revealing a powerful contribution of context on observation-induced activity in motor cortex. The activity of motor cortex remained similar during attempted hand movements while different effectors were being observed, suggesting that intuitive external device control via iBCIs may not be overtly affected by the anthropomorphicity of the effector. SIGNIFICANCE STATEMENTThe tendency for neurons in motor cortex to respond during movement observation has been proposed to underlie cognitive processes from motor learning and language development to empathy and theory of mind. Understanding how the motor cortex is engaged during observation of abstract and anthropomorphic agents informs our understanding of these processes and may guide development of neural prostheses which harness the activity of motor cortical neurons to restore lost neurologic function. Here we provide unique neuron-level evidence that human motor cortex activity is gradually modulated by how human-like an observed agent appears and moves. This finding advances our interpretation of "mirror" activity in the brain and could help guide the design of brain-controlled prostheses used by people with tetraplegia.

neuroscience↗

BRAND: A platform for closed-loop experiments with deep network models

Artificial neural networks (ANNs) are state-of-the-art tools for modeling and decoding neural activity, but deploying them in closed-loop experiments with tight timing constraints is challenging due to their limited support in existing real-time frameworks. Researchers need a platform that fully supports high-level languages for running ANNs (e.g., Python and Julia) while maintaining support for languages that are critical for low-latency data acquisition and processing (e.g., C and C++). To address these needs, we introduce the Backend for Realtime Asynchronous Neural Decoding (BRAND). BRAND comprises Linux processes, termed nodes, which communicate with each other in a graph via streams of data. Its asynchronous design allows for acquisition, control, and analysis to be executed in parallel on streams of data that may operate at different timescales. BRAND uses Redis to send data between nodes, which enables fast inter-process communication and supports 54 different programming languages. Thus, developers can easily deploy existing ANN models in BRAND with minimal implementation changes. In our tests, BRAND achieved <600 microsecond latency between processes when sending large quantities of data (1024 channels of 30 kHz neural data in 1-millisecond chunks). BRAND runs a brain-computer interface with a recurrent neural network (RNN) decoder with less than 8 milliseconds of latency from neural data input to decoder prediction. In a real-world demonstration of the system, participant T11 in the BrainGate2 clinical trial performed a standard cursor control task, in which 30 kHz signal processing, RNN decoding, task control, and graphics were all executed in BRAND. This system also supports real-time inference with complex latent variable models like Latent Factor Analysis via Dynamical Systems. By providing a framework that is fast, modular, and language-agnostic, BRAND lowers the barriers to integrating the latest tools in neuroscience and machine learning into closed-loop experiments.

neuroscience↗