bioRxiv Science⌕ Search

Biology subjects

Hurwitz, C.

Publications and source records attributed to Hurwitz, C..

7 recordsLinked to original sources

BAND: Behavior-Aligned Neural Dynamics is all you need to capture motor corrections

Movement is the result of complex, dynamic interaction between cortical and subcortical circuits. These dynamic interactions implement both feedforward motor control, arising from preparatory states, and feedback control, triggered by unexpected sensory events during movement. We show that the neural responses for feedback-driven control can be transient and small in variance, posing difficulties for unsupervised inference methods. We thus propose the Behavior-Aligned Neural Dynamics (BAND) model, which exploits semi-supervised learning to extract latent dynamics that predict both feedforward planned movement and unplanned feedback corrections. Our analysis suggests that motor corrections during movement 1) are encoded on the population level in small neural variability in primary motor (M1), but not dorsal premotor (PMd) cortex; 2) are transient; and 3) are driven by sensory feedback. Our work highlights the importance of targeted closed-loop aware methods to extract and study neural dynamics underlying complex behavioral phenomena.

neuroscience↗

In vivo cell-type and brain region classification via multimodal contrastive learning

AO_SCPLOWBSTRACTC_SCPLOWCurrent electrophysiological approaches can track the activity of many neurons, yet it is usually unknown which cell-types or brain areas are being recorded without further molecular or histological analysis. Developing accurate and scalable algorithms for identifying the cell-type and brain region of recorded neurons is thus crucial for improving our understanding of neural computation. In this work, we develop a multimodal contrastive learning approach for neural data that can be fine-tuned for different downstream tasks, including inference of cell-type and brain location. We utilize this approach to jointly embed the activity autocorrelations and extracellular waveforms of individual neurons. We demonstrate that our embedding approach, Neuronal Embeddings via MultimOdal contrastive learning (NEMO), paired with supervised fine-tuning, achieves state-of-the-art cell-type classification for two opto-tagged datasets and brain region classification for the public International Brain Laboratory Brain-wide Map dataset. Our method represents a promising step towards accurate cell-type and brain region classification from electrophysiological recordings. The project page and code are available at https://ibl-nemo.github.io/.

neuroscience↗

Exploiting correlations across trials and behavioral sessions to improve neural decoding

Traditional neural decoders model the relationship between neural activity and behavior within individual trials of a single experimental session, neglecting correlations across trials and sessions. However, animals exhibit similar neural activities when performing the same behavioral task, and their behaviors are influenced by past experiences from previous trials. To exploit these informative correlations in large datasets, we introduce two complementary models: a multi-session reduced-rank regression model that shares similar behaviorally-relevant statistical structure in neural activity across sessions to improve decoding, and a multi-session state-space model that shares similar behavioral statistical structure across trials and sessions. Applied across 433 sessions spanning 270 brain regions in the International Brain Laboratory public mouse Neuropixels dataset, our decoders demonstrate improved decoding accuracy for four distinct behaviors compared to traditional approaches. These results generalize across additional datasets, species, and behavioral tasks. Unlike existing deep learning approaches, our models are interpretable and efficient, uncovering low-dimensional representations that predict animal decisions, quantifying single-neuron contributions to decoding behaviors, and identifying different activation timescales of neural activity across the brain. Code: https://github.com/yzhang511/neural_decoding.

neuroscience↗

Bypassing spike sorting: Density-based decoding using spike localization from dense multielectrode probes

Neural decoding and its applications to brain computer interfaces (BCI) are essential for understanding the association between neural activity and behavior. A prerequisite for many decoding approaches is spike sorting, the assignment of action potentials (spikes) to individual neurons. Current spike sorting algorithms, however, can be inaccurate and do not properly model uncertainty of spike assignments, therefore discarding information that could potentially improve decoding performance. Recent advances in high-density probes (e.g., Neuropixels) and computational methods now allow for extracting a rich set of spike features from unsorted data; these features can in turn be used to directly decode behavioral correlates. To this end, we propose a spike sorting-free decoding method that directly models the distribution of extracted spike features using a mixture of Gaussians (MoG) encoding the uncertainty of spike assignments, without aiming to solve the spike clustering problem explicitly. We allow the mixing proportion of the MoG to change over time in response to the behavior and develop variational inference methods to fit the resulting model and to perform decoding. We benchmark our method with an extensive suite of recordings from different animals and probe geometries, demonstrating that our proposed decoder can consistently outperform current methods based on thresholding (i.e. multi-unit activity) and spike sorting. Open source code is available at https://github.com/yzhang511/density_decoding.

neuroscience↗

Ultra-high density electrodes improve detection, yield, and cell type specificity of brain recordings

To understand the neural basis of behavior, it is essential to sensitively and accurately measure neural activity at single neuron and single spike resolution. Extracellular electrophysiology delivers this, but it has biases in the neurons it detects and it imperfectly resolves their action potentials. To minimize these limitations, we developed a silicon probe with much smaller and denser recording sites than previous designs, called Neuropixels Ultra (NP Ultra). This device samples neuronal activity at ultra-high spatial density ([~]10 times higher than previous probes) with low noise levels, while trading off recording span. NP Ultra is effectively an implantable voltage-sensing camera that captures a planar image of a neurons electrical field. We use a spike sorting algorithm optimized for these probes to demonstrate that the yield of visually-responsive neurons in recordings from mouse visual cortex improves up to [~]3-fold. We show that NP Ultra can record from small neuronal structures including axons and dendrites. Recordings across multiple brain regions and four species revealed a subset of extracellular action potentials with unexpectedly small spatial spread and axon-like features. We share a large-scale dataset of these brain-wide recordings in mice as a resource for studies of neuronal biophysics. Finally, using ground-truth identification of three major inhibitory cortical cell types, we found that these cell types were discriminable with approximately 75% success, a significant improvement over lower-resolution recordings. NP Ultra improves spike sorting performance, detection of subcellular compartments, and cell type classification to enable more powerful dissection of neural circuit activity during behavior.

neuroscience↗

DARTsort: A modular drift tracking spike sorter for high-density multi-electrode probes

With the advent of high-density, multi-electrode probes, there has been a renewed interest in developing robust and scalable algorithms for spike sorting. Current spike sorting approaches, however, struggle to deal with noisy recordings and probe motion (drift). Here we introduce a modular and interpretable spike sorting pipeline, DARTsort (Drift Aware Registration and Tracking), that builds upon recent advances in denoising, spike localization, and drift estimation. DARTsort integrates a precise estimate of probe drift over time into a model of the spiking signal. This allows our method to be robust to drift across a variety of probe geometries. We show that our spike sorting algorithm outperforms a current state-of-the-art spike sorting algorithm, Kilosort 2.5, on simulated datasets with different drift types and noise levels. Open-source code can be found at https://github.com/cwindolf/dartsort.

neuroscience↗

Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling, and cloud-native open-source tools

Contemporary pose estimation methods enable precise measurements of behavior via supervised deep learning with hand-labeled video frames. Although effective in many cases, the supervised approach requires extensive labeling and often produces outputs that are unreliable for downstream analyses. Here, we introduce "Lightning Pose," an efficient pose estimation package with three algorithmic contributions. First, in addition to training on a few labeled video frames, we use many unlabeled videos and penalize the network whenever its predictions violate motion continuity, multiple-view geometry, and posture plausibility (semi-supervised learning). Second, we introduce a network architecture that resolves occlusions by predicting pose on any given frame using surrounding unlabeled frames. Third, we refine the pose predictions post-hoc by combining ensembling and Kalman smoothing. Together, these components render pose trajectories more accurate and scientifically usable. We release a cloud application that allows users to label data, train networks, and predict new videos directly from the browser.

neuroscience↗