Biology subjects

Sawtell, N. B.

Publications and source records attributed to Sawtell, N. B..

4 recordsLinked to original sources

bioRxiv2023

Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling, and cloud-native open-source tools

Contemporary pose estimation methods enable precise measurements of behavior via supervised deep learning with hand-labeled video frames. Although effective in many cases, the supervised approach requires extensive labeling and often produces outputs that are unreliable for downstream analyses. Here, we introduce "Lightning Pose," an efficient pose estimation package with three algorithmic contributions. First, in addition to training on a few labeled video frames, we use many unlabeled videos and penalize the network whenever its predictions violate motion continuity, multiple-view geometry, and posture plausibility (semi-supervised learning). Second, we introduce a network architecture that resolves occlusions by predicting pose on any given frame using surrounding unlabeled frames. Third, we refine the pose predictions post-hoc by combining ensembling and Kalman smoothing. Together, these components render pose trajectories more accurate and scientifically usable. We release a cloud application that allows users to label data, train networks, and predict new videos directly from the browser.

neuroscience↗

bioRxiv2022

A Biophysical Basis for Learning and Transmitting Sensory Predictions

Homeostatic (anti-Hebbian) forms of synaptic are effective at eliminating "prediction errors" that signal the differences between predicted and actual sensory input. However, such mechanisms appear to preclude the possibility of transmitting the resulting predictions to downstream circuits, severely limiting their utility. Using modeling and recordings from the electrosensory lobe of mormyrid fish, we reveal interactions between axonal and dendritic spikes that support both the learning and transmission of predictions. We find that sensory input modulates the rate of dendritic spikes by adjusting the amplitude of backpropagating axonal action potentials. Homeostatic plasticity counteracts these effects through changes in the underlying membrane potential, allowing the dendritic spike rate to be restored to equilibrium while simultaneously transmitting predictions through modulation of the axonal spike rate. These results reveal how two types of spikes dramatically enhance the computational power of single neurons in support of an ethologically relevant multi-layer computation.

neuroscience↗

bioRxiv2022

An Internal Model of Sensorimotor Context in Freely Swimming Electric Fish

Nervous systems are hypothesized to learn and store internal models that predict the sensory consequences of motor actions. However, little is known about the neural mechanisms for generating accurate predictions under real-world conditions in which the sensory consequences of action depend on environmental context. Using novel methods for underwater neural recording in freely swimming electric fish, we demonstrate that complex movement-related input to the active electrosensory system is effectively cancelled, despite being highly-dependent on the nearby environment. Computational modeling and closed-loop electrophysiological experiments indicate that the cerebellum-like circuitry of the electrosensory lobe generates context-specific predictions of self-generated input by combining motor signals with electrosensory feedback. These results provide mechanistic insight into sophisticated internal models supporting natural behavior in freely moving animals. One-Sentence SummaryUnderwater recordings in electric fish reveal neural mechanisms for predicting the sensory consequences of behavior under natural conditions in freely moving animals.

neuroscience↗

bioRxiv2021

Neural Readout of a Latency Code in the Active Electrosensory System

The latency of spikes relative to a stimulus conveys sensory information across modalities. However, in most cases it remains unclear whether and how such latency codes are utilized by postsynaptic neurons. In the active electrosensory system of mormyrid fish, a latency code for stimulus amplitude in electroreceptor afferent nerve fibers (EAs) is hypothesized to be read out by a central reference provided by motor corollary discharge (CD). Here we demonstrate that CD enhances sensory responses in postsynaptic granular cells of the electrosensory lobe, but is not required for reading out EA input. Instead, diverse latency and spike count tuning across the EA population gives rise to graded information about stimulus amplitude that can be read out by standard integration of converging excitatory synaptic inputs. Inhibitory control over the temporal window of integration renders two granular cell subclasses differentially sensitive to information derived from relative spike latency versus spike count.

neuroscience↗