bioRxiv Science⌕ Search

Biology subjects

Saddler, M. R.

Publications and source records attributed to Saddler, M. R..

4 recordsLinked to original sources

Perceptual sensitivity is explained by optimization for ecological tasks

When asked to discriminate between two stimuli that differ along some dimension, such as intensity, frequency, or orientation, humans exhibit a smallest stimulus difference, or threshold, below which discrimination becomes impossible. These limits on perceptual sensitivity have traditionally been explained by internal noise. Contemporary theories instead link perceptual sensitivity to efficient coding of the natural environment but have not been comprehensively tested. Here, we measured the psychoacoustic sensitivity of a computational model optimized for everyday sound localization and recognition tasks. We used linear classifiers operating on the model's learned representations to estimate 1632 thresholds spanning the perceptual dimensions of sound. These model-derived thresholds closely matched thresholds measured behaviorally in humans on the same test battery. The results show that many classical psychophysical phenomena emerge from representations optimized for natural behavior and suggest that discrimination thresholds are determined by linear separability in these optimized representations, rather than intrinsic neural noise.

neuroscience↗

A deep learning framework for understanding cochlear implants

Sensory prostheses replace dysfunctional sensory organs with electrical stimulation but currently fail to restore normal perception. Outcomes may be limited by stimulation strategies, neural degeneration, or suboptimal decoding by the brain. We propose a deep learning framework to evaluate these issues by estimating best-case outcomes with task-optimized decoders operating on simulated prosthetic input. We applied the framework to cochlear implants - the standard treatment for deafness - by training artificial neural networks to recognize and localize sounds using simulated auditory nerve input. The resulting models exhibited speech recognition and sound localization that was worse than that of normal hearing listeners, and on par with the best human cochlear implant users, with similar results across the three main stimulation strategies in current use. Speech recognition depended heavily on the extent of decoder optimization for implant input, with lesser influence from other factors. The results identify performance limits of current devices and demonstrate a model-guided approach for understanding the limitations and potential of sensory prostheses.

neuroscience↗

Models optimized for real-world tasks reveal the necessity of precise temporal coding in hearing

Neurons encode information in the timing of their spikes in addition to their firing rates. Spike timing is particularly precise in the auditory nerve, where action potentials phase lock to sound with sub-millisecond precision, but its behavioral relevance remains uncertain. We optimized machine learning models to perform real-world hearing tasks with simulated cochlear input, assessing the precision of auditory nerve spike timing needed to reproduce human behavior. Models with high-fidelity phase locking exhibited more human-like sound localization and speech perception than models without, consistent with an essential role in human hearing. However, the temporal precision needed to reproduce human-like behavior varied across tasks, as did the precision that benefited real-world task performance. These effects suggest that perceptual domains incorporate phase locking to different extents depending on the demands of real-world hearing. The results illustrate how optimizing models for realistic tasks can clarify the role of candidate neural codes in perception.

neuroscience↗

Deep neural network models reveal interplay of peripheral coding and stimulus statistics in pitch perception

Perception is thought to be shaped by the environments for which organisms are optimized. These influences are difficult to test in biological organisms but may be revealed by machine perceptual systems optimized under different conditions. We investigated environmental and physiological influences on pitch perception, whose properties are commonly linked to peripheral neural coding limits. We first trained artificial neural networks to estimate fundamental frequency from biologically faithful cochlear representations of natural sounds. The best-performing networks replicated many characteristics of human pitch judgments. To probe the origins of these characteristics, we then optimized networks given altered cochleae or sound statistics. Human-like behavior emerged only when cochleae had high temporal fidelity and when models were optimized for naturalistic sounds. The results suggest pitch perception is critically shaped by the constraints of natural environments in addition to those of the cochlea, illustrating the use of artificial neural networks to reveal underpinnings of behavior.

animal behavior and cognition↗