bioRxiv Science⌕ Search

Biology subjects

Bellet, J.

Publications and source records attributed to Bellet, J..

6 recordsLinked to original sources

From Coarse to Rich: Successive Waves of Visual Perception in Prefrontal Cortex

The ventrolateral prefrontal cortex (vlPFC) is well known for its involvement in high-level functions such as cognitive control and language. However, vlPFCs role in visual processing is less clear. Here, we investigated how neuronal ensembles in the vlPFC dynamically encode different types of visual information. Using chronic recording of spiking activity, we investigated vlPFCs representational geometry in a macaque monkey passively viewing a large set of naturalistic images, and compared this to representations in deep neural networks (DNNs). We found that the vlPFC processes visual information in two stages. First, an "early" response from 50 to 90 ms after stimulus onset encodes the low spatial frequency component of an image. It contains sufficient information to form a coarse estimate of the position and category of a salient object. Then, from 100 ms on, the representational geometry changes and contains much richer information. This late period contains non-categorical information typically present in conscious experiences such as the orientation of a face and natural scenes in the background. The late window also enables sub-category identification, which is boosted by the low spatial category prior. These results suggest that the vlPFC has a dual role in natural vision: first forming fast low-spatial-frequency-based priors shaping feed-forward visual processing, and subsequently maintaining a detailed and rich representation of a visual scene. SignificanceWhat information does the prefrontal cortex represent during natural vision, and how does this relate to conscious experience? Theories of consciousness differ sharply on whether prefrontal activity reflects detailed perceptual content or only high-level, task-related information. Using dense neural recordings during passive viewing of thousands of naturalistic images, we show that the ventrolateral prefrontal cortex processes visual information in two distinct stages: an early, coarse estimate of the visual scene is followed by a richer, high-dimensional representation that includes sub-category identity and other perceptual details. These findings reveal that prefrontal circuits encode more of the content of visual experience than previously assumed, even in the absence of a task.

neuroscience↗

Prefrontal neural ensembles encode an internal model of visual sequences and their violations

When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex encode visual sequences by factorizing them into separate codes for the specific pictures presented and for their abstract sequential structure. Ventrolateral prefrontal neurons were recorded while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously built up representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly updated following single exposure to a mismatch sequence, while orthogonal populations represent mismatches for sequences of different complexity. Finally, those representations generalized across sequences following the same structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences that reflect both content-specific and abstract information.

neuroscience↗

Severe distortion in the representation of foveal visual image locations in short term memory

The foveal visual image region provides the human visual system with the highest acuity. However, it is unclear whether such a high fidelity representational advantage is maintained when foveal image locations are committed to short term memory. Here we describe a paradoxically large distortion in foveal target location recall by humans. We briefly presented small, but high contrast, points of light at eccentricities ranging from 0.1 to 12 deg, while subjects maintained their line of sight on a stable target. After a brief memory period, the subjects indicated the remembered target locations via computer controlled cursors. The biggest localization errors, in terms of both directional deviations and amplitude percentage overshoots or undershoots, occurred for the most foveal targets, and such distortions were still present, albeit with qualitatively different patterns, when subjects shifted their gaze to indicate the remembered target locations. Foveal visual images are severely distorted in short term memory.

neuroscience↗

Using deep neural networks to detect complex spikes of cerebellar Purkinje Cells

One of the most powerful excitatory synapses in the entire brain is formed by cerebellar climbing fibers, originating from neurons in the inferior olive, that wrap around the proximal dendrites of cerebellar Purkinje cells. The activation of a single olivary neuron is capable of generating a large electrical event, called "complex spike", at the level of the postsynaptic Purkinje cell, comprising of a fast initial spike of large amplitude followed by a slow polyphasic tail of small amplitude spikelets. Several ideas discussing the role of the cerebellum in motor control are centered on these complex spike events. However, these events are extremely rare, only occurring 1-2 times per second. As a result, drawing conclusions about their functional role has been very challenging, as even few errors in their detection may change the result. Since standard spike sorting approaches cannot fully handle the polyphasic shape of complex spike waveforms, the only safe way to avoid omissions and false detections has been to rely on visual inspection of long traces of Purkinje cell recordings by experts. Here we present a supervised deep learning algorithm for rapidly and reliably detecting complex spikes as an alternative to tedious visual inspection. Our algorithm, utilizing both action potential and local field potential signals, not only detects complex spike events much faster than human experts, but it also excavates key features of complex spike morphology with a performance comparable to that of such experts. Significance statementClimbing fiber driven "complex spikes", fired at perplexingly low rates, are known to play a crucial role in cerebellum-based motor control. Careful interpretations of these spikes require researchers to manually detect them, since conventional online or offline spike sorting algorithms (optimized for analyzing the much more frequent "simple spikes") cannot be fully trusted. Here, we present a deep learning approach for identifying complex spikes, which is trained on local field and action potential recordings from cerebellar Purkinje cells. Our algorithm successfully identifies complex spikes, along with additional relevant neurophysiological features, with an accuracy level matching that of human experts, yet with very little time expenditure.

neuroscience↗

Memory-guided microsaccades

Microsaccades are overwhelmingly described as involuntary eye movements. Here we show in both human subjects and monkeys that individual microsaccades of any direction can easily be triggered: (1) "on demand", based on an arbitrary instruction, (2) without any special training, (3) without visual guidance by a stimulus, and (4) in a spatially and temporally accurate manner. Subjects voluntarily generated instructed "memory-guided" microsaccades readily, and similarly to how they made normal visually-guided ones. In two monkeys, we also observed midbrain superior colliculus neurons that exhibited movement-related activity bursts exclusively for memory-guided microsaccades, but not for similarly-sized visually-guided movements. Our results demonstrate behavioral and neural evidence for voluntary control over individual microsaccades, supporting recently discovered functional contributions of individual microsaccade generation to visual performance alterations and covert visual selection.

neuroscience↗

Human-level saccade detection performance using deep neural networks

Saccades are ballistic eye movements that rapidly shift gaze from one location of visual space to another. Detecting saccades in eye movement recordings is important not only for studying the neural mechanisms underlying sensory, motor, and cognitive processes, but also as a clinical and diagnostic tool. However, automatically detecting saccades can be difficult, particularly when such saccades are generated in coordination with other tracking eye movements, like smooth pursuits, or when the saccade amplitude is close to eye tracker noise levels, like with microsaccades. In such cases, labeling by human experts is required, but this is a tedious task prone to variability and error. We developed a convolutional neural network (CNN) to automatically detect saccades at human-level performance accuracy. Our algorithm surpasses state of the art according to common performance metrics, and will facilitate studies of neurophysiological processes underlying saccade generation and visual processing.

neuroscience↗