bioRxiv Science⌕ Search

Biology subjects

van Gaal, S.

Publications and source records attributed to van Gaal, S..

At least 19 recordsLinked to original sources

Change-point oddball elicits pupil-linked signatures of Bayesian belief updating

The auditory oddball protocol is widely used to study neural responses to unexpected events. In conventional designs, however, stimulus statistics are stationary: deviants do not indicate environmental change and therefore should not drive learning. Here, we introduce change-point oddball, a passive, no-report protocol in which the standard-oddball mapping reverses at unpredictable change points, requiring inference over latent environmental states. We measured pupil-linked arousal in three human cohorts. Pupil responses were larger for state-specific oddballs than standards, decayed across newly established standards after state changes, and scaled with model-derived change-point probability. A many-standards control experiment implicated a prediction-based rather than repetition-based mechanism. Finally, within participants, stronger pupil encoding of change-point probability during the passive task was associated with greater change-point-sensitive belief updating in a separate active navigation task. Thus, passive change-point oddball preserves core signatures of adaptive belief updating, enabling cross-species and clinical investigations.

neuroscience↗

Global nonequilibrium cortical dynamics tie mid-level pupil-linked arousal to optimal task performance in humans

Ongoing fluctuations in brain state, largely driven by neuromodulators of arousal, shape how sensory inputs are processed and decisions are made. Here, we combined pharmacological manipulations and pupillary proxies of arousal to examine how global cortical state dynamics relate to perceptual sensitivity. We applied the thermodynamics-inspired INSIDEOUT framework to electroencephalography (EEG) recordings from two visual discrimination tasks performed under placebo, atomoxetine (noradrenergic enhancer), and donepezil (cholinergic enhancer) challenges. INSIDEOUT quantifies the strength of functional hierarchies within the brain via the computation of temporal irreversibility in neural activity. Trial-wise global irreversibility increased linearly with pupil-indexed arousal and exhibited a nonlinear inverted-U relationship with perceptual sensitivity, while showing no differences across drug conditions. A nonlinear mediation analysis revealed that temporal irreversibility can account for a significant portion of the association between pupil-linked arousal and perceptual sensitivity. At lower arousal, increases in prestimulus irreversibility improved perceptual accuracy, whereas at higher arousal, pre- and poststimulus irreversibility had different effects. These results bridge intrinsic whole-brain dynamics with perceptual decision-making, demonstrating that neuromodulator-linked arousal tunes cortical states and, in turn, perceptual performance. More broadly, the results shed new light on how arousal may reconfigure neural global dynamics.

neuroscience↗

Effects of expectation, attention, and NMDA receptor blockade on feedforward and feedback processing

Perception is increasingly viewed as an inferential process wherein sensory inputs are integrated with prior expectations. We employed time-resolved decoding on electroencephalography (EEG) data (n = 30 male participants) to investigate how expectations modulate sensory processing across varying levels of stimulus complexity, and tested the effect of attention and NMDA receptor blockade. We designed a visual stimulus containing features of different complexity whose processing relies on distinct neural mechanisms: local contrast, collinearity, and the Kanizsa illusion, involving primarily feedforward, lateral, and feedback processes, respectively. EEG decoding revealed that expectations modulated lateral and feedback processing (better decoding for unexpected stimuli) but not feedforward processing. These expectation effects were confined to attended (task-relevant) features and were not observed for task-irrelevant features. The NMDA receptor antagonist memantine selectively enhanced decoding of the Kanizsa illusion, implicating NMDA-mediated feedback mechanisms in perceptual inference, but it did not modulate the effects of expectation or attention. These findings highlight the differential impact of expectations across different stages of sensory processing and reveal a distinct role of NMDA receptor-mediated feedback mechanisms. Significance statementPerception integrates sensory inputs with prior expectations. Using EEG decoding, we examined how expectations shape sensory processing at different levels of complexity and tested the effects of attention and NMDA receptor blockade. Our visual stimuli were designed to capture EEG markers of feedforward, lateral, and feedback mechanisms. Expectations influenced lateral and feedback processing (better decoding for unexpected stimuli) but not feedforward processing, and these effects were selective to task-relevant stimulus features. Memantine, an NMDA receptor antagonist, selectively improved decoding of the Kanizsa illusion, implicating NMDA-mediated feedback in perceptual inference, but it did not shape expectation or attention effects.

neuroscience↗

Baseline activity of V1 interneurons connects pupil-linked arousal to engaged behavioral state

AO_SCPLOWBSTRACTC_SCPLOWHumans and rodents alternate between discrete, persistent behavioral states during perceptual decision-making. For example, trials can be clustered into states of engaged, disengaged, and biased decision-making strategies. In mice, the probability of being in an engaged state exhibits an inverted-U relationship with baseline pupil-linked arousal, consistent with the Yerkes-Dodson Law. We replicated this relationship in mice (N=11; audio-visual change detection task) and showed that it generalizes to humans (N=69; auditory detection task). We then examined its neural basis, using simultaneous pupillometry and electrophysiological recordings in mouse V1. A nonlinear mediation model revealed that baseline activity of putative fast-spiking interneurons, but not putative pyramidal neurons, made a significant statistical contribution to the inverted-U shaped relationship between pupil-linked arousal and engaged-state probability. These findings are consistent with the idea that arousal may shape behavioral states by modulating baseline inhibitory activity within a primary sensory region.

neuroscience↗

Adaptive arousal regulation: Pharmacologically shifting the peak of the Yerkes-Dodson curve by catecholaminergic enhancement of arousal

Performance typically peaks at moderate arousal levels, consistent with the Yerkes-Dodson law, as confirmed by recent human and mouse pupillometry studies. Arousal states are influenced by neuromodulators like catecholamines (noradrenaline; NA and dopamine; DA) and acetylcholine (ACh). To explore their causal roles in this law, we pharmacologically enhanced arousal while measuring human decision-making and spontaneous arousal fluctuations via pupil size. The catecholaminergic agent atomoxetine (ATX) increased overall arousal and shifted the entire arousal-performance curve, suggesting a relative arousal mechanism where performance adapts to arousal fluctuations within arousal states. In contrast, the cholinergic agent donepezil (DNP) did not affect arousal or the curve. We modeled these findings in a neurobiologically plausible computational framework, showing how catecholaminergic modulation alters a disinhibitory neural circuit that encodes sensory evidence for decision-making. This work suggests that performance adapts flexibly to arousal fluctuations, ensuring optimal performance in each and every arousal state.

neuroscience↗

NMDA receptor antagonist memantine selectively affects recurrent processing during perceptual inference

Perceptual inference requires the integration of visual features through recurrent processing, the dynamic exchange of information between higher and lower level cortical regions. While animal research has demonstrated a crucial role of NMDA receptors in recurrent processing, establishing a causal link between NMDA receptors and recurrent processing in humans has remained challenging. Here, we report two pharmacological studies with randomized, double-blind, crossover designs in which we administered the NMDA antagonist memantine, while collecting human electroencephalography (EEG). We trained and tested EEG classifiers to reflect the processing of specific stimulus features with increasing levels of complexity, namely differences in stimulus contrast, collinearity between local line elements, and illusory surfaces of a Kanizsa triangle. In two experiments involving different participants and visual tasks, we found that memantine selectively improved decoding of the Kanizsa illusion, known to depend on recurrent processing, while leaving decoding of contrast and collinearity largely unaffected. Interestingly, the results from an attentional blink (experiment 1) and task-relevance manipulation (experiment 2) showed that memantine was only effective when the stimulus was attended and consciously accessed. These findings suggest that NMDA inhibition through memantine enhances recurrent processing, especially for attended objects, and thereby provide a crucial step toward bridging animal and human research, shedding light on the neural mechanisms underpinning perceptual inference and conscious perception. This research was supported by a grant from the H2020 European Research Council (ERC STG 715605, SVG).

neuroscience↗

Task-irrelevant stimuli reliably boost phasic pupil-linked arousal but do not affect decision formation

The arousal systems of the brainstem, specifically the locus coeruleus-noradrenaline system, respond "phasically" during decisions. These central arousal transients are accompanied by dilations of the pupil. Mechanistic attempts to understand the impact of phasic arousal on cognition would benefit from the ability to experimentally manipulate arousal in a temporally precise manner. Here, we evaluated a non-invasive candidate approach for such a manipulation in humans: presenting task-irrelevant auditory stimuli at different latencies during the execution of a challenging task. Task-irrelevant auditory stimuli drive responses of brainstem nuclei involved in the control of pupil size. But it is unknown whether such sound-evoked responses mimic the central arousal transients evoked during cognitive computations. A large body of evidence has implicated central arousal transients in a bias reduction during challenging perceptual decisions. We thus used challenging visual decisions as a testbed, combining them with task-irrelevant sounds of varying onset latency or duration. Across three experiments, the sounds consistently elicited well-controlled pupil responses that superimposed onto task-evoked responses. While we replicated a negative correlation between task-evoked pupil responses and bias established in previous work, the task-irrelevant sounds had no behavioral effect. This dissociation suggests that cognitive task engagement and task-irrelevant sounds may recruit distinct neural systems contributing to the control of pupil size.

neuroscience↗

Criterion placement threatens the construct validity of neural measures of consciousness

How consciousness arises from brain activity has been a topic of intense scientific research for decades. But how does one identify the neural basis of something that is intrinsically personal and subjective? A hallmark approach has been to ask observers to judge stimuli as seen (conscious) and unseen (unconscious) and use post hoc sorting of neural measurements based these judgments. Unfortunately, cognitive and response biases are known to strongly affect how observers place their criterion for judging stimuli as seen vs. unseen, thereby confounding neural measures of consciousness. Surprisingly however, the effect of conservative and liberal criterion placement on neural measures of unconscious and conscious processing has never been explicitly investigated. Here we use simulations and electrophysiological brain measurements to show that conservative criterion placement has an unintuitive consequence: rather than selectively providing a cautious estimate of conscious processing, it inflates effect sizes in neural measures of both conscious and unconscious processing, while liberal criterion placement does the reverse. After showing this in simulation, we performed decoding analyses on two electroencephalography studies that employ common subjective indicators of conscious awareness, in which we experimentally manipulated the response criterion. The results confirm that the predicted confounding effects of criterion placement on neural measures of unconscious and conscious processing occur in empirical data, while further showing that the most widely used subjective scale, the Perceptual Awareness Scale (PAS), does not guard against criterion confounds. Follow-up simulations explicate how the experimental context determines whether the relative confounding effect of criterion placement is larger in neural measures of either conscious or unconscious processing. We conclude that criterion placement threatens the construct validity of neural measures of conscious and unconscious processing.

neuroscience↗

Isolating feedforward, lateral, and feedback mechanisms underlying perceptual and attentional impairments of conscious access

This study investigates failures in conscious access resulting from either weak sensory input (perceptual impairments) or unattended input (attentional impairments). Participants viewed a Kanizsa stimulus with or without an illusory triangle within a rapid serial visual presentation of distractor stimuli. We designed a novel Kanizsa stimulus that contained additional ancillary features of different complexity (local contrast and collinearity) that were independently manipulated. Perceptual performance on the Kanizsa stimulus (presence vs. absence of an illusion) was equated between the perceptual (masking) and attentional (attentional blink) manipulation to circumvent common confounds related to conditional differences in task performance. We trained and tested classifiers on electroencephalogram (EEG) data to reflect the processing of specific stimulus features, with increasing levels of complexity. We show that late stages of processing ([~]200-250 ms), reflecting the integration of complex stimulus features (collinearity, illusory triangle), were impaired by masking but spared by the attentional blink. In contrast, decoding of local contrast (the spatial arrangement of stimulus features) was observed early in time ([~]80 ms) and was left largely unaffected by either manipulation. These results replicate previous work showing that feedforward processing is largely preserved under both perceptual and attentional impairments. Crucially however, under matched levels of performance, only attentional impairments left the processing of more complex visual features relatively intact, likely related to spared lateral and local feedback processes during inattention. These findings reveal distinct neural mechanisms associated with perceptual and attentional impairments and thus contribute to a comprehensive understanding of distinct neural stages leading to conscious access.

neuroscience↗

A disinhibitory circuit mechanism explains a general principle of peak performance during mid-level arousal

Perceptual decision-making is highly dependent on the momentary arousal state of the brain, which fluctuates over time on a scale of hours, minutes, and even seconds. The textbook relationship between momentary arousal and task performance is captured by an inverted U-shape, as put forward in the Yerkes-Dodson law (Yerkes and Dodson, 1908). This law suggests optimal performance at moderate levels of arousal, and impaired performance at low or high arousal levels. However, despite its popularity, the evidence for this relationship in humans is mixed at best. Here, we use pupil-indexed arousal and performance data from various perceptual decision-making tasks to provide converging evidence for the inverted U-shaped relationship between spontaneous arousal fluctuations and performance across different decision types (discrimination, detection) and sensory modalities (visual, auditory). To further understand this relationship, we built a neurobiologically plausible mechanistic model and show that it is possible to reproduce our findings by incorporating two types of interneurons that are both modulated by an arousal signal. The model architecture produces two dynamical regimes under the influence of arousal: one regime in which performance increases with arousal, and another regime in which performance decreases with arousal, together forming an inverted U-shaped arousal-performance relationship. We conclude that the inverted U-shaped arousal-performance relationship is a general and robust property of sensory processing. It might be brought about by the influence of arousal on two types of interneurons that together act as a disinhibitory pathway for the neural populations that encode the available sensory evidence used for the decision. Significance statementWhen people are repeatedly performing the exact same task, their performance fluctuates over time. One of the causes of this behavioral variability is spontaneous fluctuations in arousal. According to the Yerkes-Dodson law, task performance is optimal at moderate levels of species arousal, with impaired performance at very low or high arousal levels. However, until now, the evidence supporting this law as a general mechanism in human decision-making is mixed, and a neural mechanism that may explain the inverted U-shaped arousal-performance relationship is lacking. We show that the Yerkes-Dodson law is a general law that holds for human observers across decision-making tasks and settings. Furthermore, we present a simple and neurobiologically plausible mechanistic model that can explain its existence.

neuroscience↗

The neural and computational architecture of feedback dynamics in mouse cortex during stimulus report

Conscious reportability of visual input is associated with a bimodal neural response in primary visual cortex (V1): an early-latency response coupled to stimulus features and a late-latency response coupled to stimulus report or detection. This late wave of activity, central to major theories of consciousness, is thought to be driven by prefrontal cortex (PFC), responsible for "igniting" it. Here we analyzed two electrophysiological studies in mice performing different stimulus detection tasks, and characterize neural activity profiles in three key cortical regions: V1, posterior parietal cortex (PPC) and PFC. We then developed a minimal network model, constrained by known connectivity between these regions, reproducing the spatio-temporal propagation of visual-and report-related activity. Remarkably, while PFC was indeed necessary to generate report-related activity in V1, this occurred only through the mediation of PPC. PPC, and not PFC, had the final veto in enabling the report-related late wave of V1 activity.

neuroscience↗

The perceptual nature of illusory object recognition

We occasionally misinterpret ambiguous sensory input or report a stimulus when none is presented. It is unknown whether such errors have a sensory origin and reflect true perceptual illusions, or whether they have a more cognitive origin (e.g., are due to guessing), or both. When participants performed an error-prone and challenging face/house discrimination task, multivariate EEG analyses revealed that during decision errors (mistaking a face for a house), sensory stages of visual information processing initially represent the presented stimulus category. Crucially however, when participants were confident in their erroneous decision, so when the illusion was strongest, this neural representation flipped later in time and reflected the incorrectly reported percept. This flip in neural pattern was absent for decisions that were made with low confidence. This work demonstrates that decision confidence arbitrates between perceptual decision errors, which reflect true illusions of perception, and cognitive decision errors, which do not.

neuroscience↗

Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision making

Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response, further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making.

neuroscience↗

Position representations of moving objects align with real-time position in the early visual response

AO_SCPLOWBSTRACTC_SCPLOWWhen localising a moving object, the brain receives outdated sensory information about its position, due to the time required for neural transmission and processing. The brain may overcome these fundamental delays through predictively encoding the position of moving objects using information from their past trajectories. In the present study, we evaluated this proposition using multivariate analysis of high temporal resolution electroencephalographic data. We tracked neural position representations of moving objects at different stages of visual processing, relative to the real-time position of the object. During early stimulus-evoked activity, position representations of moving objects were activated substantially earlier than the equivalent activity evoked by unpredictable flashes, aligning the earliest representations of moving stimuli with their real-time positions. These findings indicate that the predictability of straight trajectories enables full compensation for the neural delays accumulated early in stimulus processing, but that delays still accumulate across later stages of cortical processing.

neuroscience↗

Directed information sharing in the brain distinguishes perception from its consequences during perceptual bistability

In the search for the neural basis of conscious experience, perception and the cognitive processes associated with reporting perception are typically confounded as neural activity is recorded while participants explicitly report what they experience. Here we present a novel way to disentangle perception from report using eye-movement analysis techniques based on convolutional neural networks and neurodynamical analyses based on information theory. We use a bistable visual stimulus that instantiates two well-known properties of conscious perception: integration and differentiation. At any given moment, observers either perceive the stimulus as one integrated unitary object or as two differentiated objects that are clearly distinct from each other. Using electroen-cephalography, we show that measures of integration and differentiation based on information theory closely follow participants perceptual experience of those contents when switches were reported. We observed increased information integration between anterior to posterior electrodes (front to back) prior to a switch to the integrated percept, and higher information differentiation of anterior signals leading up to reporting the differentiated percept. Crucially, information integration was closely linked to perception and even observed in a no-report condition when perceptual transitions were inferred from eye movements alone. In contrast, the link between neural differentiation and perception was observed solely in the active report condition. Our results, therefore, suggest that perception and the processes associated with report require distinct amounts of anterior-posterior network communication and anterior information differentiation. While front-to-back directed information is associated with changes in the content of perception when viewing bistable visual stimuli, regardless of report, frontal information differentiation was absent in the no-report condition and therefore is not directly linked to perception per se.

neuroscience↗

Processing of subjectively and objectively invisible stimuli in human visual cortex

The study of unconscious processing requires a measure of conscious awareness. Awareness measures can be either subjective (based on participants report) or objective (based on perceptual performance). The preferred awareness measure depends on the theoretical position about consciousness, and may influence conclusions about the extent of unconscious processing and about the neural correlates of consciousness. We obtained fMRI measurements from 43 subjects while they viewed masked faces and houses that were either subjectively or objectively invisible. We show that neural representations of objectively invisible faces and houses are limited to visual (shape-related) object properties, while subjectively invisible stimuli are processed up to more abstract, categorical levels of representation. These results demonstrate that the hypothesized extent of unconscious information processing is determined by the measurement approach. Furthermore, our data show that subjective and objective approaches are associated with different neural correlates of consciousness and thus have implications for neural theories of consciousness.

neuroscience↗

On the necessity of recurrent processing during object recognition: it depends on the need for scene segmentation

While feed-forward activity may suffice for recognizing objects in isolation, additional visual operations that aid object recognition might be needed for real-world scenes. One such additional operation is figure-ground segmentation; extracting the relevant features and locations of the target object while ignoring irrelevant features. In this study of 60 participants, we show objects on backgrounds of increasing complexity to investigate whether recurrent computations are increasingly important for segmenting objects from more complex backgrounds. Three lines of evidence show that recurrent processing is critical for recognition of objects embedded in complex scenes. First, behavioral results indicated a greater reduction in performance after masking objects presented on more complex backgrounds; with the degree of impairment increasing with increasing background complexity. Second, electroencephalography (EEG) measurements showed clear differences in the evoked response potentials (ERPs) between conditions around 200ms - a time point beyond feed-forward activity and object decoding based on the EEG signal indicated later decoding onsets for objects embedded in more complex backgrounds. Third, Deep Convolutional Neural Network performance confirmed this interpretation; feed-forward and less deep networks showed a higher degree of impairment in recognition for objects in complex backgrounds compared to recurrent and deeper networks. Together, these results support the notion that recurrent computations drive figure-ground segmentation of objects in complex scenes.

neuroscience↗

Intact sensory processing but hampered conflict detection when stimulus input is task-irrelevant

Conflict detection in sensory input is central to adaptive human behavior. Perhaps unsurprisingly, past research has shown that conflict may even be detected in absence of conflict awareness, suggesting that conflict detection is an automatic process that does not require attention. To test the possibility of conflict processing in the absence of attention, we manipulated task relevance and response overlap of potentially conflicting stimulus features across six behavioral tasks. Multivariate analyses on human electroencephalographic data revealed neural signatures of conflict only when at least one feature of a conflicting stimulus was attended, regardless of whether that feature was part of the conflict, or overlaps with the response. In contrast, neural signatures of basic sensory processes were present even when a stimulus was completely unattended. These data reveal an attentional bottleneck at the level of objects, suggesting that object-based attention is a prerequisite for cognitive control operations involved in conflict detection.

neuroscience↗