bioRxiv Science⌕ Search

Biology subjects

Nikolaev, A. R.

Publications and source records attributed to Nikolaev, A. R..

5 recordsLinked to original sources

Sequential Sampling as a Computational Principle of Episodic Memory

Visual perception unfolds through sequential eye movements, yet computational models of episodic memory typically assume that event representations already exist. Here, we propose that sequential gaze sampling does not simply supply memory with visual information, but contributes to the construction and organisation of episodic representations. We introduce a computational model in which successive fixations are integrated into an evolving internal representation, subsequently stored in associative memory and later retrieved through partial reinstatement of the original sampling trajectory. Within to-be-remembered elements, successive samples support progressive individuation; between elements, more frequent transitions strengthen relational binding. As sampling proceeds, internal representations become progressively lower-dimensional while retaining information about where samples were taken and when they occurred in the sequence. Sampling history also remains embedded in the resulting representation: changing the order of otherwise identical samples alters both the representation itself and element-specific retrieval. At retrieval, reinstating more of the original sampling trajectory improves access to specific elements, while competition is strongest when memories share both semantic category and sampling history. Finally, an exploratory generative readout shows that regions sampled during encoding are reconstructed more faithfully than unsampled regions. Together, these findings suggest that sequential sampling provides a candidate computational process through which episodic representations are constructed, shaping their subsequent storage and retrieval.

neuroscience↗

Neural dynamics of relational memory retrieval across eye movements

Relational memory retrieval entails a dynamic interplay between eye movements and neural activity, yet the temporal coordination of these processes remains unclear. This study examines the relationship between theta and alpha EEG activity and sequential fixations during relational memory retrieval. Participants completed a two-alternative forced-choice associative memory task while their eye movements and EEG were recorded simultaneously. Results reveal a relational eye-movement effect: correctly remembered target elements were disproportionately fixated during later stages of the retrieval sequence. Time-frequency EEG analyses across the test trial show that successful retrieval was characterized by an early, transient increase in theta power and a sustained decrease in alpha power. Gaze-related analyses linked these effects to distinct retrieval processes. The theta effect emerged after the initial cue fixation and predicted retrieval success independently of whether subsequent saccades were directed to the target or distractor. In contrast, the alpha decrease predicted retrieval success only across continued target fixations. These findings connect the relational eye-movement effect to two distinct neural signatures: a nonspecific theta increase, reflecting recollection that may initiate pattern completion, and a target-selective alpha decrease, reflecting sustained reactivation of goal-relevant associations across fixations. Together, these results clarify the temporal dynamics of relational memory retrieval and underscore the role of sequential eye movements in memory-guided behavior.

neuroscience↗

Episodic memory formation in naturalistic viewing

The brain systems of episodic memory and oculomotor control are tightly linked, suggesting a crucial role of eye movements in memory. But little is known about the neural mechanisms of memory formation across eye movements in unrestricted viewing behavior. Here, we leverage simultaneous eye tracking and EEG recording to examine episodic memory formation in free viewing. Participants memorized multi-element events while their EEG and eye movements were concurrently recorded. Each event comprised elements from three categories (face, object, place), with two exemplars from each category, in different locations on the screen. A subsequent associative memory test assessed participants memory for the between-category associations that specified each event. We used a deconvolution approach to overcome the problem of overlapping EEG responses to sequential saccades in free viewing. Brain activity was time-locked to the fixation onsets, and we examined EEG power in the theta and alpha frequency bands, the putative oscillatory correlates of episodic encoding mechanisms. Three modulations of fixation-related EEG predicted high subsequent memory performance: 1) theta increase at fixations after between-category gaze transitions, 2) theta and alpha increase at fixations after within-element gaze transitions, 3) alpha decrease at fixations after between-exemplar gaze transitions. Thus, event encoding with unrestricted viewing behavior was characterized by three neural mechanisms, manifested in fixation-locked theta and alpha EEG activity that rapidly turned on and off during the unfolding eye movement sequences. These three distinct neural mechanisms may be the essential building blocks that subserve the buildup of coherent episodic memories during unrestricted viewing behavior.

neuroscience↗

Neural Correlates of Task-related Refixation Behaviour

Information uptake during scene viewing under free viewing conditions is crucially determined by the scanning plan. This plan is determined both by top-down and bottom-up factors. To capture top-down factors affecting saccade planning, we compared EEG between first fixations and refixations on items varying in task-relevance. First fixations and refixations impose different working memory costs because first fixations involve encoding of new items whereas refixations involve rehearsal of existing items in working memory. These memory requirements also differ with the task-relevance of the item being encoded. Together, these two factors of task-relevance and memory processes related to refixation behavior would affect saccade planning. In a visual task involving search and memorization of multiple targets, we compared saccade-related potentials (SRPs) between first fixations and refixations for task-relevant (target) and task-irrelevant (distractor) items. We assessed the interval preceding a saccade away from the fixation of interest. Studying this presaccadic interval revealed how mechanisms related to saccade preparation are affected by task-relevance and refixation behavior. We found higher SRP amplitudes for first fixations than refixations over the occipital region for task-relevant items only. Our findings indicate that saccade planning is modulated by both task-relevance of an item and working memory load.

neuroscience↗

Revising the scanning plan for continued visual exploration: the neurophysiology of refixation-related behavior

Eye tracking studies suggest that refixations, fixations to locations previously visited, serve to recover information lost or missed during earlier exploration of a visual scene. These studies have largely ignored the role of precursor fixations, previous fixations on locations the eyes return to later. We consider the possibility that preparations to return later are already made during precursor fixations. This would mark precursor fixations as a special category of fixations, i.e., distinct in neural activity from other fixation categories such as refixations and fixations to locations visited only once. To capture the neural signals associated with fixation categories, we analyzed EEG and eye movement recorded simultaneously in a free-viewing contour search task. We developed a methodological pipeline involving regression-based deconvolution modeling, allowing our analyses to account for overlapping EEG responses due to the saccade sequence and other oculomotor covariates. We found that precursor fixations were preceded by the largest saccades among the fixation categories. Independently of the effect of saccade length, EEG amplitude was enhanced in precursor fixations compared to the other fixation categories 200-400 ms after fixation onsets, most noticeably over the occipital areas. We concluded that precursor fixations play a pivotal role in visual perception, marking the continuous occurrence of transitions between exploratory and exploitative modes of eye movement in natural viewing behavior.

neuroscience↗