bioRxiv ScienceSearch

Biology subjects

Samuel J Gershman

Publications and source records attributed to Samuel J Gershman.

2 recordsLinked to original sources

Behavioral tagging and the penumbra of learning

In noisy, dynamic environments, organisms must distinguish genuine change (e.g., the movement of prey) from noise (e.g., the rustling of leaves). Expectations should be updated only when the organism believes genuine change has occurred. Although individual variables can be highly unreliable, organisms can take advantage of the fact that changes tend to be correlated (e.g., movement of prey will tend to produce changes in both visual and olfactory modalities). Thus, observing a change in one variable provides information about the rate of change for other variables. We call this the penumbra of learning. At the neural level, the penumbra of learning may offer an explanation for why strong plasticity in one synapse can rescue weak plasticity at another (synaptic tagging and capture). At the behavioral level, it has been observed that weak learning of one task can be rescued by novelty exposure before or after the learning task. Here, using a simple number prediction task, we provide direct behavioral support for the penumbra of learning in humans, and show that it can be accounted for by a normative computational theory of learning.

Animal Behavior and Cognition

The Computational Nature of Memory Modification

Retrieving a memory can modify its influence on subsequent behavior. Whether this phenomenon arises from modification of the contents of the memory trace or its accessibility is a matter of considerable debate. We develop a computational theory that incorporates both mechanisms. Modification of the contents of the memory trace occurs through classical associative learning, but which memory trace is accessed (and thus made eligible for modification) depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience into statistically distinct clusters (latent causes). New memories are formed when the structure learning mechanism infers that a new latent cause underlies current sensory observations. By the same token, old memories are modified when old and new sensory observations are inferred to have been generated by the same latent cause. We derive this framework from probabilistic principles, and present a computational implementation. Simulations demonstrate that our model can reproduce the major experimental findings from studies of memory modification in the Pavlovian conditioning literature, including dependence on the strength and age of memories, the interval between memory retrieval and extinction, and prediction errors following retrieval.

Animal Behavior and Cognition