Asymmetrical adaptations to increases and decreases in environmental volatility

Abstract

Humans adapt their learning strategies to changing environments by estimating the volatility of the reinforcement conditions. Here, we examine how volatility affects learning and the underlying functional brain organizations using a probabilistic reward reversal learning task. We found that the order of conditions was critically important; participants adjusted learning rate going from volatile to stable, but not from stable to volatile, environments. Subjective volatility of the environment was encoded in the striatal reward system and its dynamic connections with the prefrontal control system. Flexibility, which captures the dynamic changes of network modularity in the brain, was higher in the environmental transition from volatile to stable than from stable to volatile. These findings suggest that behavioral adaptations and dynamic brain organizations in transitions between stable and volatile environments are asymmetric, providing critical insights into the way that people learn under uncertainty.