bioRxiv Science⌕ Search

bioRxiv · 10.1101/081984

Modelling avoidance in pathologically anxious humans using reinforcement-learning

Abstract

Serious and debilitating symptoms of anxiety are the most common mental health problem worldwide, accounting for around 5% of all adult years lived with disability in the developed world. Avoidance behaviour -avoiding social situations for fear of embarrassment, for instance-is a core feature of such anxiety. However, as for many other psychiatric symptoms, the biological mechanisms underlying avoidance remain unclear. Reinforcement-learning models provide formal and testable characterizations of the mechanisms of decision-making; here, we examine avoidance in these terms. One hundred and one healthy and pathologically anxious individuals completed an approach-avoidance go/no-go task under stress induced by threat of unpredictable shock. We show an increased reliance in the anxious group on a parameter of our reinforcement-learning model that characterizes a prepotent (Pavlovian) bias to withhold responding in the face of negative outcomes. This was particularly the case when the anxious individuals were under stress. This formal description of avoidance within the reinforcement-learning framework provides a new means of linking clinical symptoms with biophysically plausible models of neural circuitry and, as such, takes us closer to a mechanistic understanding of pathological anxiety.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mkrtchian, A., Aylward, J., Dayan, P., Roiser, J. P., Robinson, O. J.. 2016-10-20. Modelling avoidance in pathologically anxious humans using reinforcement-learning. https://doi.org/10.1101/081984

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

The Effects of Environmental Enrichment on the Behavior of Laboratory Zebrafish (Danio rerio).

Enclosures for laboratory animals are often simple for economic and practical reasons. Enrichment items, such as plants, toys, and refuges, have been shown to improve measures of welfare in commonly used species such as mice and dogs. The numbers of laboratory zebrafish have been increasing in recent years, and most are housed in systems devoid of enrichment. The aim of this study is to assess the impact of environmental enrichment on adult laboratory zebrafish behavior. Experimental fish were raised in the presence of three different enrichment regimes: plastic plants, toys, and photos of gravel. These were compared to a control group raised under standard housing conditions. Once the fish reached sexual maturity, we measured aggression, reproduction, and growth. We found that each enrichment treatment led to significant reductions in aggression in a mirror test compared to control. Reproduction was largely unaffected by the three enrichment treatments. However, we found egg production was decreased following the gravel treatment, and egg survival was increased following the plant treatment. There were no significant impacts of enrichment on measures of growth. In a parallel experiment, breeding fish were exposed to plastic plant enrichment during overnight breeding. Surprisingly, there was no significant impact on egg production or egg survival.

animal behavior and cognition↗

Development of the Highly Sensitive Horse questionnaire to assess horses' sensory processing sensitivity

It is well established that individuals vary in how they respond to situations, but might they also perceive their environment differently? Sensory Processing Sensitivity (SPS) is a multidimensional trait describing individual variation in the perception and response to sensory, emotional, and social stimuli. While extensively studied in humans, its presence in animals remains underexplored. We investigated whether horses might exhibit a comparable trait and developed the Highly Sensitive Horse questionnaire to assess equine SPS. A 104-item questionnaire was developed and refined using data from an online survey of 121 horses. The remaining 45 items were evaluated in an independent survey of 561 horses. Exploratory and confirmatory factor analyses identified a robust two-factor, 12-item structure reflecting dimensions similar to the human SPS dimensions of: Overstimulation, describing a tendency to become overwhelmed by intense or prolonged stimuli, and Sensitivity to subtleties, describing heightened perception of subtle environmental changes. The scale showed high internal consistency, excellent intra-rater and moderate inter-rater reliability. Although eSPS was associated with established behavioural traits, including fearfulness, it also explained unique behavioural variation beyond these traits. These findings suggest that horses differ in how they perceive their environment, providing a foundation to better understand equine behaviour, and opening new avenues for comparative sensory-processing research.

animal behavior and cognition↗

Social foragers rely more on dynamic cues than prior beliefs in unpredictable natural environments

Foraging is a prime example of adaptive decision-making in uncertain and changing environments. Foragers need to continuously integrate their direct experiences and observations of what others are doing with what they already know about the distribution of prey. Yet little is known about the importance of prior knowledge relative to dynamically sampled information in social foraging settings. Here, we investigated the role of prior beliefs in five large-scale ice-fishing competitions involving 49--53 highly experienced ice-fishers in 251 foraging trips. To quantify their prior spatial beliefs, participants marked areas they believed to have high resource abundance on topographic maps containing isoclines (i.e., depth curves) before each competition. GPS devices and headcams tracked behavioural states and foraging success. We found that prior beliefs about the fish distribution are to a large extent driven by lake topography and therefore converge across individuals. However, these prior beliefs were not systematically linked to foraging success. While prior beliefs predicted spot choices, especially in the beginning of competitions, they were heavily outweighed by dynamic personal and social information sources. Exploring how the use of prior beliefs differed between foraging trips, we found that high reliance on prior beliefs was associated with reduced avoidance of unsuccessful locations which resulted in limited spatial exploration. We conclude that dynamic information sampling and accumulation are key processes in social foraging decisions, with prior spatial beliefs playing only a minor role in natural environments where resources are hard to predict in advance.

animal behavior and cognition↗