bioRxiv Science⌕ Search

bioRxiv · 10.1101/2024.10.23.619903

Touchscreen response precision is sensitive to the explore/exploit tradeoff

Abstract

The explore/exploit tradeoff is a fundamental property of choice selection during reward-guided decision making. In perceptual decision making, higher certainty decisions are more motorically precise, even when the decision does not require motor accuracy. However, while we can parametrically control uncertainty in perceptual tasks, we do not know what variables - if any - shape motor precision and reflect subjective certainty during reward-guided decision making. Touchscreens are increasingly used across species to measure choice, but provide no tactile feedback on whether an action is precise or not, and therefore provide a valuable opportunity to determine whether actions differ in precision due to explore/exploit state, reward, or individual variables. We find all three of these factors exert independent drives towards increased precision. During exploit states, successive touches to the same choice are closer together than those made in an explore state, consistent with exploit states reflecting higher certainty and/or motor stereotypy in responding. However, exploit decisions might be expected to be rewarded more frequently than explore decisions. We find that exploit choice precision is increased independently of a separate increase in precision due to immediate past reward, suggesting multiple mechanisms regulating choice precision. Finally, we see evidence that male mice in general are less precise in their interactions with the touchscreen than females, even when exploiting a choice. These results suggest that as exploit behavior emerges in reward-guided decision making, individuals become more motorically precise reflecting increased certainty, even when decision choice does not require additional motor accuracy, but this is influenced by individual differences and prior reward. These data uncover the hidden potential for touchscreen tasks in any species to uncover the latent neural states that unite cognition and movement.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mueller, D., Giglio, E., Chen, C. S., Holm, A., Ebitz, R. B., Grissom, N. M.. 2024-10-23. Touchscreen response precision is sensitive to the explore/exploit tradeoff. https://doi.org/10.1101/2024.10.23.619903

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

roostR: An R package to examine diel activity patterns from Motus radio telemetry data

1. Monitoring the diel activity patterns of free-living animals is a methodological challenge. Signal strength fluctuations from Very High Frequency (VHF) radio transmitters deployed within the Motus Wildlife Tracking System can be used as a proxy for activity. However, analytical tools to extract behavioral metrics that quantify activity patterns from these data are needed. 2. We developed roostR, an open-source R package that converts Motus detection data into quantitative behavioral metrics, including roost initiation and departure, roost duration, observation time, and restlessness. The package uses a sequential pipeline built around signal volatility and rolling medians to detect transitions between active and inactive states. Default parameter values were tuned using data from 55 dark-eyed juncos (Junco hyemalis) overwintering in southeastern Ohio. 3. We provide an example from a dark-eyed junco over a 58-day period. roostR estimated roost onset on 48 nights and departure on 56 mornings, with higher rolling median signal differences during the day than at night, consistent with a diurnal animal, and variable restlessness periods each night. We also used the package to estimate roost behavior of an American tree sparrow (Spizelloides arborea) over 43-nights. 4. roostR enables researchers to extract individual activity data from Motus datasets. Because all thresholds are user-adjustable, the pipeline is adaptable across species, tag specifications, and ecological contexts, enabling researchers to test hypotheses about how environmental factors influence diel activity patterns.

animal behavior and cognition↗

Characterizing rhythmic wheel-turning behavioral patterns in cockroaches Rhyparobia maderae using machine learning

Organisms must adapt to environmental changes occurring across multiple time scales, with endogenous multiscale clocks coordinating physiology and behavior with recurring environmental rhythms, including the dominant 24-hour cycle and faster ultradian rhythms. The Madeira cockroach (Rhyparobia maderae) provides a suitable model for investigating such multiscale temporal organization. Here, locomotor activity was recorded in running-wheel experiments under constant darkness. While the endogenous circadian clock produces a clearly visible 24-hour rhythm, it remains unknown whether locomotor behavior also exhibits temporal patterns at additional time scales. These temporal patterns cannot be found by classical frequency analysis, as they are veiled by higher harmonics of the circadian rhythm which are in the same frequency range. Unsupervised machine learning methods such as K-Means clustering, self-organizing maps and Gaussian mixture are used in search for fast ultradian rhythms possibly linked to circadian cycles in locomotor activity. Prior to applying these methods, data metrics are defined which characterize bouts of activity (called activity impulses) compared to periods of reduced activity. A stochastic pattern was found in these activity metrics which characterizes the time distance between activity impulses. Across all approaches, a consistent ultradian rhythm of approximately one hour was identified in the timing of the activity maxima. This rhythm was mainly detected during the subjective night, suggesting circadian control, and appears to consist of two components with periods of approximately 40 minutes and 1.5 hours. The method proposed in this paper is applied to two cockroach groups with different levels of activity, and is generalizable to diverse datasets occurring in the form of a time series with a dominant rhythm.

animal behavior and cognition↗

Social inequity aversion and fairness preference in polar bears

Decision-making is key to survival, with choices and behaviour typically shaped by evolutionary pressures to enhance fitness and minimize loss. Inequity aversion, the tendency to respond negatively to unequal reward distributions, is therefore unexpected, as acts of fairness may be costly to the individual in the short term. In social, cooperative species, however, fairness may enhance long-term benefits through stable social interactions. Inequity aversion is believed to promote cooperative social structures and has only been demonstrated in certain social species. Yet, solitary species have not been tested, and whether this behaviour depends on social cooperative structures is unknown. Examining solitary species could clarify whether inequity aversion reflects an adaptation to cooperation or a general cognitive capacity linked to social comparison and reward evaluation. We studied inequity aversion in polar bears (Ursus maritimus), a largely solitary species, using three complementary, non-invasive cognition tests on seven bears from two zoos in the Netherlands. (1) An impunity experiment assessing effort-based inequity, in which bears performed a standardized action to obtain food rewards. (2) A choice-based experiment testing active selection between equal and unequal reward distributions. (3) A no-task control experiment assessing responses to unequal reward distribution without effort. Under effort-based inequity, bears reduced task performance and increased task latency when a partner received a superior reward. Unequal reward distributions did not affect reward acceptance independent of effort. In the choice-based paradigm, bears preferentially selected equal reward distributions with a partner present. Although generalizability to wild populations is limited, these findings demonstrate behavioural aversion of social inequity in a non-cooperative species. Inequality aversion may therefore not be restricted to social, cooperative animals but instead reflect a broadly distributed cognitive mechanism that emerges under relevant social conditions. These findings challenge current theories and advance our understanding of the cognitive foundations of fairness-related behaviour in animals.

animal behavior and cognition↗