bioRxiv Science⌕ Search

bioRxiv · 10.64898/2026.03.12.711471

TracktorLive: an integrated real-time object tracking and response system

Abstract

Real-time tracking and automated response systems are essential for standardising experiments, reducing observer bias, and improving reproducibility in studies of movement and behaviour. However, existing solutions face significant challenges: AI-based tracking systems require expensive hardware and impose computational delays, creating challenges for closed-loop experiments; existing real-time tracking tools lack standardised implementations for response delivery; and steep learning curves limit accessibility for users without programming or computer vision expertise. Here, we introduce TracktorLive, an open-source Python package designed to overcome these challenges through concurrency and a modular, cassette-based architecture. TracktorLive leverages traditional computer vision techniques to perform image-based object detection without the need for expensive hardware or deep learning. By parallelizing object tracking and response delivery into separate, concurrent server and client processes, the software minimizes frame processing time, enabling rapid, real-time analysis and response delivery. User-friendly cassettes--portable code snippets that can be copy-pasted into scripts--enable users with minimal programming experience to implement complex workflows for use in experiments and practical applications. We demonstrate TracktorLives utility through several applications, including microcontroller-based stimulus delivery for location-dependent manipulations; conditional video recording that activates only during events of interest; kinematic-based response triggering using real-time velocity computations; and multi-cassette experimental designs combining multiple functionalities. Detailed tutorials are provided to familiarize users with TracktorLives operation and functionality, and a growing library of cassettes supports diverse applications for processing both real-time and pre-recorded video. We validated the software by comparing its response timing to human experimenters in a stimulus delivery task involving two fish species, where TracktorLive demonstrated consistently higher accuracy and lower variability, particularly for fast-moving subjects. Beyond experimental biology, TracktorLives unique architecture and versatility could support many different applications in fields ranging from neuroscience to wildlife management. As an open-source software combining accessibility, modularity, and computational efficiency, TracktorLive can help democratize real-time tracking and automated response systems across disciplines.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Minasandra, P., Sridhar, V. H., Roche, D. G., Planas-Sitja, I.. 2026-03-16. TracktorLive: an integrated real-time object tracking and response system. https://doi.org/10.64898/2026.03.12.711471

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Deconstructing Boldness: Latent behavioural structure across novelty, predation, and exploration in an endangered species translocation program

Risk-related behaviours including neophobia, exploration, and predator avoidance are often assumed to covary along a general boldness axis. Although some translocation studies have linked one or more of these behaviours with fitness, it is possible that the underlying behavioural structure varies under different selective environments. Conservation breeding programs provide a unique opportunity to evaluate the structure of behavioural correlations in a non-domestic species under artificial conditions. We tested whether risk-related behaviours represent a unified boldness syndrome in a captive population of the endangered Attwaters prairie chicken (APC; Tympanuchus cupido attwateri). We quantified the repeatable behaviours of 257 juveniles and compared 11 models of behavioural covariation structure using multivariate mixed models and confirmatory factor analysis. There was no support for a single risk-taking axis; instead, we found three dimensions representing responses to novelty and environmental stimuli (Engagement), predator avoidance (Threat Response), and maze exploration (Maze Progression). Our results indicate that these risk-related behaviours are not organized along a single axis in captive APCs, challenging assumptions that risk-taking represents a universal behavioural syndrome. To anticipate post-release success accurately, conservation managers should understand the exact behavioural architecture of the captive population rather than assume that the classical bold-shy structure occurs in all contexts.

animal behavior and cognition↗

Social costs of group life: Larger groups have less affiliative behavior and more social conflict

The costs and benefits of sociality depend in part upon the size of groups. Therefore, individual behavior should vary across groups of different sizes, reflecting group size-dependent costs and benefits. Here, we test this prediction using a long-term dataset on wild female baboons (Papio cynocephalus x P. anubis). We find that individuals who live in larger groups suffer social costs: compared to animals in smaller groups, they experience more agonistic interactions, fewer grooming interactions, and sparser social networks. These social costs arise, in part, from a pattern in which relationships within dyads become more agonistic as group size increases (i.e., a given dyad exhibits fewer grooming interactions relative to agonistic interactions when it is living in a larger group). While individuals in large groups generally maintain the same number of strong bonds as individuals in small groups, they tend to develop weak bonds with a greater number of social partners that results in, on average, weaker bonds overall. Our results demonstrate that, despite potential benefits to large groups in terms of predation risk and intergroup competition, the social lives of individuals in larger groups involve less affiliation and more conflict in this wild primate population.

animal behavior and cognition↗

Shared brain transcriptome signatures of social evolution and plasticity in shell-dwelling cichlid fishes

Inter-individual variability in phenotypic traits is widespread in nature both across and within species, with similar patterns of variation often occurring between and within species. Given that these two types of variation are generated by evolutionary and plasticity processes respectively, it raises the question to what extent the causal mechanisms underlying such variability at these two different levels are shared or not. To address this question, we studied the variation in brain transcriptomes in Tanganyikan cichlids that exhibit both intra- and interspecific variation in social behavior. We compared two facultatively social cichlid species, each containing naturally occurring solitary and social-living individuals, with a closely related obligatory solitary resembling the ancestral state. Differential gene expression and Gene Set Enrichment Analyses were performed in the telencephalon and diencephalon transcriptomes to investigate the molecular basis of both behavioral plasticity and the evolution of sociality. Behavioral plasticity involved few differentially expressed genes but extensive changes in biological pathways, supporting a highly polygenic architecture of social behavior. Across both species, social-living individuals consistently upregulated pathways involved in translation, protein homeostasis, and energy metabolism, whereas solitary individuals showed enrichment of neuronal morphogenesis, cell adhesion, and structural plasticity. Remarkably, these same functional programs were associated with the independent evolution of sociality, revealing a strong overlap between evolutionary and plastic transcriptional responses. This convergence was largely restricted to the telencephalon, while the diencephalon showed limited and inconsistent functional signatures. Together, our results support the repeated recruitment of gene regulatory programs during the evolution of sociality and demonstrate that behavioral plasticity and evolutionary transitions share common neurogenomic responses, consistent with a conserved genetic toolkit for social behavior.

animal behavior and cognition↗