bioRxiv Science⌕ Search

Biology subjects

Tolkova, I.

Publications and source records attributed to Tolkova, I..

2 recordsLinked to original sources

Detection, communication, and individual identification with deep audio embeddings: A case study with North Atlantic right whales

Anthropogenic noise has increased ambient sound levels across the globe, both underwater and on land. Among its many negative impacts, heightened noise can impair communication in vocal animals through acoustic masking. Conceptually, noise reduces the animals communication space - the area in which an individual animal can effectively convey information to a conspecific listener. Previous studies have estimated the communication space using sound propagation models and/or behavioral studies. However, studies frequently equate signal recognition with signal detection - a necessary but not sufficient precondition - thereby persistently overestimating spatial coverage and underestimating anthropogenic impacts. Measuring communication is inherently difficult, and varies with taxa, call type, and context, leading to significant data gaps in key parameters. We propose that deep learning creates an opportunity to estimate biologically-relevant communication, even for data-limited species. In particular, we present a case study with the critically endangered North Atlantic right whale (Eubalaena glacialis; hereafter NARW). Prior research has demonstrated that the upcall - a low-frequency contact call produced across ages and sexes - encodes individual identity. We therefore consider a dataset of NARW vocalizations recorded with on-animal archival tags, spanning 234 samples across 11 individuals from 3 sites. First, we demonstrate that audio embeddings from the BirdNET model can robustly distinguish individual right whales. Then, we simulate the effect of varying ambient noise levels to estimate signal excess for both signal detection and individual identification. Altogether, we hope this work provides both a methodological advance for individual identification and a framework for better understanding anthropogenic impacts on vocal wildlife.

ecology↗

Image classification and cognition using contour curvature statistics

Although the higher order mechanisms behind object representation and classification in the visual system are still not well understood, there are hints that simple shape primitives such as "curviness" might activate neural activation and guide this process. Drawing on elementary invariance principles, we propose that a statistical geometric object, the probability distribution of the normalized contour curvatures (NCC) in the intensity field of a planar image, has the potential to represent and classify categories of objects. We show that NCC is sufficient for discriminating between cognitive categories such as animacy, size and type, and demonstrate the robustness of this metric to variation in illumination and viewpoint, consistent with neurobiological constraints and psychological experiments. A generative model for producing artificial images with the observed NCC distributions highlights the key features that our metric captures and just as importantly, those that it does not. More broadly, our study points to the need for statistical geometric approaches to cognition that build in both the statistics and the natural invariances of the sensory world.

animal behavior and cognition↗