bioRxiv Science⌕ Search

bioRxiv · 10.1101/2024.09.13.612839

Exploiting facial side similarities to improve AI-driven sea turtle photo-identification systems

Abstract

AO_SCPLOWBSTRACTC_SCPLOWAnimal Photo-identification (photo-ID) denotes the process of identifying individual animals based on their unique and stable morphological characteristics. It has been proven to be a particularly useful tool for a variety of studies on sea turtles increasing the knowledge of their ecology and informing conservation efforts. The photo-ID process in sea turtles is predominantly based on the geometric patterns of the scales of their two head sides which are unique to every individual, and also different from side to side. As such, both manual and automated photo-ID techniques are performed under a side-specific image retrieval setting. There, a query image showing a single profile of an unknown individual, either left or right, is only compared to images of previously identified individuals showing the same side. Here, by employing the recently introduced state-of-the-art deep feature extractor MegaDescriptor, we show for the first time an inherit deep visual similarity between left and right facial profiles of the same individuals in three sea turtle species. We show that the similarity between the left and right profiles of the same individual with respect to geometry, coloration and pigmentation, is on average higher than the similarity between profiles of different individuals. The similarity is detectable even when images are taken years apart and under diverse settings and conditions. We perform several image retrieval experiments under scenarios which mimic realistic sea turtle photo-ID matching processes, where we also allow comparisons of opposite sides in the matching process which have no spatial overlap. We show that the detection and exploitation of this similarity is translated to improved accuracies when compared to the traditional side-specific image retrieval setting. Notably this similarity cannot be detected and thus neither explored by the so-far state-of-the-art sea turtle photo-ID automated methods such as those based on SIFT. Our work leads to a change of paradigm for the sea turtle photo-ID workflows which will be further facilitated by the constant improvement of deep feature-based re-identification methods and paves the path for adopting similar workflows in other animal species as well.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Adam, L., Papafitsoros, K., Jean, C., Rees, A.. 2024-09-18. Exploiting facial side similarities to improve AI-driven sea turtle photo-identification systems. https://doi.org/10.1101/2024.09.13.612839

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Phenotypic diversity acts as a higher-order functional trait of populations

Functional traits are usually assigned to individuals, yet some properties exist only as differences among population members. Whether such higher-order properties predict collective performance remains unclear. Here we used the aquatic plant Spirodela polyrhiza to test whether phenotypic and genetic differences among genotypes predict non-additive population growth. We grew twelve Japanese strains alone and in all pairwise mixtures and quantified their growth dynamics. Mixtures sometimes outperformed the mean of their component monocultures, and some exceeded the better-performing monoculture, although diversity effects were negative on average. Positive effects were most strongly associated with between-strain differences in frond colour and morphology, identifying specific dimensions of phenotypic diversity as population-level predictors of synergistic growth. Genome-wide higher-level association mapping identified loci where between-strain diversity was associated with growth effects, implicating stress responses, secondary metabolism and frond morphology. Loci associated with reduced performance implicated chemical perception and self/non-self recognition, whereas those associated with positive effects reflected functional differentiation in stress responses and physiological niches. Our findings suggest that some traits generate new functions at the population level through variation among individuals, making diversity itself a higher-order functional property.

ecology↗

Developmental cold exposure increases the ability to maintain body temperature during future cold challenges in a free-living altricial bird

Developing in suboptimal temperatures can have widespread negative effects in organisms, but early exposure to thermal challenges can also trigger increased investment in thermoregulatory capacity. Within birds, the effects of cold exposure during incubation may differ between precocial and altricial species due to differences in the ontogeny of thermoregulation. To date, most of the evidence showing that embryonic cold exposure shapes future thermoregulatory capacity comes from a few precocial species in laboratory settings. Less is known about sensitivity to low-temperature incubation in altricial species which only become fully endothermic after hatching. In this study, we tested the effects of cold temperatures during embryonic development by temporarily cooling the nest boxes of free-living tree swallows (Tachycineta bicolor) during late incubation and subsequently exposing nestlings to an acute cold challenge. Cold exposure during early development made nestlings better at maintaining their body temperatures during the acute challenge. Developmentally cold-exposed birds also had higher thyroxine (T4) levels when sampled at lower ambient temperatures, whereas control birds showed the opposite relationship. Among nestlings that failed to maintain their body temperature during the acute cold challenge, developmentally cold-exposed nestlings secreted more corticosterone during the acute cold challenge than control nestlings. Despite these changes, cold-exposed birds did not differ from controls in cold-induced metabolic rates, body mass, or bacteria killing ability. These results are, to our knowledge, the first to show that developmental cold exposure increases the capacity to maintain body temperature during future cold challenges in a songbird. These findings suggest that experiencing even a mild decline in ambient temperatures during embryonic development could prime birds to cope more effectively with harsh or variable environmental conditions later in life.

ecology↗

Winter-run Chinook salmon juvenile recruitment and early life history response to flow in a heavily altered tailwater

Diverse life history strategies allow species to spread risk across a mosaic of habitat conditions. In Chinook Salmon (Oncorhynchus tshawytscha), particularly in the Central Valley of California, this is expressed through varied adult run timings and juvenile outmigration strategies. Anthropogenic impacts, particularly dams, disrupt these fundamental life stage transitions, often forcing managed populations to adapt to homogenized, less stochastic hydrologic regimes. This is exemplified in the Sacramento River, where the conservation of endangered Sacramento River winter run Chinook salmon requires balancing complex water operations with the ecological needs of a population confined to a short stretch of suitable habitat downstream of Shasta Reservoir. Using a 23 year dataset (2002 to 2024), we evaluated the combined effects of flow, temperature, and spawner abundance on juvenile production and life history expression in this habitat. We found that flow and spawner abundance best predicted juvenile abundance at Red Bluff Diversion Dam while temperature had considerably less support. The proportion of juveniles migrating as smolts exhibited significant density dependence that was negatively correlated to both female spawner abundance and peak flows. These results suggest focusing on temperature management alone may be insufficient. Effective management strategies should consider flow variability and habitat restoration to facilitate varying migration strategies and expand upstream rearing capacity. By addressing these physical and hydrologic constraints, managers can better support the full suite of life history strategies necessary for the resilience of winter run Chinook salmon.

ecology↗