bioRxiv Science⌕ Search

bioRxiv · 10.64898/2026.10.06.757089

WildObserve: Camera-trap image review software that learns species labels during annotation

Abstract

Motion-activated camera traps are an effective tool for monitoring animals, but a single study can produce millions of images, which must be analyzed before they yield data. The burden of analyzing them has led many teams to automate the work with computer vision. These models lose accuracy on images unlike those they were trained on, however, and a general model may not use the categories a project needs. Adapting a model to a project usually requires at least one of the following: many labeled images per species, programming expertise, a graphics processing unit (GPU), or uploading images to a remote server. I describe WildObserve, a desktop application that adapts to each project without any of these requirements. Before a reviewer sees an image, MegaDetector finds animals, people, and vehicles and marks images that are likely empty, and SpeciesNet suggests a species for each animal. WildObserve keeps SpeciesNet's feature vector for each animal, so as the reviewer confirms or corrects labels, a project model (a logistic regression on those features) retrains in about a second on an ordinary laptop, learning the project's own species list and names. Images stay on the user's computer, model outputs and human decisions are kept separate, and exports record review and model provenance. On the Caltech Camera Traps dataset, WildObserve processed 8.1 images/s on an Apple M1 Pro laptop with Core ML (1.5 images/s on its CPU), species suggestions included. At a 0.5 threshold, it found animals in 97.1% of animal images but also put a box on 48.0% of images labeled empty. On 1,467 animal crops from 14 categories, SpeciesNet alone reached 0.919 balanced accuracy. The project model reached 0.886 with three labels per category and 0.937 with 25, and 0.931 on camera locations absent from its training labels; built on features from DINOv2, a general-purpose image model, it reached only 0.784 with 50. On the Oregon Critters dataset, released after SpeciesNet was trained, SpeciesNet reached 0.751 and the project model passed it with only ten labels per category (0.783). WildObserve gives a project species suggestions in its own categories, from a model it trains simply by reviewing, without writing code, needing a GPU, or sending images elsewhere.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tabak, M.. 2026-10-10. WildObserve: Camera-trap image review software that learns species labels during annotation. https://doi.org/10.64898/2026.10.06.757089

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

On Motivating the Choice of Link Function in Binomial Regression Through A Latent Abundance Process

Ecologists commonly apply binomial regression to study binary data. Often, the link function in binomial regression is not purposefully chosen, but instead selected on the grounds of interpretation or computation efficiency. However, if the binary response is the result of a latent abundance process, then the link function implies assumptions for this underlying process. The most well-known example of this is the complementary log-log (cloglog) link, which has direct connections with the probability of a positive count under a latent Poisson distribution. If the binary response can be assumed to represent a truncated latent count, the cloglog link can be a better choice than the logit link. On the other hand, counts in ecology are often overdispersed, meaning the assumption of an underlying Poisson abundance process is unrealistic. In this article, we provide a framework for consideration of the link choice in binomial regression, in terms of the latent abundance process that binary responses can represent. Aside from the Poisson case mentioned above, we show that the cloglog link is the right choice if the latent abundance process represents the biomass of individuals, or if the latent abundance process comes from an overdispersed count distribution with a linear mean-variance relationship. For the case where the latent count follows a negative binomial distribution with a quadratic mean-variance relationship, we derive a new generalized complementary log-log (gcloglog) link function, which includes the case of the cloglog link as well as that of the logit link, where the latter implies assuming moderate overdispersion in the form of a geometric distribution. Two simulation studies demonstrate that cloglog and logit link binomial regression can exhibit bias and undercoverage when the latent count is more overdispersed than assumed, while gcloglog link models overcome this issue but in practice require replication in the binomial response for reliable estimation. Two real ecological datasets further illustrate how to use the gcloglog link binomial regression in practice including as a means of sensitivity analysis. We encourage ecologists to give more thought to the choice of link function in binomial regression, based on considering the latent abundance process and its properties.

ecology↗

Towards predictive ecological biogeography: Predicting vegetation type using fine-scale measurements of the abiotic environment

One of the goals of ecological biogeography is to accurately predict where major vegetation types, such as forests or grasslands, can establish themselves. Alas, our current understanding of the mechanisms by which environmental variables jointly influence vegetation types does not allow for such predictions. Here, we compile a database of local measurements of soil, weather, topography, and bedrock lithology for 6404 sites across the continental United States, which we complement with information about the vegetation around the measurement sites. By applying machine learning methods to a subset of the sites, we are able to train a machine that predicts - using only information about abiotic variables - the presence of forests or grasslands with nearly 90% accuracy on the rest of the sites. We find that while weather variables are statistically important for these predictions, a few soil variables prove to be the most powerful predictors. By separating the combined contributions of weather and soil, we show that soil texture is a better predictor under dry conditions than under wet conditions, while pH is important predictor regardless of the weather. Furthermore, from 136 sites undergoing grassland-to-forest succession, our analysis indicates that soil pH changes with a certain lag relative to vegetation change. Sites that have recently undergone a transition exhibit a higher pH, closer to that of grasslands, despite the presence of trees. The pH then decreases by about one unit over a 30-year period of forest development. Ultimately, our results indicate that fine-scale environmental measurements and historical ecological data can serve as a basis for quantitative bio-geographical predictions, which could eventually guide targeted conservation interventions.

ecology↗

Invasive Chinese tallow is associated with distinct rhizosphere microbial communities, core microbiomes, and functional potential relative to native Loblolly pine

Plant invasions frequently reshape belowground microbial communities, yet their effects on rhizosphere microbiome structure and function remain poorly understood. We compared the rhizosphere bacterial and fungal microbiomes of invasive Chinese tallow (Triadica sebifera) and native Loblolly pine (Pinus taeda) using 16S rRNA gene and ITS amplicon sequencing, together with microbial, functional, and soil analyses. Chinese tallow exhibited significantly greater bacterial and fungal richness and distinct microbial community composition than Loblolly pine. The invasive rhizosphere was enriched in plant-beneficial bacterial taxa, including Streptomyces, Bradyrhizobium, and Rhizobium, and ectomycorrhizal-associated fungi such as Russula and Cenococcum. This enrichment is consistent with enhanced nutrient acquisition, plant growth promotion, and stress tolerance, potentially favoring Chinese tallow establishment and persistence. Further, core microbiome and co-occurrence network analyses revealed extensive reorganization of persistent (Streptomyces, Russula) and highly connected microbial taxa that may be associated with Chinese tallow invasion. Functional predictions indicated greater representation of carbohydrate degradation, nitrogen fixation, plant growth promotion, nutrient mineralization, and ectomycorrhizal guilds in the Chinese tallow rhizosphere, whereas lignin degradation and saprotrophic or pathogen-associated fungal guilds were relatively more abundant under Loblolly pine. Soil physicochemical properties were also strongly correlated with dominant bacterial and fungal taxa, indicating that host-mediated microbial recruitment and environmental filtering jointly shaped rhizosphere community assembly. Overall, our findings identify rhizosphere microbiome reassembly as an important belowground feature associated with Chinese tallow invasion.

ecology↗