A comprehensive evaluation of taxonomic classifiers in marine vertebrate eDNA studies

Bayer, P. E.; Bennett, A.; Nester, G.; Corrigan, S.; Raes, E. J.; McInnes, A. S.; Cooper, M.; Ayad, M. E.; McVey, P.; Kardailsky, A.; Pearce, J.; Fraser, M. W.; Goncalves, P.; Burnell, S.; Rauschert, S.

doi:10.1101/2024.02.15.580601

bioRxiv · 10.1101/2024.02.15.580601

A comprehensive evaluation of taxonomic classifiers in marine vertebrate eDNA studies

Bayer, P. E.·Bennett, A.·Nester, G.·Corrigan, S.·Raes, E. J.·McInnes, A. S.·Cooper, M.·Ayad, M. E.·McVey, P.·Kardailsky, A.·Pearce, J.·Fraser, M. W.·Goncalves, P.·Burnell, S.·Rauschert, S.

View original source ↗Export metadata ↓

Abstract

Environmental DNA (eDNA) metabarcoding is a widely used tool for surveying marine vertebrate biodiversity. To this end, many computational tools have been released and a plethora of bioinformatic approaches are used for eDNA-based community composition analysis. Simulation studies and careful evaluation of taxonomic classifiers are essential to establish reliable benchmarks to improve accuracy and reproducibility of eDNA-based findings. Here we present a comprehensive evaluation of nine taxonomic classifiers exploring three widely used mitochondrial markers (12S rDNA, 16S rDNA, and COI) in Australian marine vertebrates. Curated reference databases and exclusion database tests were used to simulate diverse species compositions, including three positive control and two negative control datasets. Using these simulated datasets, we were able to identify between 19% to 85% of marine vertebrate species using mitochondrial markers. We show that MMSeqs2 and Metabuli generally outperform BLAST with 10% and 11% higher F1 scores for 12S and 16S rDNA markers, respectively, and that Naive Bayes Classifiers such as Mothur outperform sequence-based classifiers except MMSeqs2 for COI markers by 11%. Database exclusion tests reveal that MMSeqs2 and BLAST are less susceptible to false positives compared to Kraken2 with default parameters. Based on these findings, we recommend that MMSeqs2 is used for taxonomic classification of marine vertebrates given its ability to improve species-level assignments while reducing the number of false positives. Our work contributes to the establishment of best practices in eDNA-based biodiversity analysis to ultimately increase the reliability of this monitoring tool in the context of marine vertebrate conservation.

Source connections

Published article ↗

Explore related subjects

ecology Preprint

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Bayer, P. E., Bennett, A., Nester, G., Corrigan, S., Raes, E. J., McInnes, A. S., Cooper, M., Ayad, M. E., McVey, P., Kardailsky, A., Pearce, J., Fraser, M. W., Goncalves, P., Burnell, S., Rauschert, S.. 2024-02-17. A comprehensive evaluation of taxonomic classifiers in marine vertebrate eDNA studies. https://doi.org/10.1101/2024.02.15.580601

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Beyond Single-Metric Assessments: Uncovering Masked Butterfly Declines via Multi-Scalar Analysis in Central Alberta

1. This study analyzed 21 years (2000-2025) of butterfly count data from Central Alberta, integrated with intensive 5-year (2021-2025) high-resolution intra-seasonal sampling. 2. Long-term macro-scale analysis revealed a significant decline in Shannon Diversity, a change that remained obscured when relying solely on traditional metrics of species richness and evenness. 3. This diversity decline was primarily driven by the severe, long-term collapse of the native Common Ringlet (Coenonympha tullia). 4. Four other dominant species--Cabbage White (Pieris rapae), Clouded Sulphur (Colias eriphyle), European Skipper (Thymelicus lineola), and Common Wood Nymph (Cercyonis pegala)--maintained long-term population stability, though their abundances were significantly constrained by extreme winter minimum temperatures and rapid spring warming. 5. High-resolution intra-seasonal analysis (2021-2025) demonstrated that community indices and species-specific abundances were strongly limited by daily weather, particularly wind velocity and temperature. 6. These findings illustrate that while traditional metrics like richness and evenness are fundamental to community ecology, they provide incomplete insights when applied in isolation; they are most effective when utilized as part of a complementary, multi-scalar framework. 7. This study highlights the necessity of coupling multi-decadal historical datasets with high-frequency, fine-scale sampling to accurately identify the mechanisms of community turnover that simpler metrics may overlook. 8. The results underscore the critical importance of standardized citizen science monitoring in quantifying environmental impacts and establishing conservation priorities for terrestrial insect groups.

ecology↗

bioRxiv2026

From concentration to export: resource contrasts and bee traits shape pollinator spillover to crops

Floral plantings can either concentrate bees or export them to adjacent crops, yet the ecological conditions influencing these outcomes remain unclear. Here, we develop a mathematical model as proof of concept for our previous integrative hypothesis: concentrator and exporter outcomes can arise as alternative, context-dependent outcomes of the same underlying resource-selection process. Using bees as a model and focusing specifically on spillover from floral plantings to crops, we identified resource-specific thresholds separating concentration- and export-favoring conditions. Our model translates differences in relative patch attractiveness into context-dependent concentration and export outcomes and generates resource-specific, testable predictions about the conditions favoring pollinator movement into crops. In our simulations, the concentrator-exporter transition occurred at a lower flowering-intensity contrast than at pollen or nectar contrasts, which suggests that flowering intensity may provide an initial cue for bee movement, whereas nectar and pollen rewards refine or sustain bee responses once crops are perceived as attractive. Spillover thresholds differed among resource contrasts, whereas response steepness varied across bee-trait and community scenarios. Under the model's trait-sensitivity formulation, predicted spillover probability responded more strongly to flowering contrast for specialists than for generalists; colony size amplified this response, whereas bee richness dampened it. Together, these patterns show how flowering and resource contrasts interact with bee traits and community context to shape predicted spillover. Our results confirm that the concentrator and exporter hypotheses can be understood as context-dependent outcomes of the same ecological process rather than as mutually exclusive alternatives. Experimental tests of the predicted thresholds conducted in the field could reveal when and where floral plantings are most likely to promote bee spillover to crops, potentially supporting crop pollination.

ecology↗

bioRxiv2026

A Computational Re-evaluation of Spatial Trials for Zoonotic Tuberculosis Control: Model Misspecification, Diagnostic Miss-classification, and the Illusion of Wildlife Culling Efficacy

1. Wildlife reservoir management frequently relies on the Randomised Badger Culling Trial's (RBCT) trade-off hypothesis, which posits that reductions in cattle herd infections are offset by a perturbation effect driven by disrupted host dispersal. This paper evaluates the computational and epidemiological robustness of this historical trial, which serves as the foundational empirical experiment guiding zoonotic tuberculosis (Mycobacterium bovis) control policies. 2. Using generalized linear mixed models with a generalized Poisson error distribution to explicitly address historical data overdispersion, this study contrasts traditional parametric inference against exact cluster-constrained permutation tests across distinct operational definitions of disease incidence. 3. Non-parametric diagnostics reveal that previously reported treatment and perturbation effects render as statistical artifacts under exact non-parametric permutation. Inside culling zones, parametric significance fails to withstand exact permutation verification due to extreme data leverage in localized cluster blocks. 4. Crucially, when diagnostic misclassification biases are eliminated by analysing total reactor datasets, all apparent culling effects disappear, and information criteria overwhelmingly favour nested null architectures. Unconfirmed reactors likely represent true biological infections missed by low-sensitivity post-mortem macro-necropsy, proving that host removal tracks observation noise rather than genuine zoonotic transmission pathways. 5. Finally, empirical scaling conducted in this study identifies a novel mathematical saturation effect, demonstrating that this sub-linear scaling is an operational artifact of unmodelled herd-level disease recurrence over time. 6. Policy implications. Because current zoonotic tuberculosis intervention frameworks are built upon a structurally misspecified statistical model, they have driven large-scale veterinary policies resulting in substantial, unevidenced ecological and economic interventions while failing to provide genuine public health, animal health, or disease control benefits.

ecology↗