bioRxiv Science⌕ Search

bioRxiv · 10.1101/194340

Goodness of fit checks for binomial N-mixture models

Abstract

O_LIBinomial N-mixture models are commonly applied to analyze population survey data. By estimating detection probabilities, N-mixture models aim at extracting information about abundances in terms of actual and not just relative numbers. This separation of detection probability and abundance relies on parametric assumptions about the distribution of individuals among sites and of detections of individuals among repeat visits to sites. Current methods for checking assumptions are limited, and their computational complexity have hindered evaluations of their performances.\nC_LIO_LIWe develop computationally efficient graphical goodness of fit checks and measures of overdispersion for binomial N-mixture models. These checks are illustrated in a case study, and evaluated in simulations under two scenarios. The two scenarios assume overdispersion in the abundance distribution via a negative binomial distribution or in the detection probability via a beta-binomial distribution. We evaluate the ability of the checks to detect lack of fit, and how lack of fit affects estimates of abundances.\nC_LIO_LIThe simulations show that if the parametric assumptions are incorrect there can be severe biases in estimated abundances: negatively if there is overdispersion in abundance relative to the fitted model and positively if there is overdispersion in detection. Our goodness of fit checks performed well in detecting lack of fit when the abundance distribution is overdispersed, but struggled to detect lack of fit when detections were overdispersed. We show that the inability to detect lack of fit due to overdispersed detection is caused by a fundamental similarity between N-mixture models with beta-binomial detections and N-mixture models with negative binomial abundances.\nC_LIO_LIThe strong biases in estimated abundances that can occur in the binomial N-mixture model when the distribution of individuals among sites, or the detection model, is mis-specified implies that checking goodness of fit is essential for sound inference in ecological studies that use these methods. To check the assumptions we provide computationally efficient goodness of fit checks that are available in an R-package nmixgof. However, even when a binomial N-mixture model appears to fit the data well, estimates are not robust in the presence of overdispersion unless additional information about detection is collected.\nC_LI

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Knape, J., Arlt, D., Barraquand, F., Berg, A., Chevalier, M., Pärt, T., Ruete, A., Zmihorski, M.. 2017-09-27. Goodness of fit checks for binomial N-mixture models. https://doi.org/10.1101/194340

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

MillionTrees: A global benchmark for tree detection across geography, sensor, and annotation geometry

Airborne tree monitoring using remotely sensed data, combined with the growth of computer vision models for object detection and segmentation, can facilitate broad scale assessment of tree health, ecology and ecosystem function. However, datasets for airborne tree detection have been largely limited to a single geography, resolution, or annotation approach, making it difficult to develop general models and benchmark their utility for broad applications. We compile existing and newly published annotation datasets to create a comprehensive dataset for training and evaluating airborne tree detection in RGB imagery. The MillionTrees dataset has over a million individual trees from a broad range of forest types, tree species, and geographic locations. In addition, it has six million weakly supervised annotations from a range of sources including airborne LiDAR and photogrammetry, arborist surveys, and simulated landscapes. An evaluation standard is provided to facilitate rapid model development. We benchmark several existing tree detection algorithms and demonstrate that while current open-source models do not generalize across the diverse datasets in the benchmark, training on MillionTrees improves both within-domain and out-of-domain performance. Held-out validation datasets using ground truth derived from terrestrial LiDAR paired with overhead RGB show that overfitting to test data is common and hyperparameter tuning is an underappreciated challenge towards a global zero shot tree detection method. We discuss the limitations of the currently available data for airborne RGB tree detection, how to create more robust evaluation data and the need for better understanding of the uncertainty and utility of tree detection from airborne remote sensing.

ecology↗

Individual-specific recovery of the healthy human gut microbiota after antibiotics

Following disruption by broad-spectrum antibiotics, the human gut microbiome undergoes a prolonged recovery where coarse ecological features, such as species richness and diversity, are largely restored. However, as these features are shared by most healthy individuals, it remains unclear whether, even after strong perturbation, individuals preferentially return toward their own pre-treatment composition ('individual-specific recovery') or instead switch to alternative equally healthy states. Resolving this question is fundamental for evaluating the long-term impacts of antibiotics, because an individual's health is affected by their unique microbiome composition, affecting immune regulation and metabolic processing, so a state switch, even to a broadly healthy configuration, could carry unintended consequences. Here we compare each subject's post-antibiotic endpoint with their own baseline and with the baselines of every other subject, across four cohorts (n = 121) whose regimens ranged from a five-day fluoroquinolone course to a four-day three-drug combination given to deplete the gut community. The recovered community was significantly closer to the subject's own baseline than to the alternative healthy baselines in more than 90% of individuals under the mildest regimen and in two thirds of those under regimens that broadly target the gut anaerobes, remaining above chance in every cohort and the majority outcome even where most baseline taxa fell below detection during treatment. This specificity is not merely the persistence and fast regrowth of survivors: it persists among baseline taxa that remain undetected for weeks to months, and the same taxon re-establishes more readily in a host where it was previously detected than in one where it was not. Newly established taxa are consistently more functionally similar to the pre-treatment community than transient arrivals, and their identity correlates with the surviving community's composition in a substantial fraction of subjects. State switching, in contrast, was uncommon and occurred almost exclusively among subjects with the largest reduction in detected taxa during the treatment. Together, these observations reveal the individual-specific nature of the microbiome resilience to broad-spectrum antibiotics, whereas the compositional changes are not random but rather functionally and ecologically associated with the subject's baseline.

ecology↗

Tropical Peatlands as Hotspots of Hidden Arcellinida Diversity: Insights from Maludam National Park, Borneo (Sarawak, Malaysia)

Recent investigations on tropical peatlands have shown their extremely high efficiency as carbon sinks, far beyond better studied boreal bogs. The microbial diversity found in those ecosystems, as well as their corresponding ecological and metabolic processes, are just starting to be revealed, and differ considerably from high latitudes systems. However, these efforts have been concentrated almost exclusively towards prokaryotes and fungi, leaving protist communities virtually unknown. Arcellinida (testate amoebae) are well acknowledged to play an important role in boreal and temperate peatland ecology by driving microbial community composition as top predators, but also as nutrient recyclers and carbon fixers. Yet, to our knowledge, no community-level study has addressed their diversity and its drivers in tropical peatlands. In this study, we surveyed Arcellinida communities' diversity across five functionally distinct vegetation-hydrological zones situated along a hydrological transect in a coastal tropical peatland in the Maludam National Park, Malaysia. Taxonomic composition of Arcellinida communities, characterized by a high diversity of Trigonopyxis-related taxa, indicated fundamental differences in diversity and community composition from extratropical ecosystems. Species richness was significantly higher in the zones with developed understory vegetation. Furthermore, the composition of diversity varied significantly among vegetation-hydrological zones. Altogether, this study shows unique Arcellinida communities in a Southeastern Asian peatland and suggests the importance of vegetation-hydrological characteristics for protist diversity.

ecology↗