Improved accuracy for automated counting of a fish in baited underwater videos for stock assessment

Abstract

The ongoing need to sustainably manage fishery resources necessitates fishery-independent monitoring of the status of fish stocks. Camera systems, particularly baited remote underwater video stations (BRUVS), are a widely-used and repeatable method for monitoring relative abundance, required for building stock assessment models. The potential for BRUVS-based monitoring is restricted, however, by the substantial costs of manual data extraction from videos. Computer vision, in particular deep learning models, are increasingly being used to automatically detect and count fish at low abundances in videos. One of the advantages of BRUVS is that bait attractants help to reliably detect species in relatively short deployments (e.g. 1 hr). The high abundances of fish attracted to BRUVS, however, make computer vision more difficult, because fish often occlude other fish. We build upon existing deep learning methods for identifying and counting a target fisheries species across a wide range of fish abundances. Using BRUVS imagery targeting a recovering fishery species, Australian snapper (Chrysophrys auratus), we tested combinations of three further mathematical steps likely to generate accurate, efficient automation: 1) varying confidence thresholds (CTs), 2) on/off use of sequential non-maximum suppression (Seq-NMS), and 3) statistical correction equations. Output from the deep learning model was accurate at very low abundances of snapper; at higher abundances, however, the model over-predicted counts by as much as 50%. The procedure providing the most accurate counts across all fish abundances, with counts either correct or within 1 to 2 of manual counts (R2 = 93.4%), used Seq-NMS, a 55% confidence threshold, and a cubic polynomial corrective equation. The optimised modelling provides an automated procedure offering an effective and efficient method for accurately identifying and counting snapper in BRUV footage. Further testing is required to ensure that automated counts of snapper remain accurate in the survey region over time, and to determine the applicability to other regions within the distributional range of this species. For monitoring stocks of fishery species more generally, the specific equations will differ but the procedure demonstrated here would help to increase the usefulness of BRUVS, while decreasing costs.