Open-World Crimson Snapper Individual Re-Identification via Vision-Language Priors
Deployment-level FAR 6.91% · 5× feature compression · dev70 known-identity error rate 20.10% → 14.65% (27% relative improvement) · dev70 unknown-fish false acceptance 25.90% → 20.75% (20% relative improvement)
Feature compression and open-set rejection unified on a CLIP-ReID backbone; identity error rate improved by 27%, meeting the single-fish engineering freeze standard
- Compact256 projection layer: 5× dimensionality compression
- QACM unifies known-ID recognition with unknown rejection
- Self-built dataset: 92 identities, 10k+ images
Situation
Long-term tracking of individual crimson snapper in aquaculture is difficult: inter-individual appearance differences are subtle, underwater image quality fluctuates, and in real deployment new and unregistered individuals appear continuously — so a closed-set recognition assumption does not hold.
Task
Build an open-world recognition method on vision-language priors that both identifies known identities and rejects unknown ones, while compressing the model to a deployable size.
Action
Designed a Compact256 projection layer on the CLIP-ReID backbone to compress feature dimensionality by 5×; proposed a Quality-Aware Identity Prototype Mechanism (QACM) that folds image-quality estimation into identity prototype modelling, unifying known-identity recognition and unknown-identity rejection; built a crimson snapper individual dataset covering 92 identities and over ten thousand images, then ran both closed-set and deployment-level open-set evaluations.
Result
This project delivers a single-fish video runtime system for open-world fish individual re-identification. Centred on track-level identity lifecycle management, five core mechanisms — including Fast Warm-up, post-confirmation identity retention, and dynamic confidence updating — solve stable recognition under track breaks, frame-quality fluctuation, and identity conflicts.