Mar. 2025-Sep. 2026
Open-World Crimson Snapper Individual Re-Identification via Vision-Language Priors
STAR project narrative
Situation
Long-term tracking of individual crimson snapper in aquaculture is difficult: inter-individual appearance differences are subtle, underwater image quality fluctuates, and in real deployment new and unregistered individuals appear continuously — so a closed-set recognition assumption does not hold.
Task
Build an open-world recognition method on vision-language priors that both identifies known identities and rejects unknown ones, while compressing the model to a deployable size.
Action
Designed a Compact256 projection layer on the CLIP-ReID backbone to compress feature dimensionality by 5×; proposed a Quality-Aware Identity Prototype Mechanism (QACM) that folds image-quality estimation into identity prototype modelling, unifying known-identity recognition and unknown-identity rejection; built a crimson snapper individual dataset covering 92 identities and over ten thousand images, then ran both closed-set and deployment-level open-set evaluations.
Result
This project delivers a single-fish video runtime system for open-world fish individual re-identification. Centred on track-level identity lifecycle management, five core mechanisms — including Fast Warm-up, post-confirmation identity retention, and dynamic confidence updating — solve stable recognition under track breaks, frame-quality fluctuation, and identity conflicts.
System V3.1.1 meets the single-fish engineering freeze standard: it outputs stable, auditable identity results and provides a reusable technical baseline for active identity management and multi-track conflict handling in future multi-fish scenarios.
Key Quantitative Results
- Deployment-level FAR 6.91%
- 5× feature compression
- dev70 known-identity error rate 20.10% → 14.65% (27% relative improvement)
- dev70 unknown-fish false acceptance 25.90% → 20.75% (20% relative improvement)
Project Gallery
Technology Tags
- PyTorch
- CLIP-ReID
- Feature Compression
- Open-Set Recognition
- Research Publication
- Compact256 projection layer: 5× dimensionality compression
- QACM unifies known-ID recognition with unknown rejection
- Self-built dataset: 92 identities, 10k+ images