SOTAVerified

The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentation

2023-04-15Code Available0· sign in to hype

Thanh-Danh Nguyen, Anh-Khoa Nguyen Vu, Nhat-Duy Nguyen, Vinh-Tiep Nguyen, Thanh Duc Ngo, Thanh-Toan Do, Minh-Triet Tran, Tam V. Nguyen

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Camouflaged object detection and segmentation is a new and challenging research topic in computer vision. There is a serious issue of lacking data on concealed objects such as camouflaged animals in natural scenes. In this paper, we address the problem of few-shot learning for camouflaged object detection and segmentation. To this end, we first collect a new dataset, CAMO-FS, for the benchmark. As camouflaged instances are challenging to recognize due to their similarity compared to the surroundings, we guide our models to obtain camouflaged features that highly distinguish the instances from the background. In this work, we propose FS-CDIS, a framework to efficiently detect and segment camouflaged instances via two loss functions contributing to the training process. Firstly, the instance triplet loss with the characteristic of differentiating the anchor, which is the mean of all camouflaged foreground points, and the background points are employed to work at the instance level. Secondly, to consolidate the generalization at the class level, we present instance memory storage with the scope of storing camouflaged features of the same category, allowing the model to capture further class-level information during the learning process. The extensive experiments demonstrated that our proposed method achieves state-of-the-art performance on the newly collected dataset. Code is available at https://github.com/danhntd/FS-CDIS.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CAMO-FSFS-CDIS (MTFA+IMS 5-shot)box AP10.36Unverified
CAMO-FSFS-CDIS (Res101-MTFA+IMS 5-shot)box AP10.36Unverified
CAMO-FSFS-CDIS (iFS-RCNN+ITL 5-shot)box AP10.36Unverified
CAMO-FSFS-CDIS (Res101-MTFA+ITL 5-shot)box AP9.76Unverified
CAMO-FSFS-CDIS (M-RCNN+ITL 5-shot)box AP9.67Unverified
CAMO-FSFS-CDIS (M-RCNN+IMS 5-shot)box AP9.52Unverified
CAMO-FSFS-CDIS (iFS-RCNN+IMS 5-shot)box AP8.44Unverified
CAMO-FSFS-CDIS (M-RCNN+IMS 3-shot)box AP7.96Unverified
CAMO-FSFS-CDIS (M-RCNN+ITL 3-shot)box AP7.85Unverified
CAMO-FSFS-CDIS (M-RCNN+ITL 2-shot)box AP7.56Unverified
CAMO-FSFS-CDIS (MTFA+IMS 3-shot)box AP7.55Unverified
CAMO-FSFS-CDIS (Res101-MTFA+IMS 3-shot)box AP7.55Unverified
CAMO-FSFS-CDIS (M-RCNN+IMS 2-shot)box AP7.39Unverified
CAMO-FSFS-CDIS (Res101-MTFA+ITL 2-shot)box AP7.28Unverified
CAMO-FSFS-CDIS (iFS-RCNN+ITL 3-shot)box AP7.1Unverified
CAMO-FSFS-CDIS (MTFA+IMS 2-shot)box AP6.95Unverified
CAMO-FSFS-CDIS (Res101-MTFA+IMS 2-shot)box AP6.95Unverified
CAMO-FSFS-CDIS (iFS-RCNN+IMS 2-shot)box AP6.39Unverified
CAMO-FSFS-CDIS (iFS-RCNN+IMS 3-shot)box AP5.94Unverified
CAMO-FSFS-CDIS (iFS-RCNN+ITL 2-shot)box AP5.66Unverified
CAMO-FSFS-CDIS (M-RCNN+ITL 1-shot)box AP5.08Unverified
CAMO-FSFS-CDIS (M-RCNN+IMS 1-shot)box AP4.92Unverified
CAMO-FSFS-CDIS (iFS-RCNN+ITL 1-shot)box AP4.71Unverified
CAMO-FSFS-CDIS (MTFA+IMS 1-shot)box AP4.5Unverified
CAMO-FSFS-CDIS (Res101-MTFA+ITL 1-shot)box AP4.04Unverified
CAMO-FSFS-CDIS (iFS-RCNN+IMS 1-shot)box AP2.74Unverified

Reproductions