Hypercorrelation Squeeze for Few-Shot Segmentation
Juhong Min, Dahyun Kang, Minsu Cho
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/juhongm999/hsnetOfficialpytorch★ 254
Abstract
Few-shot semantic segmentation aims at learning to segment a target object from a query image using only a few annotated support images of the target class. This challenging task requires to understand diverse levels of visual cues and analyze fine-grained correspondence relations between the query and the support images. To address the problem, we propose Hypercorrelation Squeeze Networks (HSNet) that leverages multi-level feature correlation and efficient 4D convolutions. It extracts diverse features from different levels of intermediate convolutional layers and constructs a collection of 4D correlation tensors, i.e., hypercorrelations. Using efficient center-pivot 4D convolutions in a pyramidal architecture, the method gradually squeezes high-level semantic and low-level geometric cues of the hypercorrelation into precise segmentation masks in coarse-to-fine manner. The significant performance improvements on standard few-shot segmentation benchmarks of PASCAL-5i, COCO-20i, and FSS-1000 verify the efficacy of the proposed method.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| COCO-20i (1-shot) | HSNet (ResNet-50) | Mean IoU | 39.2 | — | Unverified |
| COCO-20i (1-shot) | HSNet (ResNet-101) | Mean IoU | 41.2 | — | Unverified |
| COCO-20i (5-shot) | HSNet (ResNet-101) | Mean IoU | 49.5 | — | Unverified |
| COCO-20i (5-shot) | HSNet (ResNet-50) | Mean IoU | 46.9 | — | Unverified |
| FSS-1000 (1-shot) | HSNet (ResNet-50) | Mean IoU | 85.5 | — | Unverified |
| FSS-1000 (1-shot) | HSNet (ResNet-101) | Mean IoU | 86.5 | — | Unverified |
| FSS-1000 (1-shot) | HSNet (VGG-16) | Mean IoU | 82.3 | — | Unverified |
| FSS-1000 (5-shot) | HSNet (ResNet-50) | Mean IoU | 87.8 | — | Unverified |
| FSS-1000 (5-shot) | HSNet (ResNet-101) | Mean IoU | 88.5 | — | Unverified |
| FSS-1000 (5-shot) | HSNet (VGG-16) | Mean IoU | 85.8 | — | Unverified |
| PASCAL-5i (1-Shot) | HSNet (ResNet-101) | Mean IoU | 66.2 | — | Unverified |
| PASCAL-5i (1-Shot) | HSNet (ResNet-50) | Mean IoU | 64 | — | Unverified |
| PASCAL-5i (1-Shot) | HSNet (VGG-16) | Mean IoU | 59.7 | — | Unverified |
| PASCAL-5i (5-Shot) | HSNet (ResNet-101) | Mean IoU | 70.4 | — | Unverified |
| PASCAL-5i (5-Shot) | HSNet (ResNet-50) | Mean IoU | 69.5 | — | Unverified |
| PASCAL-5i (5-Shot) | HSNet (VGG-16) | Mean IoU | 64.1 | — | Unverified |