Video Object Segmentation
Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.
For leaderboards please refer to the different subtasks.
Papers
Showing 1–25 of 551 papers
All datasetsDAVIS 2016DAVIS 2017 (val)YouTube-VOS 2018DAVIS-2017 (test-dev)YouTube-VOS 2019DAVIS 2017M^3-VOSFBMSYouTubeFBMS-59MOSESegTrack-v2
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | AOC-MF (val) | F-Score | 94.7 | — | Unverified |
| 2 | ISVOS (BL30K, MS) | J&F | 93.4 | — | Unverified |
| 3 | XMem (BL30K, MS) | J&F | 93.3 | — | Unverified |
| 4 | BATMAN (val) | J&F | 92.5 | — | Unverified |
| 5 | STCN (val) | J&F | 91.6 | — | Unverified |
| 6 | XMem | J&F | 91.5 | — | Unverified |
| 7 | MobileVOS (val) | J&F | 91.4 | — | Unverified |
| 8 | AOT (val) | J&F | 91.1 | — | Unverified |
| 9 | LCM (val) | J&F | 90.7 | — | Unverified |
| 10 | RPCMVOS (val) | J&F | 90.6 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | XMem (BLK30K, MS) | Mean Jaccard & F-Measure | 89.5 | — | Unverified |
| 2 | LCM | F-measure | 86.5 | — | Unverified |
| 3 | XMem | Mean Jaccard & F-Measure | 86.2 | — | Unverified |
| 4 | BATMAN | Mean Jaccard & F-Measure | 86.2 | — | Unverified |
| 5 | STCN | Mean Jaccard & F-Measure | 85.4 | — | Unverified |
| 6 | AOT | Mean Jaccard & F-Measure | 84.9 | — | Unverified |
| 7 | STM | F-measure | 84.3 | — | Unverified |
| 8 | TransVOS | Mean Jaccard & F-Measure | 83.9 | — | Unverified |
| 9 | RPCMVOS | Mean Jaccard & F-Measure | 83.7 | — | Unverified |
| 10 | RMN | Mean Jaccard & F-Measure | 83.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | XMem (BL30K, MS) | Mean Jaccard & F-Measure | 86.9 | — | Unverified |
| 2 | AOT | Mean Jaccard & F-Measure | 84.1 | — | Unverified |
| 3 | RPCMVOS | Mean Jaccard & F-Measure | 84 | — | Unverified |
| 4 | STCN | Mean Jaccard & F-Measure | 83 | — | Unverified |
| 5 | CFBI+ | Mean Jaccard & F-Measure | 82.8 | — | Unverified |
| 6 | RMN | Jaccard (Seen) | 82.1 | — | Unverified |
| 7 | LCM | Mean Jaccard & F-Measure | 82 | — | Unverified |
| 8 | TransVOS | Mean Jaccard & F-Measure | 81.8 | — | Unverified |
| 9 | SST | Mean Jaccard & F-Measure | 81.7 | — | Unverified |
| 10 | LWL | Mean Jaccard & F-Measure | 81.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | XMem (BL30K, MS) | Mean Jaccard & F-Measure | 83.7 | — | Unverified |
| 2 | XMem | Mean Jaccard & F-Measure | 81 | — | Unverified |
| 3 | BATMAN | Jaccard | 78.4 | — | Unverified |
| 4 | AOT | Jaccard | 75.9 | — | Unverified |
| 5 | RPCMVOS | Jaccard | 75.8 | — | Unverified |
| 6 | LCM | Jaccard | 74.4 | — | Unverified |
| 7 | KMN | Jaccard | 74.1 | — | Unverified |
| 8 | TransVOS | Jaccard | 73 | — | Unverified |
| 9 | STCN | Jaccard | 72.7 | — | Unverified |
| 10 | RMN | Jaccard | 71.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | XMem (BL30K,MS) | Mean Jaccard & F-Measure | 86.8 | — | Unverified |
| 2 | XMem | Mean Jaccard & F-Measure | 85.5 | — | Unverified |
| 3 | BATMAN | Mean Jaccard & F-Measure | 85 | — | Unverified |
| 4 | AOT | Mean Jaccard & F-Measure | 84.1 | — | Unverified |
| 5 | RPCMVOS | Mean Jaccard & F-Measure | 83.9 | — | Unverified |
| 6 | MobileVOS | Mean Jaccard & F-Measure | 83.3 | — | Unverified |
| 7 | STCN | Mean Jaccard & F-Measure | 82.7 | — | Unverified |
| 8 | CFBI+ | Mean Jaccard & F-Measure | 82.6 | — | Unverified |
| 9 | SST | Mean Jaccard & F-Measure | 81.8 | — | Unverified |
| 10 | CFBI | Mean Jaccard & F-Measure | 81 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | AOC-MF (val) | Jaccard (Mean) | 81.7 | — | Unverified |
| 2 | ViTAE-T-Stage | Jaccard (Mean) | 79.4 | — | Unverified |
| 3 | DINO (ViT-B/8, ImageNet retrain) | J&F | 71.4 | — | Unverified |
| 4 | VOSwL (Mask+Language) | mIoU | 59 | — | Unverified |
| 5 | UniTrack | mIoU | 58.4 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ReVOS | Average IOU | 75.6 | — | Unverified |
| 2 | Cutie-base | Average IOU | 74.6 | — | Unverified |
| 3 | XMem | Average IOU | 70.4 | — | Unverified |
| 4 | SAM 2 | Average IOU | 69.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | LOCATE | mIoU | 68.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Cutie | J&F | 68.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | LOCATE | mIoU | 79.9 | — | Unverified |