SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 51–100 of 551 papers

TitleStatusHype
Multi-Granularity Video Object SegmentationCode1
Efficient Track AnythingCode7
Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation—0
HyperSeg: Towards Universal Visual Segmentation with Large Language ModelCode2
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video SegmentationCode3
ClickTrack: Towards Real-time Interactive Single Object Tracking—0
IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet VideosCode2
LiVOS: Light Video Object Segmentation with Gated Linear MatchingCode1
Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI SegmentationCode0
Addressing Issues with Working Memory in Video Object Segmentation—0
SMITE: Segment Me In TimECode3
SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory TreeCode4
One Token to Seg Them All: Language Instructed Reasoning Segmentation in VideosCode2
X-Prompt: Multi-modal Visual Prompt for Video Object SegmentationCode1
Memory Matching is not Enough: Jointly Improving Memory Matching and Decoding for Video Object Segmentation—0
LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation—0
Discriminative Spatial-Semantic VOS Solution: 1st Place Solution for 6th LSVOSCode0
Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video Object SegmentationCode2
CSS-Segment: 2nd Place Report of LSVOS Challenge VOS Track—0
The 2nd Solution for LSVOS Challenge RVOS Track: Spatial-temporal Refinement for Consistent Semantic Segmentation—0
The Instance-centric Transformer for the RVOS Track of LSVOS Challenge: 3rd Place Solution—0
LSVOS Challenge 3rd Place Report: SAM2 and Cutie based VOS—0
3D-Aware Instance Segmentation and Tracking in Egocentric Videos—0
Video Object Segmentation via SAM 2: The 4th Solution for LSVOS Challenge VOS Track—0
UNINEXT-Cutie: The 1st Solution for LSVOS Challenge RVOS Track—0
Fast Sprite Decomposition from Animated Graphics—0
Biomedical SAM 2: Segment Anything in Biomedical Images and VideosCode0
SAM 2: Segment Anything in Images and VideosCode12
Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object SegmentationCode0
Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical videoCode0
Improving Unsupervised Video Object Segmentation via Fake Flow Generation—0
VISA: Reasoning Video Object Segmentation via Large Language ModelsCode3
ActionVOS: Actions as Prompts for Video Object SegmentationCode1
Learning Spatial-Semantic Features for Robust Video Object Segmentation—0
Rethinking Image-to-Video Adaptation: An Object-centric Perspective—0
Context Propagation from Proposals for Semantic Video Object Segmentation—0
Submodular video object proposal selection for semantic object segmentation—0
Non-parametric Contextual Relationship Learning for Semantic Video Object Segmentation—0
Video Inpainting Localization with Contrastive LearningCode1
PVUW 2024 Challenge on Complex Video Understanding: Methods and ResultsCode4
2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation—0
Trusted Video Inpainting Localization via Deep Attentive Noise LearningCode0
ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object DetectionCode0
GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation—0
2nd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation—0
RMem: Restricted Memory Banks Improve Video Object Segmentation—0
1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video SegmentationCode1
Training-Free Robust Interactive Video Object Segmentation—0
3rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation—0
A Semi-Self-Supervised Approach for Dense-Pattern Video Object Segmentation—0
Show:102550
← PrevPage 2 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7—Unverified
2ISVOS (BL30K, MS)J&F93.4—Unverified
3XMem (BL30K, MS)J&F93.3—Unverified
4BATMAN (val)J&F92.5—Unverified
5STCN (val)J&F91.6—Unverified
6XMemJ&F91.5—Unverified
7MobileVOS (val)J&F91.4—Unverified
8AOT (val)J&F91.1—Unverified
9LCM (val)J&F90.7—Unverified
10RPCMVOS (val)J&F90.6—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5—Unverified
2LCMF-measure86.5—Unverified
3XMemMean Jaccard & F-Measure86.2—Unverified
4BATMANMean Jaccard & F-Measure86.2—Unverified
5STCNMean Jaccard & F-Measure85.4—Unverified
6AOTMean Jaccard & F-Measure84.9—Unverified
7STMF-measure84.3—Unverified
8TransVOSMean Jaccard & F-Measure83.9—Unverified
9RPCMVOSMean Jaccard & F-Measure83.7—Unverified
10RMNMean Jaccard & F-Measure83.5—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9—Unverified
2AOTMean Jaccard & F-Measure84.1—Unverified
3RPCMVOSMean Jaccard & F-Measure84—Unverified
4STCNMean Jaccard & F-Measure83—Unverified
5CFBI+Mean Jaccard & F-Measure82.8—Unverified
6RMNJaccard (Seen)82.1—Unverified
7LCMMean Jaccard & F-Measure82—Unverified
8TransVOSMean Jaccard & F-Measure81.8—Unverified
9SSTMean Jaccard & F-Measure81.7—Unverified
10LWLMean Jaccard & F-Measure81.5—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7—Unverified
2XMemMean Jaccard & F-Measure81—Unverified
3BATMANJaccard78.4—Unverified
4AOTJaccard75.9—Unverified
5RPCMVOSJaccard75.8—Unverified
6LCMJaccard74.4—Unverified
7KMNJaccard74.1—Unverified
8TransVOSJaccard73—Unverified
9STCNJaccard72.7—Unverified
10RMNJaccard71.9—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8—Unverified
2XMemMean Jaccard & F-Measure85.5—Unverified
3BATMANMean Jaccard & F-Measure85—Unverified
4AOTMean Jaccard & F-Measure84.1—Unverified
5RPCMVOSMean Jaccard & F-Measure83.9—Unverified
6MobileVOSMean Jaccard & F-Measure83.3—Unverified
7STCNMean Jaccard & F-Measure82.7—Unverified
8CFBI+Mean Jaccard & F-Measure82.6—Unverified
9SSTMean Jaccard & F-Measure81.8—Unverified
10CFBIMean Jaccard & F-Measure81—Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7—Unverified
2ViTAE-T-StageJaccard (Mean)79.4—Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4—Unverified
4VOSwL (Mask+Language)mIoU59—Unverified
5UniTrackmIoU58.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6—Unverified
2Cutie-baseAverage IOU74.6—Unverified
3XMemAverage IOU70.4—Unverified
4SAM 2Average IOU69.5—Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3—Unverified
2oursJaccard (Mean)76.7—Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9—Unverified
2FEELVOSmIoU0.82—Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8—Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3—Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9—Unverified