SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 251300 of 551 papers

TitleStatusHype
3D-Aware Instance Segmentation and Tracking in Egocentric Videos0
UNINEXT-Cutie: The 1st Solution for LSVOS Challenge RVOS Track0
Fast Sprite Decomposition from Animated Graphics0
Biomedical SAM 2: Segment Anything in Biomedical Images and VideosCode0
Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object SegmentationCode0
Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical videoCode0
Improving Unsupervised Video Object Segmentation via Fake Flow Generation0
Learning Spatial-Semantic Features for Robust Video Object Segmentation0
Rethinking Image-to-Video Adaptation: An Object-centric Perspective0
Submodular video object proposal selection for semantic object segmentation0
Non-parametric Contextual Relationship Learning for Semantic Video Object Segmentation0
Context Propagation from Proposals for Semantic Video Object Segmentation0
2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation0
Trusted Video Inpainting Localization via Deep Attentive Noise LearningCode0
ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object DetectionCode0
GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation0
RMem: Restricted Memory Banks Improve Video Object Segmentation0
2nd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation0
Training-Free Robust Interactive Video Object Segmentation0
3rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation0
A Semi-Self-Supervised Approach for Dense-Pattern Video Object Segmentation0
1st Place Solution for MOSE Track in CVPR 2024 PVUW Workshop: Complex Video Object Segmentation0
3rd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation0
Lifelong Learning Using a Dynamically Growing Tree of Sub-networks for Domain Generalization in Video Object Segmentation0
One-shot Training for Video Object Segmentation0
Harnessing Vision-Language Pretrained Models with Temporal-Aware Adaptation for Referring Video Object Segmentation0
Global Motion Understanding in Large-Scale Video Object Segmentation0
DeVOS: Flow-Guided Deformable Transformer for Video Object Segmentation0
Space-time Reinforcement Network for Video Object Segmentation0
360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos0
Spatial-Temporal Multi-level Association for Video Object Segmentation0
Annolid: Annotate, Segment, and Track Anything You NeedCode0
OneVOS: Unifying Video Object Segmentation with All-in-One Transformer Framework0
ClickVOS: Click Video Object SegmentationCode0
Moving Object Proposals with Deep Learned Optical Flow for Video Object Segmentation0
Point-VOS: Pointing Up Video Object Segmentation0
Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound0
Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention0
Explore Synergistic Interaction Across Frames for Interactive Video Object Segmentation0
Understanding Video Transformers via Universal Concept Discovery0
Learning to Segment Referred Objects from Narrated Egocentric Videos0
No More Shortcuts: Realizing the Potential of Temporal Self-Supervision0
Hierarchical Graph Pattern Understanding for Zero-Shot VOSCode0
TAM-VT: Transformation-Aware Multi-scale Video Transformer for Segmentation and Tracking0
Semi-supervised Active Learning for Video Action DetectionCode0
Flexible visual prompts for in-context learning in computer visionCode0
VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models0
SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation0
Sketch-based Video Object Segmentation: Benchmark and Analysis0
Learning the What and How of Annotation in Video Object Segmentation0
Show:102550
← PrevPage 6 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7Unverified
2ISVOS (BL30K, MS)J&F93.4Unverified
3XMem (BL30K, MS)J&F93.3Unverified
4BATMAN (val)J&F92.5Unverified
5STCN (val)J&F91.6Unverified
6XMemJ&F91.5Unverified
7MobileVOS (val)J&F91.4Unverified
8AOT (val)J&F91.1Unverified
9LCM (val)J&F90.7Unverified
10RPCMVOS (val)J&F90.6Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5Unverified
2LCMF-measure86.5Unverified
3XMemMean Jaccard & F-Measure86.2Unverified
4BATMANMean Jaccard & F-Measure86.2Unverified
5STCNMean Jaccard & F-Measure85.4Unverified
6AOTMean Jaccard & F-Measure84.9Unverified
7STMF-measure84.3Unverified
8TransVOSMean Jaccard & F-Measure83.9Unverified
9RPCMVOSMean Jaccard & F-Measure83.7Unverified
10RMNMean Jaccard & F-Measure83.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9Unverified
2AOTMean Jaccard & F-Measure84.1Unverified
3RPCMVOSMean Jaccard & F-Measure84Unverified
4STCNMean Jaccard & F-Measure83Unverified
5CFBI+Mean Jaccard & F-Measure82.8Unverified
6RMNJaccard (Seen)82.1Unverified
7LCMMean Jaccard & F-Measure82Unverified
8TransVOSMean Jaccard & F-Measure81.8Unverified
9SSTMean Jaccard & F-Measure81.7Unverified
10LWLMean Jaccard & F-Measure81.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7Unverified
2XMemMean Jaccard & F-Measure81Unverified
3BATMANJaccard78.4Unverified
4AOTJaccard75.9Unverified
5RPCMVOSJaccard75.8Unverified
6LCMJaccard74.4Unverified
7KMNJaccard74.1Unverified
8TransVOSJaccard73Unverified
9STCNJaccard72.7Unverified
10RMNJaccard71.9Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8Unverified
2XMemMean Jaccard & F-Measure85.5Unverified
3BATMANMean Jaccard & F-Measure85Unverified
4AOTMean Jaccard & F-Measure84.1Unverified
5RPCMVOSMean Jaccard & F-Measure83.9Unverified
6MobileVOSMean Jaccard & F-Measure83.3Unverified
7STCNMean Jaccard & F-Measure82.7Unverified
8CFBI+Mean Jaccard & F-Measure82.6Unverified
9SSTMean Jaccard & F-Measure81.8Unverified
10CFBIMean Jaccard & F-Measure81Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7Unverified
2ViTAE-T-StageJaccard (Mean)79.4Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4Unverified
4VOSwL (Mask+Language)mIoU59Unverified
5UniTrackmIoU58.4Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6Unverified
2Cutie-baseAverage IOU74.6Unverified
3XMemAverage IOU70.4Unverified
4SAM 2Average IOU69.5Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3Unverified
2oursJaccard (Mean)76.7Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9Unverified
2FEELVOSmIoU0.82Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9Unverified