SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 251–300 of 551 papers

TitleStatusHype
3D-Aware Instance Segmentation and Tracking in Egocentric Videos—0
UNINEXT-Cutie: The 1st Solution for LSVOS Challenge RVOS Track—0
Fast Sprite Decomposition from Animated Graphics—0
Biomedical SAM 2: Segment Anything in Biomedical Images and VideosCode0
Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object SegmentationCode0
Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical videoCode0
Improving Unsupervised Video Object Segmentation via Fake Flow Generation—0
Learning Spatial-Semantic Features for Robust Video Object Segmentation—0
Rethinking Image-to-Video Adaptation: An Object-centric Perspective—0
Submodular video object proposal selection for semantic object segmentation—0
Non-parametric Contextual Relationship Learning for Semantic Video Object Segmentation—0
Context Propagation from Proposals for Semantic Video Object Segmentation—0
2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation—0
Trusted Video Inpainting Localization via Deep Attentive Noise LearningCode0
ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object DetectionCode0
GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation—0
RMem: Restricted Memory Banks Improve Video Object Segmentation—0
2nd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation—0
Training-Free Robust Interactive Video Object Segmentation—0
3rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation—0
A Semi-Self-Supervised Approach for Dense-Pattern Video Object Segmentation—0
1st Place Solution for MOSE Track in CVPR 2024 PVUW Workshop: Complex Video Object Segmentation—0
3rd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation—0
Lifelong Learning Using a Dynamically Growing Tree of Sub-networks for Domain Generalization in Video Object Segmentation—0
One-shot Training for Video Object Segmentation—0
Harnessing Vision-Language Pretrained Models with Temporal-Aware Adaptation for Referring Video Object Segmentation—0
Global Motion Understanding in Large-Scale Video Object Segmentation—0
DeVOS: Flow-Guided Deformable Transformer for Video Object Segmentation—0
Space-time Reinforcement Network for Video Object Segmentation—0
360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos—0
Spatial-Temporal Multi-level Association for Video Object Segmentation—0
Annolid: Annotate, Segment, and Track Anything You NeedCode0
OneVOS: Unifying Video Object Segmentation with All-in-One Transformer Framework—0
ClickVOS: Click Video Object SegmentationCode0
Moving Object Proposals with Deep Learned Optical Flow for Video Object Segmentation—0
Point-VOS: Pointing Up Video Object Segmentation—0
Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound—0
Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention—0
Explore Synergistic Interaction Across Frames for Interactive Video Object Segmentation—0
Understanding Video Transformers via Universal Concept Discovery—0
Learning to Segment Referred Objects from Narrated Egocentric Videos—0
No More Shortcuts: Realizing the Potential of Temporal Self-Supervision—0
Hierarchical Graph Pattern Understanding for Zero-Shot VOSCode0
TAM-VT: Transformation-Aware Multi-scale Video Transformer for Segmentation and Tracking—0
Semi-supervised Active Learning for Video Action DetectionCode0
Flexible visual prompts for in-context learning in computer visionCode0
VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models—0
SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation—0
Sketch-based Video Object Segmentation: Benchmark and Analysis—0
Learning the What and How of Annotation in Video Object Segmentation—0
Show:102550
← PrevPage 6 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7—Unverified
2ISVOS (BL30K, MS)J&F93.4—Unverified
3XMem (BL30K, MS)J&F93.3—Unverified
4BATMAN (val)J&F92.5—Unverified
5STCN (val)J&F91.6—Unverified
6XMemJ&F91.5—Unverified
7MobileVOS (val)J&F91.4—Unverified
8AOT (val)J&F91.1—Unverified
9LCM (val)J&F90.7—Unverified
10RPCMVOS (val)J&F90.6—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5—Unverified
2LCMF-measure86.5—Unverified
3XMemMean Jaccard & F-Measure86.2—Unverified
4BATMANMean Jaccard & F-Measure86.2—Unverified
5STCNMean Jaccard & F-Measure85.4—Unverified
6AOTMean Jaccard & F-Measure84.9—Unverified
7STMF-measure84.3—Unverified
8TransVOSMean Jaccard & F-Measure83.9—Unverified
9RPCMVOSMean Jaccard & F-Measure83.7—Unverified
10RMNMean Jaccard & F-Measure83.5—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9—Unverified
2AOTMean Jaccard & F-Measure84.1—Unverified
3RPCMVOSMean Jaccard & F-Measure84—Unverified
4STCNMean Jaccard & F-Measure83—Unverified
5CFBI+Mean Jaccard & F-Measure82.8—Unverified
6RMNJaccard (Seen)82.1—Unverified
7LCMMean Jaccard & F-Measure82—Unverified
8TransVOSMean Jaccard & F-Measure81.8—Unverified
9SSTMean Jaccard & F-Measure81.7—Unverified
10LWLMean Jaccard & F-Measure81.5—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7—Unverified
2XMemMean Jaccard & F-Measure81—Unverified
3BATMANJaccard78.4—Unverified
4AOTJaccard75.9—Unverified
5RPCMVOSJaccard75.8—Unverified
6LCMJaccard74.4—Unverified
7KMNJaccard74.1—Unverified
8TransVOSJaccard73—Unverified
9STCNJaccard72.7—Unverified
10RMNJaccard71.9—Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8—Unverified
2XMemMean Jaccard & F-Measure85.5—Unverified
3BATMANMean Jaccard & F-Measure85—Unverified
4AOTMean Jaccard & F-Measure84.1—Unverified
5RPCMVOSMean Jaccard & F-Measure83.9—Unverified
6MobileVOSMean Jaccard & F-Measure83.3—Unverified
7STCNMean Jaccard & F-Measure82.7—Unverified
8CFBI+Mean Jaccard & F-Measure82.6—Unverified
9SSTMean Jaccard & F-Measure81.8—Unverified
10CFBIMean Jaccard & F-Measure81—Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7—Unverified
2ViTAE-T-StageJaccard (Mean)79.4—Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4—Unverified
4VOSwL (Mask+Language)mIoU59—Unverified
5UniTrackmIoU58.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6—Unverified
2Cutie-baseAverage IOU74.6—Unverified
3XMemAverage IOU70.4—Unverified
4SAM 2Average IOU69.5—Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3—Unverified
2oursJaccard (Mean)76.7—Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9—Unverified
2FEELVOSmIoU0.82—Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8—Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3—Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9—Unverified