SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 201250 of 551 papers

TitleStatusHype
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
Robust and Efficient Memory Network for Video Object Segmentation0
Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual GroupingCode1
Segment Everything Everywhere All at OnceCode1
Boosting Video Object Segmentation via Space-time Correspondence LearningCode1
MED-VT++: Unifying Multimodal Learning with a Multiscale Encoder-Decoder Video Transformer0
CLVOS23: A Long Video Object Segmentation Dataset for Continual LearningCode0
Co-attention Propagation Network for Zero-Shot Video Object SegmentationCode0
SegGPT: Segmenting Everything In ContextCode4
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking TasksCode1
Reliability-Hierarchical Memory Network for Scribble-Supervised Video Object SegmentationCode1
CrOC: Cross-View Online Clustering for Dense Visual Representation LearningCode1
Two-shot Video Object SegmentationCode1
Adaptive Multi-source Predictor for Zero-shot Video Object SegmentationCode1
Unified Mask Embedding and Correspondence Learning for Self-Supervised Video SegmentationCode0
Guided Slot Attention for Unsupervised Video Object SegmentationCode1
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation0
Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentation0
One-Shot Video Inpainting0
Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot InteractionCode1
MOSE: A New Dataset for Video Object Segmentation in Complex ScenesCode2
Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation0
Flow-guided Semi-supervised Video Object Segmentation0
TarViS: A Unified Approach for Target-based Video SegmentationCode1
Unsupervised Video Object Segmentation with Online Adversarial Self-Tuning0
Video State-Changing Object SegmentationCode0
Robust Referring Video Object Segmentation with Cyclic Structural Consensus0
SegGPT: Towards Segmenting Everything in Context0
HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation0
Video Object Segmentation-aware Video Frame InterpolationCode1
Segment Every Reference Object in Spatial and Temporal Spaces0
Alignment Before Aggregation: Trajectory Memory Retrieval Network for Video Object Segmentation0
End-to-End Video Matting With Trimap PropagationCode1
1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object SegmentationCode1
Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy0
Learning a Fast 3D Spectral Approach to Object Segmentation and Tracking over Space and Time0
Look Before You Match: Instance Understanding Matters in Video Object Segmentation0
Breaking the "Object" in Video Object Segmentation0
Video Object of Interest Segmentation0
Learning to Learn Better for Video Object SegmentationCode1
Dual Prototype Attention for Unsupervised Video Object SegmentationCode1
LVOS: A Benchmark for Long-term Video Object SegmentationCode1
Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview0
Efficient Unsupervised Video Object Segmentation Network Based on Motion Guidance0
Quantifying and Learning Static vs. Dynamic Information in Deep Spatiotemporal Networks0
Two-Level Temporal Relation Model for Online Video Instance SegmentationCode0
VLT: Vision-Language Transformer and Query Generation for Referring SegmentationCode2
Self-supervised Amodal Video Object SegmentationCode0
Decoupling Features in Hierarchical Propagation for Video Object SegmentationCode2
Global Spectral Filter Memory Network for Video Object SegmentationCode1
Show:102550
← PrevPage 5 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7Unverified
2ISVOS (BL30K, MS)J&F93.4Unverified
3XMem (BL30K, MS)J&F93.3Unverified
4BATMAN (val)J&F92.5Unverified
5STCN (val)J&F91.6Unverified
6XMemJ&F91.5Unverified
7MobileVOS (val)J&F91.4Unverified
8AOT (val)J&F91.1Unverified
9LCM (val)J&F90.7Unverified
10RPCMVOS (val)J&F90.6Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5Unverified
2LCMF-measure86.5Unverified
3XMemMean Jaccard & F-Measure86.2Unverified
4BATMANMean Jaccard & F-Measure86.2Unverified
5STCNMean Jaccard & F-Measure85.4Unverified
6AOTMean Jaccard & F-Measure84.9Unverified
7STMF-measure84.3Unverified
8TransVOSMean Jaccard & F-Measure83.9Unverified
9RPCMVOSMean Jaccard & F-Measure83.7Unverified
10RMNMean Jaccard & F-Measure83.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9Unverified
2AOTMean Jaccard & F-Measure84.1Unverified
3RPCMVOSMean Jaccard & F-Measure84Unverified
4STCNMean Jaccard & F-Measure83Unverified
5CFBI+Mean Jaccard & F-Measure82.8Unverified
6RMNJaccard (Seen)82.1Unverified
7LCMMean Jaccard & F-Measure82Unverified
8TransVOSMean Jaccard & F-Measure81.8Unverified
9SSTMean Jaccard & F-Measure81.7Unverified
10LWLMean Jaccard & F-Measure81.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7Unverified
2XMemMean Jaccard & F-Measure81Unverified
3BATMANJaccard78.4Unverified
4AOTJaccard75.9Unverified
5RPCMVOSJaccard75.8Unverified
6LCMJaccard74.4Unverified
7KMNJaccard74.1Unverified
8TransVOSJaccard73Unverified
9STCNJaccard72.7Unverified
10RMNJaccard71.9Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8Unverified
2XMemMean Jaccard & F-Measure85.5Unverified
3BATMANMean Jaccard & F-Measure85Unverified
4AOTMean Jaccard & F-Measure84.1Unverified
5RPCMVOSMean Jaccard & F-Measure83.9Unverified
6MobileVOSMean Jaccard & F-Measure83.3Unverified
7STCNMean Jaccard & F-Measure82.7Unverified
8CFBI+Mean Jaccard & F-Measure82.6Unverified
9SSTMean Jaccard & F-Measure81.8Unverified
10CFBIMean Jaccard & F-Measure81Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7Unverified
2ViTAE-T-StageJaccard (Mean)79.4Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4Unverified
4VOSwL (Mask+Language)mIoU59Unverified
5UniTrackmIoU58.4Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6Unverified
2Cutie-baseAverage IOU74.6Unverified
3XMemAverage IOU70.4Unverified
4SAM 2Average IOU69.5Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3Unverified
2oursJaccard (Mean)76.7Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9Unverified
2FEELVOSmIoU0.82Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9Unverified