SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 251300 of 551 papers

TitleStatusHype
Self-supervised Video Representation Learning with Motion-Aware Masked AutoencodersCode1
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object RelationsCode1
BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in VideoCode1
A Simple and Powerful Global Optimization for Unsupervised Video Object SegmentationCode1
Unsupervised Video Object Segmentation via Prototype Memory NetworkCode1
Treating Motion as Option to Reduce Motion Dependency in Unsupervised Video Object SegmentationCode1
Pixel-Level Equalized Matching for Video Object Segmentation0
TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut0
SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-MaximizationCode1
Two-Stream Networks for Object Segmentation in Videos0
Per-Clip Video Object SegmentationCode1
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation0
Multi-Attention Network for Compressed Video Referring Object SegmentationCode1
In Defense of Online Models for Video Instance SegmentationCode2
Semantic-Aware Fine-Grained CorrespondenceCode1
Region Aware Video Object Segmentation with Deep Motion Modeling0
Hierarchical Feature Alignment Network for Unsupervised Video Object SegmentationCode1
Learning Quality-aware Dynamic Memory for Video Object SegmentationCode1
Tackling Background Distraction in Video Object SegmentationCode1
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory ModelCode3
SiamMask: A Framework for Fast Online Object Tracking and SegmentationCode4
Towards Robust Referring Video Object Segmentation with Cyclic Relational ConsensusCode1
Towards Robust Video Object Segmentation with Adaptive Object CalibrationCode1
The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation0
5th Place Solution for YouTube-VOS Challenge 2022: Video Object Segmentation0
Language-Bridged Spatial-Temporal Interaction for Referring Video Object SegmentationCode1
A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic InformationCode1
Differentiable Soft-Masked AttentionCode1
Collaborative Attention Memory Network for Video Object Segmentation0
Recurrent Dynamic Embedding for Video Object SegmentationCode1
Boosting Video Object Segmentation based on Scale InconsistencyCode0
Self-Supervised Video Object Segmentation via Cutout Prediction and Tagging0
Adaptive Memory Management for Video Object SegmentationCode0
Implicit Motion-Compensated Network for Unsupervised Video Object SegmentationCode0
In-N-Out Generative Learning for Dense Unsupervised Video SegmentationCode1
Video Polyp Segmentation: A Deep Learning PerspectiveCode2
Temporal Transductive Inference for Few-Shot Video Object SegmentationCode0
Scalable Video Object Segmentation with Identification MechanismCode2
Robust Visual Tracking by SegmentationCode1
Local-Global Context Aware Transformer for Language-Guided Video SegmentationCode1
End-to-End Semi-Supervised Learning for Video Action DetectionCode1
Revisiting Click-based Interactive Video Object SegmentationCode0
Box Supervised Video Segmentation Proposal NetworkCode0
Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks0
Learning Pixel Trajectories with Multiscale Contrastive Random Walks0
Language as Queries for Referring Video Object SegmentationCode2
Wnet: Audio-Guided Video Object Segmentation via Wavelet-Based Cross-Modal Denoising NetworksCode1
Multi-Level Representation Learning With Semantic Alignment for Referring Video Object Segmentation0
YouMVOS: An Actor-Centric Multi-Shot Video Object Segmentation Dataset0
Siamese Network with Interactive Transformer for Video Object SegmentationCode0
Show:102550
← PrevPage 6 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7Unverified
2ISVOS (BL30K, MS)J&F93.4Unverified
3XMem (BL30K, MS)J&F93.3Unverified
4BATMAN (val)J&F92.5Unverified
5STCN (val)J&F91.6Unverified
6XMemJ&F91.5Unverified
7MobileVOS (val)J&F91.4Unverified
8AOT (val)J&F91.1Unverified
9LCM (val)J&F90.7Unverified
10RPCMVOS (val)J&F90.6Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5Unverified
2LCMF-measure86.5Unverified
3XMemMean Jaccard & F-Measure86.2Unverified
4BATMANMean Jaccard & F-Measure86.2Unverified
5STCNMean Jaccard & F-Measure85.4Unverified
6AOTMean Jaccard & F-Measure84.9Unverified
7STMF-measure84.3Unverified
8TransVOSMean Jaccard & F-Measure83.9Unverified
9RPCMVOSMean Jaccard & F-Measure83.7Unverified
10RMNMean Jaccard & F-Measure83.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9Unverified
2AOTMean Jaccard & F-Measure84.1Unverified
3RPCMVOSMean Jaccard & F-Measure84Unverified
4STCNMean Jaccard & F-Measure83Unverified
5CFBI+Mean Jaccard & F-Measure82.8Unverified
6RMNJaccard (Seen)82.1Unverified
7LCMMean Jaccard & F-Measure82Unverified
8TransVOSMean Jaccard & F-Measure81.8Unverified
9SSTMean Jaccard & F-Measure81.7Unverified
10LWLMean Jaccard & F-Measure81.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7Unverified
2XMemMean Jaccard & F-Measure81Unverified
3BATMANJaccard78.4Unverified
4AOTJaccard75.9Unverified
5RPCMVOSJaccard75.8Unverified
6LCMJaccard74.4Unverified
7KMNJaccard74.1Unverified
8TransVOSJaccard73Unverified
9STCNJaccard72.7Unverified
10RMNJaccard71.9Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8Unverified
2XMemMean Jaccard & F-Measure85.5Unverified
3BATMANMean Jaccard & F-Measure85Unverified
4AOTMean Jaccard & F-Measure84.1Unverified
5RPCMVOSMean Jaccard & F-Measure83.9Unverified
6MobileVOSMean Jaccard & F-Measure83.3Unverified
7STCNMean Jaccard & F-Measure82.7Unverified
8CFBI+Mean Jaccard & F-Measure82.6Unverified
9SSTMean Jaccard & F-Measure81.8Unverified
10CFBIMean Jaccard & F-Measure81Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7Unverified
2ViTAE-T-StageJaccard (Mean)79.4Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4Unverified
4VOSwL (Mask+Language)mIoU59Unverified
5UniTrackmIoU58.4Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6Unverified
2Cutie-baseAverage IOU74.6Unverified
3XMemAverage IOU70.4Unverified
4SAM 2Average IOU69.5Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3Unverified
2oursJaccard (Mean)76.7Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9Unverified
2FEELVOSmIoU0.82Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9Unverified