SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 151200 of 551 papers

TitleStatusHype
Learning the What and How of Annotation in Video Object Segmentation0
ISAR: A Benchmark for Single- and Few-Shot Object Instance Segmentation and Re-Identification0
SpVOS: Efficient Video Object Segmentation with Triple Sparse Convolution0
Putting the Object Back into Video Object SegmentationCode3
Zero-Shot Open-Vocabulary Tracking with Large Pre-Trained Models0
Sub-token ViT Embedding via Stochastic Resonance TransformersCode0
CoralVOS: Dataset and Benchmark for Coral Video Segmentation0
Memory-Efficient Continual Learning Object Segmentation for Long Video0
Treating Motion as Option with Output Selection for Unsupervised Video Object SegmentationCode1
Adversarial Attacks on Video Object Segmentation with Hard Region Discovery0
Efficient Long-Short Temporal Attention Network for Unsupervised Video Object Segmentation0
PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video SegmentationCode1
Fully Transformer-Equipped Architecture for End-to-End Referring Video Object Segmentation0
Multi-grained Temporal Prototype Learning for Few-shot Video Object SegmentationCode0
Temporal Collection and Distribution for Referring Video Object Segmentation0
Tracking Anything with Decoupled Video SegmentationCode3
Robust Visual Tracking by Motion Analyzing0
Learning Cross-Modal Affinity for Referring Video Object Segmentation Targeting Limited SamplesCode0
Joint Modeling of Feature, Correspondence, and a Compressed Memory for Video Object Segmentation0
Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and SegmentationCode1
LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingCode0
Scalable Video Object Segmentation with Simplified Framework0
MeViS: A Large-scale Benchmark for Video Segmentation with Motion ExpressionsCode2
Isomer: Isomerous Transformer for Zero-shot Video Object SegmentationCode1
Expression Prompt Collaboration Transformer for Universal Referring Video Object SegmentationCode0
Learning Referring Video Object Segmentation from Weak Annotation0
XMem++: Production-level Video Segmentation From Few Annotated FramesCode2
Tracking Anything in High QualityCode2
Spectrum-guided Multi-granularity Referring Video Object SegmentationCode1
OnlineRefer: A Simple Online Baseline for Referring Video Object SegmentationCode1
Hierarchical Spatiotemporal Transformers for Video Object Segmentation0
Holistic Prototype Attention Network for Few-Shot VOSCode0
Multiscale Memory Comparator Transformer for Few-Shot Video SegmentationCode0
FODVid: Flow-guided Object Discovery in Videos0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation0
RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object SegmentationCode1
Segment Anything Meets Point TrackingCode3
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentation0
TrickVOS: A Bag of Tricks for Video Object Segmentation0
Online Unsupervised Video Object Segmentation via Contrastive Motion ClusteringCode0
LoSh: Long-Short Text Joint Prediction Network for Referring Video Object SegmentationCode1
SOC: Semantic-Assisted Object Cluster for Referring Video Object SegmentationCode1
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object SegmentationCode1
AutoDepthNet: High Frame Rate Depth Map Reconstruction using Commodity Depth and RGB Cameras0
Siamese Masked Autoencoders0
UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything ModelCode1
READMem: Robust Embedding Association for a Diverse Memory in Unconstrained Video Object SegmentationCode0
Video Object Segmentation in Panoptic Wild ScenesCode2
Personalize Segment Anything Model with One ShotCode3
Show:102550
← PrevPage 4 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7Unverified
2ISVOS (BL30K, MS)J&F93.4Unverified
3XMem (BL30K, MS)J&F93.3Unverified
4BATMAN (val)J&F92.5Unverified
5STCN (val)J&F91.6Unverified
6XMemJ&F91.5Unverified
7MobileVOS (val)J&F91.4Unverified
8AOT (val)J&F91.1Unverified
9LCM (val)J&F90.7Unverified
10RPCMVOS (val)J&F90.6Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5Unverified
2LCMF-measure86.5Unverified
3XMemMean Jaccard & F-Measure86.2Unverified
4BATMANMean Jaccard & F-Measure86.2Unverified
5STCNMean Jaccard & F-Measure85.4Unverified
6AOTMean Jaccard & F-Measure84.9Unverified
7STMF-measure84.3Unverified
8TransVOSMean Jaccard & F-Measure83.9Unverified
9RPCMVOSMean Jaccard & F-Measure83.7Unverified
10RMNMean Jaccard & F-Measure83.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9Unverified
2AOTMean Jaccard & F-Measure84.1Unverified
3RPCMVOSMean Jaccard & F-Measure84Unverified
4STCNMean Jaccard & F-Measure83Unverified
5CFBI+Mean Jaccard & F-Measure82.8Unverified
6RMNJaccard (Seen)82.1Unverified
7LCMMean Jaccard & F-Measure82Unverified
8TransVOSMean Jaccard & F-Measure81.8Unverified
9SSTMean Jaccard & F-Measure81.7Unverified
10LWLMean Jaccard & F-Measure81.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7Unverified
2XMemMean Jaccard & F-Measure81Unverified
3BATMANJaccard78.4Unverified
4AOTJaccard75.9Unverified
5RPCMVOSJaccard75.8Unverified
6LCMJaccard74.4Unverified
7KMNJaccard74.1Unverified
8TransVOSJaccard73Unverified
9STCNJaccard72.7Unverified
10RMNJaccard71.9Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8Unverified
2XMemMean Jaccard & F-Measure85.5Unverified
3BATMANMean Jaccard & F-Measure85Unverified
4AOTMean Jaccard & F-Measure84.1Unverified
5RPCMVOSMean Jaccard & F-Measure83.9Unverified
6MobileVOSMean Jaccard & F-Measure83.3Unverified
7STCNMean Jaccard & F-Measure82.7Unverified
8CFBI+Mean Jaccard & F-Measure82.6Unverified
9SSTMean Jaccard & F-Measure81.8Unverified
10CFBIMean Jaccard & F-Measure81Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7Unverified
2ViTAE-T-StageJaccard (Mean)79.4Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4Unverified
4VOSwL (Mask+Language)mIoU59Unverified
5UniTrackmIoU58.4Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6Unverified
2Cutie-baseAverage IOU74.6Unverified
3XMemAverage IOU70.4Unverified
4SAM 2Average IOU69.5Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3Unverified
2oursJaccard (Mean)76.7Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9Unverified
2FEELVOSmIoU0.82Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9Unverified