SOTAVerified

Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Showing 101150 of 551 papers

TitleStatusHype
1st Place Solution for MOSE Track in CVPR 2024 PVUW Workshop: Complex Video Object Segmentation0
3rd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation0
Lifelong Learning Using a Dynamically Growing Tree of Sub-networks for Domain Generalization in Video Object Segmentation0
One-shot Training for Video Object Segmentation0
Harnessing Vision-Language Pretrained Models with Temporal-Aware Adaptation for Referring Video Object Segmentation0
DeVOS: Flow-Guided Deformable Transformer for Video Object Segmentation0
Global Motion Understanding in Large-Scale Video Object Segmentation0
Space-time Reinforcement Network for Video Object Segmentation0
LVOS: A Benchmark for Large-scale Long-term Video Object SegmentationCode2
360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos0
Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object SegmentationCode2
Moving Object Segmentation: All You Need Is SAM (and Flow)Code3
Spatial-Temporal Multi-level Association for Video Object Segmentation0
Event-assisted Low-Light Video Object SegmentationCode1
Temporally Consistent Referring Video Object Segmentation with Hybrid MemoryCode1
Annolid: Annotate, Segment, and Track Anything You NeedCode0
Efficient Video Object Segmentation via Modulated Cross-Attention MemoryCode2
PSALM: Pixelwise SegmentAtion with Large Multi-Modal ModelCode3
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object SegmentationCode1
Video Object Segmentation with Dynamic Query ModulationCode1
OneVOS: Unifying Video Object Segmentation with All-in-One Transformer Framework0
Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment AnythingCode1
ClickVOS: Click Video Object SegmentationCode0
Depth-aware Test-Time Training for Zero-shot Video Object SegmentationCode1
VideoMAC: Video Masked Autoencoders Meet ConvNetsCode1
UniVS: Unified and Universal Video Segmentation with Prompts as QueriesCode3
Lester: rotoscope animation through video object segmentation and trackingCode1
Moving Object Proposals with Deep Learned Optical Flow for Video Object Segmentation0
Point-VOS: Pointing Up Video Object Segmentation0
Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound0
Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention0
Vivim: a Video Vision Mamba for Medical Video SegmentationCode2
Explore Synergistic Interaction Across Frames for Interactive Video Object Segmentation0
Understanding Video Transformers via Universal Concept Discovery0
OMG-Seg: Is One Model Good Enough For All Segmentation?Code5
Learning to Segment Referred Objects from Narrated Egocentric Videos0
1st Place Solution for 5th LSVOS Challenge: Referring Video Object SegmentationCode1
Tracking with Human-Intent ReasoningCode1
UniRef++: Segment Every Reference Object in Spatial and Temporal SpacesCode2
No More Shortcuts: Realizing the Potential of Temporal Self-Supervision0
Hierarchical Graph Pattern Understanding for Zero-Shot VOSCode0
General Object Foundation Model for Images and Videos at ScaleCode3
TAM-VT: Transformation-Aware Multi-scale Video Transformer for Segmentation and Tracking0
Semi-supervised Active Learning for Video Action DetectionCode0
Flexible visual prompts for in-context learning in computer visionCode0
SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation0
VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models0
Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object SegmentationCode1
SEGIC: Unleashing the Emergent Correspondence for In-Context SegmentationCode1
Sketch-based Video Object Segmentation: Benchmark and Analysis0
Show:102550
← PrevPage 3 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)F-Score94.7Unverified
2ISVOS (BL30K, MS)J&F93.4Unverified
3XMem (BL30K, MS)J&F93.3Unverified
4BATMAN (val)J&F92.5Unverified
5STCN (val)J&F91.6Unverified
6XMemJ&F91.5Unverified
7MobileVOS (val)J&F91.4Unverified
8AOT (val)J&F91.1Unverified
9LCM (val)J&F90.7Unverified
10RPCMVOS (val)J&F90.6Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BLK30K, MS)Mean Jaccard & F-Measure89.5Unverified
2LCMF-measure86.5Unverified
3XMemMean Jaccard & F-Measure86.2Unverified
4BATMANMean Jaccard & F-Measure86.2Unverified
5STCNMean Jaccard & F-Measure85.4Unverified
6AOTMean Jaccard & F-Measure84.9Unverified
7STMF-measure84.3Unverified
8TransVOSMean Jaccard & F-Measure83.9Unverified
9RPCMVOSMean Jaccard & F-Measure83.7Unverified
10RMNMean Jaccard & F-Measure83.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure86.9Unverified
2AOTMean Jaccard & F-Measure84.1Unverified
3RPCMVOSMean Jaccard & F-Measure84Unverified
4STCNMean Jaccard & F-Measure83Unverified
5CFBI+Mean Jaccard & F-Measure82.8Unverified
6RMNJaccard (Seen)82.1Unverified
7LCMMean Jaccard & F-Measure82Unverified
8TransVOSMean Jaccard & F-Measure81.8Unverified
9SSTMean Jaccard & F-Measure81.7Unverified
10LWLMean Jaccard & F-Measure81.5Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K, MS)Mean Jaccard & F-Measure83.7Unverified
2XMemMean Jaccard & F-Measure81Unverified
3BATMANJaccard78.4Unverified
4AOTJaccard75.9Unverified
5RPCMVOSJaccard75.8Unverified
6LCMJaccard74.4Unverified
7KMNJaccard74.1Unverified
8TransVOSJaccard73Unverified
9STCNJaccard72.7Unverified
10RMNJaccard71.9Unverified
#ModelMetricClaimedVerifiedStatus
1XMem (BL30K,MS)Mean Jaccard & F-Measure86.8Unverified
2XMemMean Jaccard & F-Measure85.5Unverified
3BATMANMean Jaccard & F-Measure85Unverified
4AOTMean Jaccard & F-Measure84.1Unverified
5RPCMVOSMean Jaccard & F-Measure83.9Unverified
6MobileVOSMean Jaccard & F-Measure83.3Unverified
7STCNMean Jaccard & F-Measure82.7Unverified
8CFBI+Mean Jaccard & F-Measure82.6Unverified
9SSTMean Jaccard & F-Measure81.8Unverified
10CFBIMean Jaccard & F-Measure81Unverified
#ModelMetricClaimedVerifiedStatus
1AOC-MF (val)Jaccard (Mean)81.7Unverified
2ViTAE-T-StageJaccard (Mean)79.4Unverified
3DINO (ViT-B/8, ImageNet retrain)J&F71.4Unverified
4VOSwL (Mask+Language)mIoU59Unverified
5UniTrackmIoU58.4Unverified
#ModelMetricClaimedVerifiedStatus
1ReVOSAverage IOU75.6Unverified
2Cutie-baseAverage IOU74.6Unverified
3XMemAverage IOU70.4Unverified
4SAM 2Average IOU69.5Unverified
#ModelMetricClaimedVerifiedStatus
1DFNetF-Score82.3Unverified
2oursJaccard (Mean)76.7Unverified
#ModelMetricClaimedVerifiedStatus
1OursAverage74.9Unverified
2FEELVOSmIoU0.82Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU68.8Unverified
#ModelMetricClaimedVerifiedStatus
1CutieJ&F68.3Unverified
#ModelMetricClaimedVerifiedStatus
1LOCATEmIoU79.9Unverified