SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 151200 of 895 papers

TitleStatusHype
Kernelized Memory Network for Video Object SegmentationCode1
Language-Bridged Spatial-Temporal Interaction for Referring Video Object SegmentationCode1
D2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in VideosCode1
D^2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in VideosCode1
Isomer: Isomerous Transformer for Zero-shot Video Object SegmentationCode1
DVIS++: Improved Decoupled Framework for Universal Video SegmentationCode1
Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and SegmentationCode1
Actor and Action Video Segmentation from a SentenceCode1
Interactive Video Object Segmentation Using Global and Local Transfer ModulesCode1
Unified Domain Adaptive Semantic SegmentationCode1
1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video SegmentationCode1
DC-SAM: In-Context Segment Anything in Images and Videos via Dual ConsistencyCode1
Adaptive Multi-source Predictor for Zero-shot Video Object SegmentationCode1
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and GrounderCode1
Joint Inductive and Transductive Learning for Video Object SegmentationCode1
LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and BenchmarkCode1
Learning Dynamic Network Using a Reuse Gate Function in Semi-supervised Video Object SegmentationCode1
Cross-Modal Progressive Comprehension for Referring SegmentationCode1
Deep Feature Flow for Video RecognitionCode1
Local-Global Context Aware Transformer for Language-Guided Video SegmentationCode1
LVOS: A Benchmark for Long-term Video Object SegmentationCode1
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
CrOC: Cross-View Online Clustering for Dense Visual Representation LearningCode1
Making a Case for 3D Convolutions for Object Segmentation in VideosCode1
A Survey on Deep Learning Technique for Video SegmentationCode1
In-N-Out Generative Learning for Dense Unsupervised Video SegmentationCode1
AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace PlatformCode1
Delving Deep Into Many-to-Many Attention for Few-Shot Video Object SegmentationCode1
Associating Objects with Transformers for Video Object SegmentationCode1
Dense Unsupervised Learning for Video SegmentationCode1
Active Boundary Loss for Semantic SegmentationCode1
A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic InformationCode1
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
Learning Fast and Robust Target Models for Video Object SegmentationCode1
3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPWCode1
Differentiable Soft-Masked AttentionCode1
Contrastive Transformation for Self-supervised Correspondence LearningCode1
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware FusionCode1
ActionVOS: Actions as Prompts for Video Object SegmentationCode1
Learning Spatio-Appearance Memory Network for High-Performance Visual TrackingCode1
Hierarchical Memory Matching Network for Video Object SegmentationCode1
Guided Slot Attention for Unsupervised Video Object SegmentationCode1
Efficient Regional Memory Network for Video Object SegmentationCode1
A Simple and Powerful Global Optimization for Unsupervised Video Object SegmentationCode1
Hierarchical Feature Alignment Network for Unsupervised Video Object SegmentationCode1
Domain Adaptive Video Segmentation via Temporal Consistency RegularizationCode1
Domain Adaptive Video Segmentation via Temporal Pseudo SupervisionCode1
Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object MixingCode1
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous FlightCode1
Context-Aware Relative Object Queries To Unify Video Instance and Panoptic SegmentationCode1
Show:102550
← PrevPage 4 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified