SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 351400 of 895 papers

TitleStatusHype
Spatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic SegmentationCode0
CrOC: Cross-View Online Clustering for Dense Visual Representation LearningCode1
Tube-Link: A Flexible Cross Tube Framework for Universal Video SegmentationCode1
Two-shot Video Object SegmentationCode1
Adaptive Multi-source Predictor for Zero-shot Video Object SegmentationCode1
Unified Mask Embedding and Correspondence Learning for Self-Supervised Video SegmentationCode0
Global Knowledge Calibration for Fast Open-Vocabulary SegmentationCode1
Guided Slot Attention for Unsupervised Video Object SegmentationCode1
InstMove: Instance Motion for Object-centric Video SegmentationCode2
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation0
Efficient Semantic Segmentation by Altering Resolutions for Compressed VideosCode1
Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentation0
A Threefold Review on Deep Semantic Segmentation: Efficiency-oriented, Temporal and Depth-aware design0
Learning to Adapt to Online Streams with Distribution Shifts0
One-Shot Video Inpainting0
Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance SegmentationCode1
PolyFormer: Referring Image Segmentation as Sequential Polygon GenerationCode1
Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot InteractionCode1
MOSE: A New Dataset for Video Object Segmentation in Complex ScenesCode2
Audio-Visual Segmentation with SemanticsCode2
Approximating DTW with a convolutional neural network on EEG data0
Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation0
Flow-guided Semi-supervised Video Object Segmentation0
A Comprehensive Review of Modern Object Segmentation Approaches0
Video Semantic Segmentation with Inter-Frame Feature Fusion and Inner-Frame Feature RefinementCode0
TarViS: A Unified Approach for Target-based Video SegmentationCode1
Object Segmentation with Audio Context0
SegGPT: Towards Segmenting Everything in Context0
Unsupervised Video Object Segmentation with Online Adversarial Self-Tuning0
Video State-Changing Object SegmentationCode0
Robust Referring Video Object Segmentation with Cyclic Structural Consensus0
HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation0
Video Object Segmentation-aware Video Frame InterpolationCode1
Alignment Before Aggregation: Trajectory Memory Retrieval Network for Video Object Segmentation0
Segment Every Reference Object in Spatial and Temporal Spaces0
End-to-End Video Matting With Trimap PropagationCode1
Multispectral Video Semantic Segmentation: A Benchmark Dataset and BaselineCode1
Simultaneously Short- and Long-Term Temporal Modeling for Semi-Supervised Video Semantic Segmentation0
Context-Aware Relative Object Queries To Unify Video Instance and Panoptic SegmentationCode1
NewsNet: A Novel Dataset for Hierarchical Temporal SegmentationCode0
A Class-wise Non-salient Region Generalized Framework for Video Semantic Segmentation0
1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object SegmentationCode1
Video Segmentation Learning Using Cascade Residual Convolutional Neural Network0
Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy0
Learning a Fast 3D Spectral Approach to Object Segmentation and Tracking over Space and Time0
Look Before You Match: Instance Understanding Matters in Video Object Segmentation0
Breaking the "Object" in Video Object Segmentation0
Tencent AVS: A Holistic Ads Video Dataset for Multi-modal Scene Segmentation0
Video Object of Interest Segmentation0
Learning to Learn Better for Video Object SegmentationCode1
Show:102550
← PrevPage 8 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified