SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 501550 of 895 papers

TitleStatusHype
Robust and Efficient Memory Network for Video Object Segmentation0
Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detection0
Motion-state Alignment for Video Semantic Segmentation0
MED-VT++: Unifying Multimodal Learning with a Multiscale Encoder-Decoder Video Transformer0
Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentation0
CLVOS23: A Long Video Object Segmentation Dataset for Continual LearningCode0
Co-attention Propagation Network for Zero-Shot Video Object SegmentationCode0
Spatio-Temporal Pixel-Level Contrastive Learning-based Source-Free Domain Adaptation for Video Semantic SegmentationCode0
Unified Mask Embedding and Correspondence Learning for Self-Supervised Video SegmentationCode0
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation0
A Threefold Review on Deep Semantic Segmentation: Efficiency-oriented, Temporal and Depth-aware design0
Tsanet: Temporal and Scale Alignment for Unsupervised Video Object Segmentation0
Learning to Adapt to Online Streams with Distribution Shifts0
One-Shot Video Inpainting0
Approximating DTW with a convolutional neural network on EEG data0
Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation0
Flow-guided Semi-supervised Video Object Segmentation0
A Comprehensive Review of Modern Object Segmentation Approaches0
Video Semantic Segmentation with Inter-Frame Feature Fusion and Inner-Frame Feature RefinementCode0
Object Segmentation with Audio Context0
Robust Referring Video Object Segmentation with Cyclic Structural Consensus0
NewsNet: A Novel Dataset for Hierarchical Temporal SegmentationCode0
Simultaneously Short- and Long-Term Temporal Modeling for Semi-Supervised Video Semantic Segmentation0
HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation0
Alignment Before Aggregation: Trajectory Memory Retrieval Network for Video Object Segmentation0
Unsupervised Video Object Segmentation with Online Adversarial Self-Tuning0
Segment Every Reference Object in Spatial and Temporal Spaces0
Video State-Changing Object SegmentationCode0
SegGPT: Towards Segmenting Everything in Context0
A Class-wise Non-salient Region Generalized Framework for Video Semantic Segmentation0
Video Segmentation Learning Using Cascade Residual Convolutional Neural Network0
Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy0
Learning a Fast 3D Spectral Approach to Object Segmentation and Tracking over Space and Time0
Look Before You Match: Instance Understanding Matters in Video Object Segmentation0
Breaking the "Object" in Video Object Segmentation0
Tencent AVS: A Holistic Ads Video Dataset for Multi-modal Scene Segmentation0
Video Object of Interest Segmentation0
Robust Online Video Instance Segmentation with Track QueriesCode0
Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview0
Efficient Unsupervised Video Object Segmentation Network Based on Motion Guidance0
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments0
Quantifying and Learning Static vs. Dynamic Information in Deep Spatiotemporal Networks0
Two-Level Temporal Relation Model for Online Video Instance SegmentationCode0
Self-supervised Amodal Video Object SegmentationCode0
EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddle0
Motion-inductive Self-supervised Object Discovery in Videos0
Pixel-Level Equalized Matching for Video Object Segmentation0
TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut0
Hierarchical Reinforcement Learning Based Video Semantic Coding for Segmentation0
Efficient Heterogeneous Video Segmentation at the Edge0
Show:102550
← PrevPage 11 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified