SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 101150 of 895 papers

TitleStatusHype
VideoMAC: Video Masked Autoencoders Meet ConvNetsCode1
Lester: rotoscope animation through video object segmentation and trackingCode1
We're Not Using Videos Effectively: An Updated Domain Adaptive Video Segmentation BaselineCode1
1st Place Solution for 5th LSVOS Challenge: Referring Video Object SegmentationCode1
Tracking with Human-Intent ReasoningCode1
DVIS++: Improved Decoupled Framework for Universal Video SegmentationCode1
AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace PlatformCode1
Efficient Multimodal Semantic Segmentation via Dual-Prompt LearningCode1
A Simple Video Segmenter by Tracking Objects Along Axial TrajectoriesCode1
Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object SegmentationCode1
SEGIC: Unleashing the Emergent Correspondence for In-Context SegmentationCode1
Unified Domain Adaptive Semantic SegmentationCode1
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
Mask Propagation for Efficient Video Semantic SegmentationCode1
Treating Motion as Option with Output Selection for Unsupervised Video Object SegmentationCode1
MediViSTA: Medical Video Segmentation via Temporal Fusion SAM Adaptation for EchocardiographyCode1
PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video SegmentationCode1
GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video SegmentationCode1
CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video SegmentationCode1
Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and SegmentationCode1
LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and BenchmarkCode1
Isomer: Isomerous Transformer for Zero-shot Video Object SegmentationCode1
Stochastic positional embeddings improve masked image modelingCode1
Spectrum-guided Multi-granularity Referring Video Object SegmentationCode1
OnlineRefer: A Simple Online Baseline for Referring Video Object SegmentationCode1
NVDS+: Towards Efficient and Versatile Neural Stabilizer for Video Depth EstimationCode1
RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object SegmentationCode1
LoSh: Long-Short Text Joint Prediction Network for Referring Video Object SegmentationCode1
3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPWCode1
SOC: Semantic-Assisted Object Cluster for Referring Video Object SegmentationCode1
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object SegmentationCode1
UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything ModelCode1
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual GroupingCode1
Segment Everything Everywhere All at OnceCode1
Boosting Video Object Segmentation via Space-time Correspondence LearningCode1
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking TasksCode1
Reliability-Hierarchical Memory Network for Scribble-Supervised Video Object SegmentationCode1
CrOC: Cross-View Online Clustering for Dense Visual Representation LearningCode1
Tube-Link: A Flexible Cross Tube Framework for Universal Video SegmentationCode1
Two-shot Video Object SegmentationCode1
Adaptive Multi-source Predictor for Zero-shot Video Object SegmentationCode1
Global Knowledge Calibration for Fast Open-Vocabulary SegmentationCode1
Guided Slot Attention for Unsupervised Video Object SegmentationCode1
Efficient Semantic Segmentation by Altering Resolutions for Compressed VideosCode1
Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance SegmentationCode1
PolyFormer: Referring Image Segmentation as Sequential Polygon GenerationCode1
Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot InteractionCode1
TarViS: A Unified Approach for Target-based Video SegmentationCode1
End-to-End Video Matting With Trimap PropagationCode1
Show:102550
← PrevPage 3 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified