SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 101150 of 895 papers

TitleStatusHype
Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence LearningCode1
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object RelationsCode1
Exploiting Temporal State Space Sharing for Video Semantic SegmentationCode1
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object SegmentationCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
Learning Object Depth from Camera Motion and Video Object SegmentationCode1
Exploring the Semi-supervised Video Object Segmentation Problem from a Cyclic PerspectiveCode1
BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in VideoCode1
Learning Video Object Segmentation from Unlabeled VideosCode1
CamSAM2: Segment Anything Accurately in Camouflaged VideosCode1
Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object SegmentationCode1
Efficient Semantic Video Segmentation with Per-frame InferenceCode1
CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video SegmentationCode1
General and Task-Oriented Video SegmentationCode1
LVOS: A Benchmark for Long-term Video Object SegmentationCode1
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Interactive Video Object Segmentation Using Global and Local Transfer ModulesCode1
Making a Case for 3D Convolutions for Object Segmentation in VideosCode1
A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic InformationCode1
AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic SegmentationCode1
Clockwork Convnets for Video Semantic SegmentationCode1
MATNet: Motion-Attentive Transition Network for Zero-Shot Video Object SegmentationCode1
Efficient Regional Memory Network for Video Object SegmentationCode1
Learning Local and Global Temporal Contexts for Video Semantic SegmentationCode1
AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace PlatformCode1
MediViSTA: Medical Video Segmentation via Temporal Fusion SAM Adaptation for EchocardiographyCode1
Efficient Multimodal Semantic Segmentation via Dual-Prompt LearningCode1
Efficient Semantic Segmentation by Altering Resolutions for Compressed VideosCode1
Isomer: Isomerous Transformer for Zero-shot Video Object SegmentationCode1
DVIS++: Improved Decoupled Framework for Universal Video SegmentationCode1
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking TasksCode1
Adaptive Multi-source Predictor for Zero-shot Video Object SegmentationCode1
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video SegmentationCode1
End-to-End Referring Video Object Segmentation with Multimodal TransformersCode1
In-N-Out Generative Learning for Dense Unsupervised Video SegmentationCode1
Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and SegmentationCode1
Joint Inductive and Transductive Learning for Video Object SegmentationCode1
Attention-guided Temporally Coherent Video Object MattingCode1
A Transductive Approach for Video Object SegmentationCode1
Domain Adaptive Video Segmentation via Temporal Consistency RegularizationCode1
Actor and Action Video Segmentation from a SentenceCode1
Domain Adaptive Video Segmentation via Temporal Pseudo SupervisionCode1
Cross-Modal Progressive Comprehension for Referring SegmentationCode1
Learning Dynamic Network Using a Reuse Gate Function in Semi-supervised Video Object SegmentationCode1
CrOC: Cross-View Online Clustering for Dense Visual Representation LearningCode1
A Survey on Deep Learning Technique for Video SegmentationCode1
Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object MixingCode1
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous FlightCode1
Differentiable Soft-Masked AttentionCode1
Show:102550
← PrevPage 3 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified