SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 101–125 of 895 papers

TitleStatusHype
Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence LearningCode1
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object RelationsCode1
End-to-End Video Matting With Trimap PropagationCode1
Generic Event Boundary Detection: A Benchmark for Event SegmentationCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video SegmentationCode1
BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in VideoCode1
Guided Slot Attention for Unsupervised Video Object SegmentationCode1
CamSAM2: Segment Anything Accurately in Camouflaged VideosCode1
Event-assisted Low-Light Video Object SegmentationCode1
3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPWCode1
Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object SegmentationCode1
End-to-End Semi-Supervised Learning for Video Action DetectionCode1
Exploiting Temporal State Space Sharing for Video Semantic SegmentationCode1
A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic InformationCode1
AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic SegmentationCode1
Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and SegmentationCode1
Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2Code1
Cross-Modal Progressive Comprehension for Referring SegmentationCode1
Clockwork Convnets for Video Semantic SegmentationCode1
Accelerating Video Object Segmentation with Compressed VideoCode1
1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object SegmentationCode1
Learning Local and Global Temporal Contexts for Video Semantic SegmentationCode1
AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace PlatformCode1
Show:102550
← PrevPage 5 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3—Unverified
2TDNet-50 [9]mIoU79.9—Unverified
3DeltaDist-DDRNet-39mIoU79.9—Unverified
4PSPNet-101 [20]mIoU79.7—Unverified
5PSPNet-50 [20]mIoU78.1—Unverified
6LVS [12]mIoU76.8—Unverified
7GRFP [15]mIoU73.6—Unverified
8FCN-50 [14]mIoU70.1—Unverified
9DFF [22]mIoU69.2—Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5—Unverified
2ETC-MobileNetMean IoU76.3—Unverified
3TDNet-50Mean IoU76.2—Unverified
4PSPNet-50Mean IoU76—Unverified
5NetwarpMean IoU74.7—Unverified
6GRFPMean IoU67.1—Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8—Unverified
2UniVS(Swin-L)mIoU59.8—Unverified
3Tube-Link(Swin-large)mIoU59.6—Unverified
4MRCFA(MiT-B5)mIoU49.9—Unverified
5CFFM(MiT-B5)mIoU49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1—Unverified
2TMANet (ResNet-50)Q57.5—Unverified
3CSANet (ResNet-101)Q49.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52—Unverified
2MVNet(PSPNet)mIoU54.36—Unverified
3MVNet(FCN)mIoU53.9—Unverified