SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 125 of 895 papers

TitleStatusHype
SeC: Advancing Complex Video Object Segmentation via Progressive Concept Construction0
Memory-Augmented SAM2 for Training-Free Surgical Video Segmentation0
MUVOD: A Novel Multi-view Video Object Segmentation Dataset and A Benchmark for 3D Segmentation0
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and GrounderCode1
CogGen: A Learner-Centered Generative AI Architecture for Intelligent Tutoring with Programming Video0
Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environment0
A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects0
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Q-SAM2: Accurate Quantization for Segment Anything Model 20
THU-Warwick Submission for EPIC-KITCHEN Challenge 2025: Semi-Supervised Video Object Segmentation0
VideoMolmo: Spatio-Temporal Grounding Meets PointingCode2
InterRVOS: Interaction-aware Referring Video Object Segmentation0
SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training CostCode1
Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System CollaborationCode2
OmniFall: A Unified Staged-to-Wild Benchmark for Human Fall DetectionCode0
ThinkVideo: High-Quality Reasoning Video Segmentation with Chain of ThoughtsCode0
Unlocking the Power of SAM 2 for Few-Shot SegmentationCode1
FlowCut: Unsupervised Video Instance Segmentation via Temporal Mask Matching0
Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video Object Segmentation0
VolE: A Point-cloud Framework for Food 3D Reconstruction and Volume Estimation0
6D Pose Estimation on Spoons and Hands0
Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2Code1
TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in ActionCode1
MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection0
RGB-D Video Object Segmentation via Enhanced Multi-store Feature Memory0
Show:102550
← PrevPage 1 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified