SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 895 papers

TitleStatusHype
SeC: Advancing Complex Video Object Segmentation via Progressive Concept Construction—0
Memory-Augmented SAM2 for Training-Free Surgical Video Segmentation—0
MUVOD: A Novel Multi-view Video Object Segmentation Dataset and A Benchmark for 3D Segmentation—0
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and GrounderCode1
CogGen: A Learner-Centered Generative AI Architecture for Intelligent Tutoring with Programming Video—0
Leader360V: The Large-scale, Real-world 360 Video Dataset for Multi-task Learning in Diverse Environment—0
A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects—0
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Q-SAM2: Accurate Quantization for Segment Anything Model 2—0
THU-Warwick Submission for EPIC-KITCHEN Challenge 2025: Semi-Supervised Video Object Segmentation—0
VideoMolmo: Spatio-Temporal Grounding Meets PointingCode2
InterRVOS: Interaction-aware Referring Video Object Segmentation—0
SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training CostCode1
Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System CollaborationCode2
OmniFall: A Unified Staged-to-Wild Benchmark for Human Fall DetectionCode0
ThinkVideo: High-Quality Reasoning Video Segmentation with Chain of ThoughtsCode0
Unlocking the Power of SAM 2 for Few-Shot SegmentationCode1
FlowCut: Unsupervised Video Instance Segmentation via Temporal Mask Matching—0
Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video Object Segmentation—0
VolE: A Point-cloud Framework for Food 3D Reconstruction and Volume Estimation—0
6D Pose Estimation on Spoons and Hands—0
Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2Code1
TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in ActionCode1
MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection—0
RGB-D Video Object Segmentation via Enhanced Multi-store Feature Memory—0
Few-Shot Referring Video Single- and Multi-Object Segmentation via Cross-Modal Affinity with Instance Sequence MatchingCode0
DC-SAM: In-Context Segment Anything in Images and Videos via Dual ConsistencyCode1
PVUW 2025 Challenge Report: Advances in Pixel-level Understanding of Complex Videos in the Wild—0
MASSeg : 2nd Technical Report for 4th PVUW MOSE TrackCode0
FVOS for MOSE Track of 4th PVUW Challenge: 3rd Place Solution—0
STSeg-Complex Video Object Segmentation: The 1st Solution for 4th PVUW MOSE Challenge—0
Multi-person Physics-based Pose Estimation for Combat Sports—0
GLUS: Global-Local Reasoning Unified into A Single Large Language Model for Video SegmentationCode2
Saliency-Motion Guided Trunk-Collateral Network for Unsupervised Video Object Segmentation—0
The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video SegmentationCode5
MedSAM2: Segment Anything in 3D Medical Images and VideosCode4
CamoSAM2: Motion-Appearance Induced Auto-Refining Prompts for Video Camouflaged Object Detection—0
Zero-Shot 4D Lidar Panoptic Segmentation—0
4th PVUW MeViS 3rd Place Report: Sa2VACode5
ReferDINO-Plus: 2nd Solution for 4th PVUW MeViS Challenge at CVPR 2025Code0
Comparative Analysis of Image, Video, and Audio Classifiers for Automated News Video Segmentation—0
Online Reasoning Video Segmentation with Just-in-Time Digital Twins—0
Exploiting Temporal State Space Sharing for Video Semantic SegmentationCode1
CamSAM2: Segment Anything Accurately in Camouflaged VideosCode1
One-Shot Medical Video Object Segmentation via Temporal Contrastive Memory NetworksCode0
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous FlightCode1
Reducing Annotation Burden: Exploiting Image Knowledge for Few-Shot Medical Video Object Segmentation via Spatiotemporal Consistency RelearningCode0
Leveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and TrackingCode0
SAM2 for Image and Video Segmentation: A Comprehensive Survey—0
AUTV: Creating Underwater Video Datasets with Pixel-wise Annotations—0
Show:102550
← PrevPage 1 of 18Next →
All datasetsCityscapes valCamVidVSPWLaRSMultispectral Video Semantic Segmentation

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3—Unverified
2TDNet-50 [9]mIoU79.9—Unverified
3DeltaDist-DDRNet-39mIoU79.9—Unverified
4PSPNet-101 [20]mIoU79.7—Unverified
5PSPNet-50 [20]mIoU78.1—Unverified
6LVS [12]mIoU76.8—Unverified
7GRFP [15]mIoU73.6—Unverified
8FCN-50 [14]mIoU70.1—Unverified
9DFF [22]mIoU69.2—Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5—Unverified
2ETC-MobileNetMean IoU76.3—Unverified
3TDNet-50Mean IoU76.2—Unverified
4PSPNet-50Mean IoU76—Unverified
5NetwarpMean IoU74.7—Unverified
6GRFPMean IoU67.1—Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8—Unverified
2UniVS(Swin-L)mIoU59.8—Unverified
3Tube-Link(Swin-large)mIoU59.6—Unverified
4MRCFA(MiT-B5)mIoU49.9—Unverified
5CFFM(MiT-B5)mIoU49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1—Unverified
2TMANet (ResNet-50)Q57.5—Unverified
3CSANet (ResNet-101)Q49.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52—Unverified
2MVNet(PSPNet)mIoU54.36—Unverified
3MVNet(FCN)mIoU53.9—Unverified