SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 76–100 of 895 papers

TitleStatusHype
Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and VideosCode5
Segment Anything Model for Zero-shot Single Particle Tracking in Liquid Phase Transmission Electron MicroscopyCode0
EntitySAM: Segment Everything in Video—0
Semantic and Sequential Alignment for Referring Video Object Segmentation—0
VideoGLaMM : A Large Multimodal Model for Pixel-Level Visual Grounding in Videos—0
DTOS: Dynamic Time Object Sensing with Large Multimodal ModelCode0
Decoupled Motion Expression Video Segmentation—0
HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual PerceiverCode2
VidSeg: Training-free Video Semantic Segmentation based on Diffusion Models—0
Is Segment Anything Model 2 All You Need for Surgery Video Segmentation? A Systematic Evaluation—0
Generative Video Propagation—0
When SAM2 Meets Video Shadow and Mirror DetectionCode0
InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language ModelsCode2
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Towards Open-Vocabulary Video Semantic SegmentationCode1
Static-Dynamic Class-level Perception Consistency in Video Semantic Segmentation—0
Collaborative Hybrid Propagator for Temporal Misalignment in Audio-Visual Segmentation—0
Stable Mean Teacher for Semi-supervised Video Action DetectionCode0
Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any GranularityCode2
Video Decomposition Prior: A Methodology to Decompose Videos into Layers—0
Referring Video Object Segmentation via Language-aligned Track SelectionCode1
Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different ScenesCode3
Multi-Granularity Video Object SegmentationCode1
Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation—0
Det-SAM2:Technical Report on the Self-Prompting Segmentation Framework Based on Segment Anything Model 2Code2
Show:102550
← PrevPage 4 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3—Unverified
2TDNet-50 [9]mIoU79.9—Unverified
3DeltaDist-DDRNet-39mIoU79.9—Unverified
4PSPNet-101 [20]mIoU79.7—Unverified
5PSPNet-50 [20]mIoU78.1—Unverified
6LVS [12]mIoU76.8—Unverified
7GRFP [15]mIoU73.6—Unverified
8FCN-50 [14]mIoU70.1—Unverified
9DFF [22]mIoU69.2—Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5—Unverified
2ETC-MobileNetMean IoU76.3—Unverified
3TDNet-50Mean IoU76.2—Unverified
4PSPNet-50Mean IoU76—Unverified
5NetwarpMean IoU74.7—Unverified
6GRFPMean IoU67.1—Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8—Unverified
2UniVS(Swin-L)mIoU59.8—Unverified
3Tube-Link(Swin-large)mIoU59.6—Unverified
4MRCFA(MiT-B5)mIoU49.9—Unverified
5CFFM(MiT-B5)mIoU49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1—Unverified
2TMANet (ResNet-50)Q57.5—Unverified
3CSANet (ResNet-101)Q49.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52—Unverified
2MVNet(PSPNet)mIoU54.36—Unverified
3MVNet(FCN)mIoU53.9—Unverified