SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 76100 of 895 papers

TitleStatusHype
Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and VideosCode5
Segment Anything Model for Zero-shot Single Particle Tracking in Liquid Phase Transmission Electron MicroscopyCode0
EntitySAM: Segment Everything in Video0
Semantic and Sequential Alignment for Referring Video Object Segmentation0
VideoGLaMM : A Large Multimodal Model for Pixel-Level Visual Grounding in Videos0
DTOS: Dynamic Time Object Sensing with Large Multimodal ModelCode0
Decoupled Motion Expression Video Segmentation0
HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual PerceiverCode2
VidSeg: Training-free Video Semantic Segmentation based on Diffusion Models0
Is Segment Anything Model 2 All You Need for Surgery Video Segmentation? A Systematic Evaluation0
Generative Video Propagation0
When SAM2 Meets Video Shadow and Mirror DetectionCode0
InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language ModelsCode2
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Towards Open-Vocabulary Video Semantic SegmentationCode1
Static-Dynamic Class-level Perception Consistency in Video Semantic Segmentation0
Collaborative Hybrid Propagator for Temporal Misalignment in Audio-Visual Segmentation0
Stable Mean Teacher for Semi-supervised Video Action DetectionCode0
Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any GranularityCode2
Video Decomposition Prior: A Methodology to Decompose Videos into Layers0
Referring Video Object Segmentation via Language-aligned Track SelectionCode1
Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different ScenesCode3
Multi-Granularity Video Object SegmentationCode1
Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation0
Det-SAM2:Technical Report on the Self-Prompting Segmentation Framework Based on Segment Anything Model 2Code2
Show:102550
← PrevPage 4 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified