SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 151175 of 895 papers

TitleStatusHype
Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2Code3
SAM 2: Segment Anything in Images and VideosCode12
Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object SegmentationCode0
Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical videoCode0
ViLLa: Video Reasoning Segmentation with Large Language ModelCode1
FoodMem: Near Real-time and Precise Food Video Segmentation0
Improving Unsupervised Video Object Segmentation via Fake Flow Generation0
VISA: Reasoning Video Object Segmentation via Large Language ModelsCode3
Learning Spatial-Semantic Features for Robust Video Object Segmentation0
ActionVOS: Actions as Prompts for Video Object SegmentationCode1
General and Task-Oriented Video SegmentationCode1
Rethinking Image-to-Video Adaptation: An Object-centric Perspective0
Submodular video object proposal selection for semantic object segmentation0
Non-parametric Contextual Relationship Learning for Semantic Video Object Segmentation0
Context Propagation from Proposals for Semantic Video Object Segmentation0
DaBiT: Depth and Blur informed Transformer for Joint Refocusing and Super-ResolutionCode0
Deep Unfolding-Aided Parameter Tuning for Plug-and-Play-Based Video Snapshot Compressive Imaging0
MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generation0
Video Inpainting Localization with Contrastive LearningCode1
PVUW 2024 Challenge on Complex Video Understanding: Methods and ResultsCode4
Multimodal Segmentation for Vocal Tract Modeling0
2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation0
SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp SegmentationCode1
Trusted Video Inpainting Localization via Deep Attentive Noise LearningCode0
GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation0
Show:102550
← PrevPage 7 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified