SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 101125 of 895 papers

TitleStatusHype
Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation0
RoMo: Robust Motion Segmentation Improves Structure from Motion0
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video SegmentationCode3
Geometric Algebra Planes: Convex Implicit Neural Volumes0
ClickTrack: Towards Real-time Interactive Single Object Tracking0
IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet VideosCode2
Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level0
Zero-shot capability of SAM-family models for bone segmentation in CT scans0
GaussianCut: Interactive segmentation via graph cut for 3D Gaussian Splatting0
MSEG-VCUQ: Multimodal SEGmentation with Enhanced Vision Foundation Models, Convolutional Neural Networks, and Uncertainty Quantification for High-Speed Video Phase Detection DataCode0
Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters0
VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videos0
LiVOS: Light Video Object Segmentation with Gated Linear MatchingCode1
Event-guided Low-light Video Semantic Segmentation0
Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI SegmentationCode0
Addressing Issues with Working Memory in Video Object Segmentation0
SMITE: Segment Me In TimECode3
VideoSAM: A Large Vision Foundation Model for High-Speed Video SegmentationCode0
SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory TreeCode4
Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentation0
Configurable Embodied Data Generation for Class-Agnostic RGB-D Video Segmentation0
VideoSAM: Open-World Video Segmentation0
Shift and matching queries for video semantic segmentation0
One Token to Seg Them All: Language Instructed Reasoning Segmentation in VideosCode2
X-Prompt: Multi-modal Visual Prompt for Video Object SegmentationCode1
Show:102550
← PrevPage 5 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified