SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 125 of 895 papers

TitleStatusHype
SAM 2: Segment Anything in Images and VideosCode11
Segment Anything in Medical Images and Videos: Benchmark and DeploymentCode7
Efficient Track AnythingCode7
Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and VideosCode5
Underwater Camouflaged Object Tracking Meets Vision-Language SAM2Code5
4th PVUW MeViS 3rd Place Report: Sa2VACode5
Unleashing the Potential of SAM2 for Biomedical Images and Videos: A SurveyCode5
The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video SegmentationCode5
OMG-Seg: Is One Model Good Enough For All Segmentation?Code5
SiamMask: A Framework for Fast Online Object Tracking and SegmentationCode4
SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory TreeCode4
PVUW 2024 Challenge on Complex Video Understanding: Methods and ResultsCode4
SegGPT: Segmenting Everything In ContextCode4
MedSAM2: Segment Anything in 3D Medical Images and VideosCode4
EdgeTAM: On-Device Track Anything ModelCode4
SMITE: Segment Me In TimECode3
Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different ScenesCode3
Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2Code3
RAP-SAM: Towards Real-Time All-Purpose Segment AnythingCode3
Putting the Object Back into Video Object SegmentationCode3
Moving Object Segmentation: All You Need Is SAM (and Flow)Code3
Personalize Segment Anything Model with One ShotCode3
Min-Max Similarity: A Contrastive Semi-Supervised Deep Learning Network for Surgical Tools SegmentationCode3
PSALM: Pixelwise SegmentAtion with Large Multi-Modal ModelCode3
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video SegmentationCode3
Show:102550
← PrevPage 1 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2DeltaDist-DDRNet-39mIoU79.9Unverified
3TDNet-50 [9]mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified