SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 5175 of 895 papers

TitleStatusHype
MemSAM: Taming Segment Anything Model for Echocardiography Video SegmentationCode2
Scalable Video Object Segmentation with Identification MechanismCode2
Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video Object SegmentationCode2
MeViS: A Large-scale Benchmark for Video Segmentation with Motion ExpressionsCode2
Mask2Former for Video Instance SegmentationCode2
Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object SegmentationCode2
InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language ModelsCode2
DVIS-DAQ: Improving Video Segmentation via Dynamic Anchor QueriesCode2
MCIBI++: Soft Mining Contextual Information Beyond Image for Semantic SegmentationCode2
IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet VideosCode2
Find First, Track Next: Decoupling Identification and Propagation in Referring Video Object SegmentationCode2
Efficient Video Object Segmentation via Modulated Cross-Attention MemoryCode2
GLUS: Global-Local Reasoning Unified into A Single Large Language Model for Video SegmentationCode2
In Defense of Online Models for Video Instance SegmentationCode2
Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any GranularityCode2
HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual PerceiverCode2
Efficient Multimodal Semantic Segmentation via Dual-Prompt LearningCode1
1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object SegmentationCode1
Efficient Regional Memory Network for Video Object SegmentationCode1
AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic SegmentationCode1
Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2Code1
Efficient Semantic Segmentation by Altering Resolutions for Compressed VideosCode1
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
DVIS++: Improved Decoupled Framework for Universal Video SegmentationCode1
AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace PlatformCode1
Show:102550
← PrevPage 3 of 36Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2DeltaDist-DDRNet-39mIoU79.9Unverified
3TDNet-50 [9]mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified