SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 201250 of 895 papers

TitleStatusHype
Guided Interactive Video Object Segmentation Using Reliability-Based Attention MapsCode1
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence LearningCode1
Semantic-Aware Fine-Grained CorrespondenceCode1
Pyramid Scene Parsing NetworkCode1
DVIS++: Improved Decoupled Framework for Universal Video SegmentationCode1
Referring Video Object Segmentation via Language-aligned Track SelectionCode1
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Contrastive Transformation for Self-supervised Correspondence LearningCode1
ActionVOS: Actions as Prompts for Video Object SegmentationCode1
Polygonal Point Set TrackingCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
Full-Duplex Strategy for Video Object SegmentationCode1
Spectrum-guided Multi-granularity Referring Video Object SegmentationCode1
A Simple and Powerful Global Optimization for Unsupervised Video Object SegmentationCode1
Efficient Multimodal Semantic Segmentation via Dual-Prompt LearningCode1
BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in VideoCode1
Efficient Regional Memory Network for Video Object SegmentationCode1
Efficient Semantic Segmentation by Altering Resolutions for Compressed VideosCode1
Efficient Semantic Video Segmentation with Per-frame InferenceCode1
General and Task-Oriented Video SegmentationCode1
Stochastic positional embeddings improve masked image modelingCode1
Context-Aware Relative Object Queries To Unify Video Instance and Panoptic SegmentationCode1
Physarum Powered Differentiable Linear Programming Layers and ApplicationsCode1
Pixel-Level Bijective Matching for Video Object SegmentationCode1
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
Flow-based Video Segmentation for Human Head and ShouldersCode1
Mining Relations among Cross-Frame Affinities for Video Semantic SegmentationCode1
RankSeg: Adaptive Pixel Classification with Image Category Ranking for SegmentationCode1
End-to-End Referring Video Object Segmentation with Multimodal TransformersCode1
PolyFormer: Referring Image Segmentation as Sequential Polygon GenerationCode1
OnlineRefer: A Simple Online Baseline for Referring Video Object SegmentationCode1
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background IntegrationCode1
Modeling Motion with Multi-Modal Features for Text-Based Video SegmentationCode1
MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object SegmentationCode1
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object RelationsCode1
PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video SegmentationCode1
Motion-Attentive Transition for Zero-Shot Video Object SegmentationCode1
Collaborative Video Object Segmentation by Foreground-Background IntegrationCode1
Fast Video Object Segmentation using the Global Context ModuleCode1
Exploiting Temporal State Space Sharing for Video Semantic SegmentationCode1
Tracking with Human-Intent ReasoningCode1
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object SegmentationCode1
Exploring the Semi-supervised Video Object Segmentation Problem from a Cyclic PerspectiveCode1
Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence RewardCode1
Multi-Granularity Video Object SegmentationCode1
1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object SegmentationCode1
FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical FlowCode1
Learning Local and Global Temporal Contexts for Video Semantic SegmentationCode1
Online Model Distillation for Efficient Video InferenceCode1
Show:102550
← PrevPage 5 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2DeltaDist-DDRNet-39mIoU79.9Unverified
3TDNet-50 [9]mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified