SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 51100 of 895 papers

TitleStatusHype
MemSAM: Taming Segment Anything Model for Echocardiography Video SegmentationCode2
UniRef++: Segment Every Reference Object in Spatial and Temporal SpacesCode2
MeViS: A Large-scale Benchmark for Video Segmentation with Motion ExpressionsCode2
XMem++: Production-level Video Segmentation From Few Annotated FramesCode2
Tracking Anything in High QualityCode2
Video Object Segmentation in Panoptic Wild ScenesCode2
InstMove: Instance Motion for Object-centric Video SegmentationCode2
MOSE: A New Dataset for Video Object Segmentation in Complex ScenesCode2
Audio-Visual Segmentation with SemanticsCode2
Decoupling Features in Hierarchical Propagation for Video Object SegmentationCode2
MCIBI++: Soft Mining Contextual Information Beyond Image for Semantic SegmentationCode2
In Defense of Online Models for Video Instance SegmentationCode2
Scalable Video Object Segmentation with Identification MechanismCode2
Language as Queries for Referring Video Object SegmentationCode2
Mask2Former for Video Instance SegmentationCode2
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language TranslationCode2
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and GrounderCode1
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training CostCode1
Unlocking the Power of SAM 2 for Few-Shot SegmentationCode1
Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2Code1
TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in ActionCode1
DC-SAM: In-Context Segment Anything in Images and Videos via Dual ConsistencyCode1
Exploiting Temporal State Space Sharing for Video Semantic SegmentationCode1
CamSAM2: Segment Anything Accurately in Camouflaged VideosCode1
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous FlightCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
SASVi - Segment Any Surgical VideoCode1
MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object SegmentationCode1
Few-shot Structure-Informed Machinery Part Segmentation with Foundation Models and Graph Neural NetworksCode1
Learning Motion and Temporal Cues for Unsupervised Video Object SegmentationCode1
VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video CaptioningCode1
M^3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object SegmentationCode1
Towards Open-Vocabulary Video Semantic SegmentationCode1
Referring Video Object Segmentation via Language-aligned Track SelectionCode1
Multi-Granularity Video Object SegmentationCode1
LiVOS: Light Video Object Segmentation with Gated Linear MatchingCode1
X-Prompt: Multi-modal Visual Prompt for Video Object SegmentationCode1
ViLLa: Video Reasoning Segmentation with Large Language ModelCode1
ActionVOS: Actions as Prompts for Video Object SegmentationCode1
General and Task-Oriented Video SegmentationCode1
Video Inpainting Localization with Contrastive LearningCode1
SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp SegmentationCode1
1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video SegmentationCode1
Event-assisted Low-Light Video Object SegmentationCode1
Temporally Consistent Referring Video Object Segmentation with Hybrid MemoryCode1
Video Object Segmentation with Dynamic Query ModulationCode1
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object SegmentationCode1
Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment AnythingCode1
Depth-aware Test-Time Training for Zero-shot Video Object SegmentationCode1
Show:102550
← PrevPage 2 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2DeltaDist-DDRNet-39mIoU79.9Unverified
3TDNet-50 [9]mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified