SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 551600 of 895 papers

TitleStatusHype
Visual Subtitle Feature Enhanced Video Outline Generation0
Two-Stream Networks for Object Segmentation in Videos0
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation0
Region Aware Video Object Segmentation with Deep Motion Modeling0
Personalized PCA: Decoupling Shared and Unique FeaturesCode0
MAC-DO: An Efficient Output-Stationary GEMM Accelerator for CNNs Using DRAM Technology0
The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation0
5th Place Solution for YouTube-VOS Challenge 2022: Video Object Segmentation0
Distortion-Aware Network Pruning and Feature Reuse for Real-time Video Segmentation0
An Image Processing Pipeline for Camera Trap Time-Lapse RecordingsCode0
A Machine Learning-based Segmentation Approach for Measuring Similarity between Sign Languages0
TubeFormer-DeepLab: Video Mask Transformer0
Collaborative Attention Memory Network for Video Object Segmentation0
Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion0
Boosting Video Object Segmentation based on Scale InconsistencyCode0
Representation Recycling for Streaming Video AnalysisCode0
Self-Supervised Video Object Segmentation via Cutout Prediction and Tagging0
Adaptive Memory Management for Video Object SegmentationCode0
3D Convolutional Networks for Action Recognition: Application to Sport Gesture Recognition0
Implicit Motion-Compensated Network for Unsupervised Video Object SegmentationCode0
Human Instance Segmentation and Tracking via Data Association and Single-stage Detector0
Deeply Interleaved Two-Stream Encoder for Referring Video Segmentation0
DNN-Driven Compressive Offloading for Edge-Assisted Semantic Video Segmentation0
Temporal Transductive Inference for Few-Shot Video Object SegmentationCode0
Delta Distillation for Efficient Video ProcessingCode0
Object discovery and representation networksCode0
Revisiting Click-based Interactive Video Object SegmentationCode0
Efficient Video Segmentation Models with Per-frame Inference0
Box Supervised Video Segmentation Proposal NetworkCode0
Borrowing from yourself: Faster future video segmentation with partial channel updateCode0
Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks0
Learning Pixel Trajectories with Multiscale Contrastive Random Walks0
YouMVOS: An Actor-Centric Multi-Shot Video Object Segmentation Dataset0
Multi-Level Representation Learning With Semantic Alignment for Referring Video Object Segmentation0
Real-Time, Accurate, and Consistent Video Semantic Segmentation via Unsupervised Adaptation and Cross-Unit Deployment on Mobile Device0
Siamese Network with Interactive Transformer for Video Object SegmentationCode0
Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentation0
Iteratively Selecting an Easy Reference Frame Makes Unsupervised Video Object Segmentation Easier0
A Discriminative Single-Shot Segmentation Network for Visual Object Tracking0
MUNet: Motion Uncertainty-aware Semi-supervised Video Object Segmentation0
Learning To Segment Dominant Object Motion From Watching Videos0
Hierarchical interaction network for video object segmentation from referring expressions0
FlowVOS: Weakly-Supervised Visual Warping for Detail-Preserving and Temporally Consistent Single-Shot Video Object Segmentation0
Video Salient Object Detection via Contrastive Features and Attention Modules0
SiamPolar: Semi-supervised Realtime Video Object Segmentation with Polar Representation0
Perceptual Consistency in Video Segmentation0
Multi-Object Tracking and Segmentation with a Space-Time Memory Network0
Temporally stable video segmentation without video annotations0
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation0
Space Time Recurrent Memory Network0
Show:102550
← PrevPage 12 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified