SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Showing 301350 of 895 papers

TitleStatusHype
Immersive Human-Machine Teleoperation Framework for Precision Agriculture: Integrating UAV-based Digital Mapping and Virtual Reality Control0
Isomer: Isomerous Transformer for Zero-shot Video Object SegmentationCode1
Expression Prompt Collaboration Transformer for Universal Referring Video Object SegmentationCode0
Learning Referring Video Object Segmentation from Weak Annotation0
Stochastic positional embeddings improve masked image modelingCode1
XMem++: Production-level Video Segmentation From Few Annotated FramesCode2
Tracking Anything in High QualityCode2
Spectrum-guided Multi-granularity Referring Video Object SegmentationCode1
OnlineRefer: A Simple Online Baseline for Referring Video Object SegmentationCode1
Hierarchical Spatiotemporal Transformers for Video Object Segmentation0
NVDS+: Towards Efficient and Versatile Neural Stabilizer for Video Depth EstimationCode1
Holistic Prototype Attention Network for Few-Shot VOSCode0
Multiscale Memory Comparator Transformer for Few-Shot Video SegmentationCode0
Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video SegmentationCode0
FODVid: Flow-guided Object Discovery in Videos0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation0
RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object SegmentationCode1
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentation0
TrickVOS: A Bag of Tricks for Video Object Segmentation0
Online Unsupervised Video Object Segmentation via Contrastive Motion ClusteringCode0
A spatio-temporal network for video semantic segmentation in surgical videos0
LoSh: Long-Short Text Joint Prediction Network for Referring Video Object SegmentationCode1
3rd Place Solution for PVUW Challenge 2023: Video Panoptic Segmentation0
Semantic Segmentation on VSPW Dataset through Contrastive Loss and Multi-dataset Training Approach0
Recyclable Semi-supervised Method Based on Multi-model Ensemble for Video Scene Parsing0
3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPWCode1
SOC: Semantic-Assisted Object Cluster for Referring Video Object SegmentationCode1
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object SegmentationCode1
AutoDepthNet: High Frame Rate Depth Map Reconstruction using Commodity Depth and RGB Cameras0
Siamese Masked Autoencoders0
READMem: Robust Embedding Association for a Diverse Memory in Unconstrained Video Object SegmentationCode0
UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything ModelCode1
A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering0
Video Object Segmentation in Panoptic Wild ScenesCode2
Personalize Segment Anything Model with One ShotCode3
Event-Free Moving Object Segmentation from Moving Ego VehicleCode1
Robust and Efficient Memory Network for Video Object Segmentation0
Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detection0
Motion-state Alignment for Video Semantic Segmentation0
Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual GroupingCode1
Segment Everything Everywhere All at OnceCode1
Boosting Video Object Segmentation via Space-time Correspondence LearningCode1
MED-VT++: Unifying Multimodal Learning with a Multiscale Encoder-Decoder Video Transformer0
Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentation0
CLVOS23: A Long Video Object Segmentation Dataset for Continual LearningCode0
Co-attention Propagation Network for Zero-Shot Video Object SegmentationCode0
SegGPT: Segmenting Everything In ContextCode4
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking TasksCode1
Reliability-Hierarchical Memory Network for Scribble-Supervised Video Object SegmentationCode1
Show:102550
← PrevPage 7 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3Unverified
2TDNet-50 [9]mIoU79.9Unverified
3DeltaDist-DDRNet-39mIoU79.9Unverified
4PSPNet-101 [20]mIoU79.7Unverified
5PSPNet-50 [20]mIoU78.1Unverified
6LVS [12]mIoU76.8Unverified
7GRFP [15]mIoU73.6Unverified
8FCN-50 [14]mIoU70.1Unverified
9DFF [22]mIoU69.2Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5Unverified
2ETC-MobileNetMean IoU76.3Unverified
3TDNet-50Mean IoU76.2Unverified
4PSPNet-50Mean IoU76Unverified
5NetwarpMean IoU74.7Unverified
6GRFPMean IoU67.1Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8Unverified
2UniVS(Swin-L)mIoU59.8Unverified
3Tube-Link(Swin-large)mIoU59.6Unverified
4MRCFA(MiT-B5)mIoU49.9Unverified
5CFFM(MiT-B5)mIoU49.3Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1Unverified
2TMANet (ResNet-50)Q57.5Unverified
3CSANet (ResNet-101)Q49.1Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52Unverified
2MVNet(PSPNet)mIoU54.36Unverified
3MVNet(FCN)mIoU53.9Unverified