SOTAVerified

Video Semantic Segmentation

The goal of video semantic segmentation is to assign a predefined class to each pixel in all frames of a video. This requires the model not only to predict accurate segmentation masks but also to ensure that these masks remain temporally consistent across frames. This task has broad applications in areas such as autonomous driving, medical video analysis, and AR/VR.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 895 papers

TitleStatusHype
DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance FieldsCode0
Correlation-aware active learning for surgery video segmentation—0
Sketch-based Video Object Segmentation: Benchmark and Analysis—0
Learning the What and How of Annotation in Video Object Segmentation—0
ISAR: A Benchmark for Single- and Few-Shot Object Instance Segmentation and Re-Identification—0
SpVOS: Efficient Video Object Segmentation with Triple Sparse Convolution—0
Understanding Video Transformers for Segmentation: A Survey of Application and Interpretability—0
Zero-Shot Open-Vocabulary Tracking with Large Pre-Trained Models—0
Sub-token ViT Embedding via Stochastic Resonance TransformersCode0
CoralVOS: Dataset and Benchmark for Coral Video Segmentation—0
SimLVSeg: Simplifying Left Ventricular Segmentation in 2D+Time Echocardiograms with Self- and Weakly-Supervised LearningCode0
Memory-Efficient Continual Learning Object Segmentation for Long Video—0
Adversarial Attacks on Video Object Segmentation with Hard Region Discovery—0
Rethinking Amodal Video Segmentation from Learning Supervised Signals with Object-centric RepresentationCode0
Efficient Long-Short Temporal Attention Network for Unsupervised Video Object Segmentation—0
MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic SegmentationCode0
SANPO: A Scene Understanding, Accessibility and Human Navigation Dataset—0
Fully Transformer-Equipped Architecture for End-to-End Referring Video Object Segmentation—0
GL-Fusion: Global-Local Fusion Network for Multi-view Echocardiogram Video SegmentationCode0
Multi-grained Temporal Prototype Learning for Few-shot Video Object SegmentationCode0
Temporal-aware Hierarchical Mask Classification for Video Semantic SegmentationCode0
Temporal Collection and Distribution for Referring Video Object Segmentation—0
Robust Visual Tracking by Motion Analyzing—0
Learning Cross-Modal Affinity for Referring Video Object Segmentation Targeting Limited SamplesCode0
Joint Modeling of Feature, Correspondence, and a Compressed Memory for Video Object Segmentation—0
Robotic Scene Segmentation with Memory Network for Runtime Surgical Context InferenceCode0
LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingCode0
MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation—0
Scalable Video Object Segmentation with Simplified Framework—0
Immersive Human-Machine Teleoperation Framework for Precision Agriculture: Integrating UAV-based Digital Mapping and Virtual Reality Control—0
Expression Prompt Collaboration Transformer for Universal Referring Video Object SegmentationCode0
Learning Referring Video Object Segmentation from Weak Annotation—0
Hierarchical Spatiotemporal Transformers for Video Object Segmentation—0
Holistic Prototype Attention Network for Few-Shot VOSCode0
Multiscale Memory Comparator Transformer for Few-Shot Video SegmentationCode0
Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video SegmentationCode0
FODVid: Flow-guided Object Discovery in Videos—0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking—0
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation—0
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentation—0
TrickVOS: A Bag of Tricks for Video Object Segmentation—0
Online Unsupervised Video Object Segmentation via Contrastive Motion ClusteringCode0
A spatio-temporal network for video semantic segmentation in surgical videos—0
3rd Place Solution for PVUW Challenge 2023: Video Panoptic Segmentation—0
Semantic Segmentation on VSPW Dataset through Contrastive Loss and Multi-dataset Training Approach—0
Recyclable Semi-supervised Method Based on Multi-model Ensemble for Video Scene Parsing—0
AutoDepthNet: High Frame Rate Depth Map Reconstruction using Commodity Depth and RGB Cameras—0
Siamese Masked Autoencoders—0
READMem: Robust Embedding Association for a Diverse Memory in Unconstrained Video Object SegmentationCode0
A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering—0
Show:102550
← PrevPage 10 of 18Next →
All datasetsCityscapes valCamVidVSPWLaRSMultispectral Video Semantic Segmentation

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1TMANet-50mIoU80.3—Unverified
2TDNet-50 [9]mIoU79.9—Unverified
3DeltaDist-DDRNet-39mIoU79.9—Unverified
4PSPNet-101 [20]mIoU79.7—Unverified
5PSPNet-50 [20]mIoU78.1—Unverified
6LVS [12]mIoU76.8—Unverified
7GRFP [15]mIoU73.6—Unverified
8FCN-50 [14]mIoU70.1—Unverified
9DFF [22]mIoU69.2—Unverified
#ModelMetricClaimedVerifiedStatus
1TMANet-50Mean IoU76.5—Unverified
2ETC-MobileNetMean IoU76.3—Unverified
3TDNet-50Mean IoU76.2—Unverified
4PSPNet-50Mean IoU76—Unverified
5NetwarpMean IoU74.7—Unverified
6GRFPMean IoU67.1—Unverified
#ModelMetricClaimedVerifiedStatus
1DVIS++(VIT-L)mIoU63.8—Unverified
2UniVS(Swin-L)mIoU59.8—Unverified
3Tube-Link(Swin-large)mIoU59.6—Unverified
4MRCFA(MiT-B5)mIoU49.9—Unverified
5CFFM(MiT-B5)mIoU49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1WaSR-T (ResNet-101)Q60.1—Unverified
2TMANet (ResNet-50)Q57.5—Unverified
3CSANet (ResNet-101)Q49.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MVNet(DeepLabV3)mIoU54.52—Unverified
2MVNet(PSPNet)mIoU54.36—Unverified
3MVNet(FCN)mIoU53.9—Unverified