SOTAVerified

Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Showing 101150 of 455 papers

TitleStatusHype
Malicious or Benign? Towards Effective Content Moderation for Children's VideosCode0
Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception0
HateMM: A Multi-Modal Dataset for Hate Video ClassificationCode1
Verbs in Action: Improving verb understanding in video-language modelsCode0
SparseFormer: Sparse Visual Recognition via Limited Latent TokensCode1
Vita-CLIP: Video and text adaptive CLIP via Multimodal PromptingCode1
NetFlick: Adversarial Flickering Attacks on Deep Learning Based Video Compression0
SELF-VS: Self-supervised Encoding Learning For Video SummarizationCode0
Unified Keypoint-based Action Recognition Framework via Structured Keypoint Pooling0
Selective Structured State-Spaces for Long-Form Video Understanding0
The effectiveness of MAE pre-pretraining for billion-scale pretrainingCode1
ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked AutoencodersCode0
Towards Activated Muscle Group Estimation in the WildCode1
Temporal Coherent Test-Time Optimization for Robust Video Classification0
Video4MRI: An Empirical Study on Brain Magnetic Resonance Image Analytics with CNN-based Video Classification Frameworks0
Analysis of Real-Time Hostile Activitiy Detection from Spatiotemporal Features Using Time Distributed Deep CNNs, RNNs and Attention-Based Mechanisms0
Reversible Vision TransformersCode1
Augmenting Ego-Vehicle for Traffic Near-Miss and Accident Classification Dataset using Manipulating Conditional Style TranslationCode0
Few-Shot Video Classification via Representation Fusion and Promotion Learning0
Class Prototypes Based Contrastive Learning for Classifying Multi-Label and Fine-Grained Educational Videos0
Efficient Movie Scene Detection using State-Space TransformersCode1
Truncate-Split-Contrast: A Framework for Learning from Mislabeled Videos0
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners0
Evaluation of Explanation Methods of AI -- CNNs in Image Classification Tasks with Reference-based and No-reference MetricsCode0
A Unified Multimodal De- and Re-coupling Framework for RGB-D Motion RecognitionCode1
Deep Unsupervised Key Frame Extraction for Efficient Video Classification0
BOREx: Bayesian-Optimization--Based Refinement of Saliency Map for Image- and Video-Classification Models0
Transfer-learning for video classification: Video Swin Transformer on multiple domains0
Linear Video Transformer with Feature Fixation0
Overlooked Video Classification in Weakly Supervised Video Anomaly DetectionCode1
S4ND: Modeling Images and Videos as Multidimensional Signals Using State SpacesCode0
TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video SurveillanceCode1
FuTH-Net: Fusing Temporal Relations and Holistic Features for Aerial Video Classification0
Traffic Congestion Prediction using Deep Convolutional Neural Networks: A Color-coding Approach0
On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition0
UAV-CROWD: Violent and non-violent crowd activity simulator from the perspective of UAV0
Motion Sensitive Contrastive Learning for Self-supervised Video Representation0
Two-Stream Transformer Architecture for Long Video Understanding0
Adaptive occlusion sensitivity analysis for visually explaining video recognition networksCode0
P2ANet: A Dataset and Benchmark for Dense Action Detection from Table Tennis Match Broadcasting Videos0
SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized ViolenceCode1
Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning0
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility0
Inductive and Transductive Few-Shot Video Classification via Appearance and Temporal AlignmentsCode1
NSNet: Non-saliency Suppression Sampler for Efficient Video Recognition0
Exploring Fine-Grained Audiovisual Categorization with the SSW60 DatasetCode1
Temporal and cross-modal attention for audio-visual zero-shot learningCode1
GOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation LearningCode0
Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models0
Long-term Leap Attention, Short-term Periodic Shift for Video ClassificationCode0
Show:102550
← PrevPage 3 of 10Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)95.2Unverified
2MA-LMMAccuracy (%)93Unverified
3S5Accuracy (%)90.7Unverified
4TranS4merAccuracy (%)90.27Unverified
5D-Sprv.Accuracy (%)89.9Unverified
6ViS4merAccuracy (%)88.2Unverified
7GHRMAccuracy (%)75.5Unverified
8TimeceptionAccuracy (%)71.3Unverified
9VideoGraphAccuracy (%)69.5Unverified
#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)93.5Unverified
2MA-LMMAccuracy (%)93.2Unverified
3S5Accuracy (%)90.8Unverified
4D-Sprv.Accuracy (%)90Unverified
5TranS4merAccuracy (%)89.3Unverified
6ViS4merAccuracy (%)88.4Unverified
7TSNAccuracy (%)73.4Unverified
#ModelMetricClaimedVerifiedStatus
1VTNAccuracy77.85Unverified
2I3DAccuracy72.11Unverified
3ConvLSTMAccuracy69.71Unverified
#ModelMetricClaimedVerifiedStatus
1DCGN (self-attention graph pooling)Hit@187.7Unverified
2Hierarchical LSTM with MoEHit@186.8Unverified
3Mixture-of-2-ExpertsHit@170.1Unverified
#ModelMetricClaimedVerifiedStatus
1Structured Keypoint PoolingAccuracy99.5Unverified
2CNN+LSTM1:1 Accuracy98Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridmAP38.2Unverified
#ModelMetricClaimedVerifiedStatus
1Cooperative Ours (3rd-person)Accuracy (%)24.7Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridTop-177.6Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAccuracy (%)73.95Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy84Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy91Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Label Prototypes Contrastive LearningAUPR88.4Unverified