SOTAVerified

Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 455 papers

TitleStatusHype
PUDD: Towards Robust Multi-modal Prototype-based Deepfake Detection—0
MU-Bench: A Multitask Multimodal Benchmark for Machine UnlearningCode0
PrAViC: Probabilistic Adaptation Framework for Real-Time Video Classification—0
DL-KDD: Dual-Light Knowledge Distillation for Action Recognition in the Dark—0
Few-Shot Classification of Interactive Activities of Daily Living (InteractADL)Code0
ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos—0
SIAVC: Semi-Supervised Framework for Industrial Accident Video ClassificationCode0
Learning Correlation Structures for Vision Transformers—0
Robustness and Visual Explanation for Black Box Image, Video, and ECG Signal Classification with Reinforcement Learning—0
Pig aggression classification using CNN, Transformers and Recurrent Networks—0
Leveraging Compressed Frame Sizes For Ultra-Fast Video Classification—0
Learning Expressive And Generalizable Motion Features For Face Forgery Detection—0
A Multimodal Handover Failure Detection Dataset and BaselinesCode0
Multi-modality transrectal ultrasound video classification for identification of clinically significant prostate cancerCode0
Time-, Memory- and Parameter-Efficient Visual Adaptation—0
FakeClaim: A Multiple Platform-driven Dataset for Identification of Fake News on 2023 Israel-Hamas WarCode0
Short-Form Videos and Mental Health: A Knowledge-Guided Neural Topic Model—0
Efficient Selective Audio Masked Multimodal Bottleneck Transformer for Audio-Video Classification—0
Efficient Multiscale Multimodal Bottleneck Transformer for Audio-Video Classification—0
Time- Memory- and Parameter-Efficient Visual Adaptation—0
Neural architecture impact on identifying temporally extended Reinforcement Learning tasks—0
Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding—0
Language as the Medium: Multimodal Video Classification through text only—0
Differentiable Resolution Compression and Alignment for Efficient Video Classification and RetrievalCode0
AV-MaskEnhancer: Enhancing Video Representations through Audio-Visual Masked Autoencoder—0
Text-to-feature diffusion for audio-visual few-shot learningCode0
Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer ModelsCode0
The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework—0
Active Learning for Video Classification with Frame Level Queries—0
Learning Unseen Modality InteractionCode0
Boosting Breast Ultrasound Video Classification by the Guidance of Keyframe Feature Centers—0
Inflated 3D Convolution-Transformer for Weakly-supervised Carotid Stenosis Grading with Ultrasound VideosCode0
Multi-label Video Classification for Underwater Ship Inspection—0
Malicious or Benign? Towards Effective Content Moderation for Children's VideosCode0
Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception—0
Verbs in Action: Improving verb understanding in video-language modelsCode0
NetFlick: Adversarial Flickering Attacks on Deep Learning Based Video Compression—0
SELF-VS: Self-supervised Encoding Learning For Video SummarizationCode0
Unified Keypoint-based Action Recognition Framework via Structured Keypoint Pooling—0
Selective Structured State-Spaces for Long-Form Video Understanding—0
ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked AutoencodersCode0
Temporal Coherent Test-Time Optimization for Robust Video Classification—0
Video4MRI: An Empirical Study on Brain Magnetic Resonance Image Analytics with CNN-based Video Classification Frameworks—0
Analysis of Real-Time Hostile Activitiy Detection from Spatiotemporal Features Using Time Distributed Deep CNNs, RNNs and Attention-Based Mechanisms—0
Augmenting Ego-Vehicle for Traffic Near-Miss and Accident Classification Dataset using Manipulating Conditional Style TranslationCode0
Class Prototypes Based Contrastive Learning for Classifying Multi-Label and Fine-Grained Educational Videos—0
Few-Shot Video Classification via Representation Fusion and Promotion Learning—0
Truncate-Split-Contrast: A Framework for Learning from Mislabeled Videos—0
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners—0
Evaluation of Explanation Methods of AI -- CNNs in Image Classification Tasks with Reference-based and No-reference MetricsCode0
Show:102550
← PrevPage 4 of 10Next →
All datasetsBreakfastCOINMoBYouTube-8MHockey Fight Detection DatasetCharadesHome Action GenomeKineticsMultimodal PISASomething-Something V1Something-Something V2SRI-APPROVE Fine-Grained Video Classification

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)95.2—Unverified
2MA-LMMAccuracy (%)93—Unverified
3S5Accuracy (%)90.7—Unverified
4TranS4merAccuracy (%)90.27—Unverified
5D-Sprv.Accuracy (%)89.9—Unverified
6ViS4merAccuracy (%)88.2—Unverified
7GHRMAccuracy (%)75.5—Unverified
8TimeceptionAccuracy (%)71.3—Unverified
9VideoGraphAccuracy (%)69.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)93.5—Unverified
2MA-LMMAccuracy (%)93.2—Unverified
3S5Accuracy (%)90.8—Unverified
4D-Sprv.Accuracy (%)90—Unverified
5TranS4merAccuracy (%)89.3—Unverified
6ViS4merAccuracy (%)88.4—Unverified
7TSNAccuracy (%)73.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VTNAccuracy77.85—Unverified
2I3DAccuracy72.11—Unverified
3ConvLSTMAccuracy69.71—Unverified
#ModelMetricClaimedVerifiedStatus
1DCGN (self-attention graph pooling)Hit@187.7—Unverified
2Hierarchical LSTM with MoEHit@186.8—Unverified
3Mixture-of-2-ExpertsHit@170.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Structured Keypoint PoolingAccuracy99.5—Unverified
2CNN+LSTM1:1 Accuracy98—Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridmAP38.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Cooperative Ours (3rd-person)Accuracy (%)24.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridTop-177.6—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAccuracy (%)73.95—Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy84—Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy91—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Label Prototypes Contrastive LearningAUPR88.4—Unverified