SOTAVerified

Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Showing 1–50 of 455 papers

TitleStatusHype
ActAlign: Zero-Shot Fine-Grained Video Classification via Language-Guided Sequence AlignmentCode0
Exploring Audio Cues for Enhanced Test-Time Video Model AdaptationCode0
Spatiotemporal Analysis of Forest Machine Operations Using 3D Video Classification—0
Video-GPT via Next Clip DiffusionCode1
Read My Ears! Horse Ear Movement Detection for Equine Affective State AssessmentCode0
Perception Encoder: The best visual embeddings are not at the output of the networkCode8
TenAd: A Tensor-based Low-rank Black Box Adversarial Attack for Video Classification—0
Unbiasing through Textual Descriptions: Mitigating Representation Bias in Video Benchmarks—0
Spatiotemporal Learning with Context-aware Video Tubelets for Ultrasound Video Analysis—0
Ultrasound Image-to-Video Synthesis via Latent Dynamic Diffusion ModelsCode0
Accurate and Efficient Two-Stage Gun Detection in Video—0
Online Meta-learning for AutoML in Real-time (OnMAR)—0
Variable-frame CNNLSTM for Breast Nodule Classification using Ultrasound Videos—0
Optimizing GPT for Video Understanding: Zero-Shot Performance and Prompt Engineering—0
Towards a Robust Framework for Multimodal Hate Detection: A Study on Video vs. Image-based ContentCode0
BRIDLE: Generalized Self-supervised Learning with QuantizationCode0
Extending Information Bottleneck Attribution to Video SequencesCode0
Document-Level Sentiment Analysis of Urdu Text Using Deep Learning Techniques—0
Efficient Lung Ultrasound Severity Scoring Using Dedicated Feature ExtractorCode0
GenVidBench: A Challenging Benchmark for Detecting AI-Generated Video—0
When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysisCode1
Towards Zero-Shot & Explainable Video Description by Reasoning over Graphs of Events in Space and Time—0
An Empirical Study of Autoregressive Pre-training from Videos—0
Temporal Feature Weaving for Neonatal Echocardiographic Viewpoint Video ClassificationCode0
CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets—0
Multi-Modal Video Feature Extraction for Popularity Prediction—0
AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction—0
DejaVid: Encoder-Agnostic Learned Temporal Matching for Video ClassificationCode0
LEARN: A Unified Framework for Multi-Task Domain Adapt Few-Shot LearningCode0
Discrepancy-Aware Attention Network for Enhanced Audio-Visual Zero-Shot Learning—0
Gramian Multimodal Representation Learning and AlignmentCode2
Context-Aware Detection of Mixed Critical Events using Video Classification—0
OccludeNet: A Causal Journey into Mixed-View Actor-Centric Video Action Recognition under OcclusionsCode0
AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction—0
Efficient Audio-Visual Fusion for Video Classification—0
AM Flow: Adapters for Temporal Processing in Action Recognition—0
Optimizing Violence Detection in Video Classification Accuracy through 3D Convolutional Neural Networks—0
Video Token Merging for Long-form Video Understanding—0
Distributed Intelligent Video Surveillance for Early Armed Robbery Detection based on Deep LearningCode0
CPFD: Confidence-aware Privileged Feature Distillation for Short Video Classification—0
TikGuard: A Deep Learning Transformer-Based Solution for Detecting Unsuitable TikTok Content for Kids—0
Benchmarking Edge AI Platforms for High-Performance ML Inference—0
Pushing the boundaries of event subsampling in event-based video classification using CNNsCode0
Scalable Frame Sampling for Video Classification: A Semi-Optimal Policy Approach with Reduced Search SpaceCode0
Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power ApplicationsCode0
ReSpike: Residual Frames-based Hybrid Spiking Neural Networks for Efficient Action RecognitionCode0
HERMES: temporal-coHERent long-forM understanding with Episodes and SemanticsCode1
Attend-Fusion: Efficient Audio-Visual Fusion for Video Classification—0
Query-Efficient Video Adversarial Attack with Stylized Logo—0
VidModEx: Interpretable and Efficient Black Box Model Extraction for High-Dimensional SpacesCode0
Show:102550
← PrevPage 1 of 10Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)95.2—Unverified
2MA-LMMAccuracy (%)93—Unverified
3S5Accuracy (%)90.7—Unverified
4TranS4merAccuracy (%)90.27—Unverified
5D-Sprv.Accuracy (%)89.9—Unverified
6ViS4merAccuracy (%)88.2—Unverified
7GHRMAccuracy (%)75.5—Unverified
8TimeceptionAccuracy (%)71.3—Unverified
9VideoGraphAccuracy (%)69.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)93.5—Unverified
2MA-LMMAccuracy (%)93.2—Unverified
3S5Accuracy (%)90.8—Unverified
4D-Sprv.Accuracy (%)90—Unverified
5TranS4merAccuracy (%)89.3—Unverified
6ViS4merAccuracy (%)88.4—Unverified
7TSNAccuracy (%)73.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VTNAccuracy77.85—Unverified
2I3DAccuracy72.11—Unverified
3ConvLSTMAccuracy69.71—Unverified
#ModelMetricClaimedVerifiedStatus
1DCGN (self-attention graph pooling)Hit@187.7—Unverified
2Hierarchical LSTM with MoEHit@186.8—Unverified
3Mixture-of-2-ExpertsHit@170.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Structured Keypoint PoolingAccuracy99.5—Unverified
2CNN+LSTM1:1 Accuracy98—Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridmAP38.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Cooperative Ours (3rd-person)Accuracy (%)24.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridTop-177.6—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAccuracy (%)73.95—Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy84—Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy91—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Label Prototypes Contrastive LearningAUPR88.4—Unverified