SOTAVerified

Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Showing 201250 of 455 papers

TitleStatusHype
Deep Unsupervised Key Frame Extraction for Efficient Video Classification0
BOREx: Bayesian-Optimization--Based Refinement of Saliency Map for Image- and Video-Classification Models0
Transfer-learning for video classification: Video Swin Transformer on multiple domains0
Linear Video Transformer with Feature Fixation0
S4ND: Modeling Images and Videos as Multidimensional Signals Using State SpacesCode0
FuTH-Net: Fusing Temporal Relations and Holistic Features for Aerial Video Classification0
Traffic Congestion Prediction using Deep Convolutional Neural Networks: A Color-coding Approach0
On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition0
UAV-CROWD: Violent and non-violent crowd activity simulator from the perspective of UAV0
Motion Sensitive Contrastive Learning for Self-supervised Video Representation0
Two-Stream Transformer Architecture for Long Video Understanding0
Adaptive occlusion sensitivity analysis for visually explaining video recognition networksCode0
P2ANet: A Dataset and Benchmark for Dense Action Detection from Table Tennis Match Broadcasting Videos0
Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning0
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility0
NSNet: Non-saliency Suppression Sampler for Efficient Video Recognition0
GOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation LearningCode0
Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models0
Long-term Leap Attention, Short-term Periodic Shift for Video ClassificationCode0
Beyond Transfer Learning: Co-finetuning for Action Localisation0
PatchZero: Defending against Adversarial Patch Attacks by Detecting and Zeroing the Patch0
Automatic Concept Extraction for Concept Bottleneck-based Video Classification0
Analysis and Extensions of Adversarial Training for Video ClassificationCode0
Learning Muti-expert Distribution Calibration for Long-tailed Video Classification0
Overview of the MedVidQA 2022 Shared Task on Medical Video Question-Answering0
VPAI_Lab at MedVidQA 2022: A Two-Stage Cross-modal Fusion Method for Medical Instructional Video ClassificationCode0
Calibrating Class Weights with Multi-Modal Information for Partial Video Domain Adaptation0
SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognition0
Semi-supervised and Deep learning Frameworks for Video Classification and Key-frame Identification0
Movie Genre Classification by Language Augmentation and Shot SamplingCode0
Transformers Meet Visual Learning Understanding: A Comprehensive Review0
RoVISQ: Reduction of Video Service Quality via Adversarial Attacks on Deep Learning-based Video Compression0
TFCNet: Temporal Fully Connected Networks for Static Unbiased Temporal Reasoning0
Recent Trends in 2D Object Detection and Applications in Video Event Recognition0
Capturing Temporal Information in a Single Frame: Channel Sampling Strategies for Action RecognitionCode0
Co-training Transformer with Videos and Images Improves Action Recognition0
Approaches Toward Physical and General Video Anomaly DetectionCode0
MASTAF: A Model-Agnostic Spatio-Temporal Attention Fusion Network for Few-shot Video ClassificationCode0
PreViTS: Contrastive Pretraining with Video Tracking Supervision0
MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation LearningCode0
Unsupervised Action Localization Crop in Video Retargeting for 3D ConvNets0
Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing0
MetaVD: A Meta Video Dataset for enhancing human action recognition datasetsCode0
Adversarial Attacks on Black Box Video Classifiers: Leveraging the Power of Geometric TransformationsCode0
An Investigation on Hardware-Aware Vision Transformer Scaling0
Predicting Driver Self-Reported Stress by Analyzing the Road Scene0
Overview of Tencent Multi-modal Ads Video Understanding Challenge0
Goal-driven text descriptions for images0
Hand Hygiene Video Classification Based on Deep Learning0
Hand Pose Classification Based on Neural Networks0
Show:102550
← PrevPage 5 of 10Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)95.2Unverified
2MA-LMMAccuracy (%)93Unverified
3S5Accuracy (%)90.7Unverified
4TranS4merAccuracy (%)90.27Unverified
5D-Sprv.Accuracy (%)89.9Unverified
6ViS4merAccuracy (%)88.2Unverified
7GHRMAccuracy (%)75.5Unverified
8TimeceptionAccuracy (%)71.3Unverified
9VideoGraphAccuracy (%)69.5Unverified
#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)93.5Unverified
2MA-LMMAccuracy (%)93.2Unverified
3S5Accuracy (%)90.8Unverified
4D-Sprv.Accuracy (%)90Unverified
5TranS4merAccuracy (%)89.3Unverified
6ViS4merAccuracy (%)88.4Unverified
7TSNAccuracy (%)73.4Unverified
#ModelMetricClaimedVerifiedStatus
1VTNAccuracy77.85Unverified
2I3DAccuracy72.11Unverified
3ConvLSTMAccuracy69.71Unverified
#ModelMetricClaimedVerifiedStatus
1DCGN (self-attention graph pooling)Hit@187.7Unverified
2Hierarchical LSTM with MoEHit@186.8Unverified
3Mixture-of-2-ExpertsHit@170.1Unverified
#ModelMetricClaimedVerifiedStatus
1Structured Keypoint PoolingAccuracy99.5Unverified
2CNN+LSTM1:1 Accuracy98Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridmAP38.2Unverified
#ModelMetricClaimedVerifiedStatus
1Cooperative Ours (3rd-person)Accuracy (%)24.7Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridTop-177.6Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAccuracy (%)73.95Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy84Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy91Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Label Prototypes Contrastive LearningAUPR88.4Unverified