SOTAVerified

Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Showing 76100 of 455 papers

TitleStatusHype
Time-, Memory- and Parameter-Efficient Visual Adaptation0
FakeClaim: A Multiple Platform-driven Dataset for Identification of Fake News on 2023 Israel-Hamas WarCode0
Short-Form Videos and Mental Health: A Knowledge-Guided Neural Topic Model0
Efficient Selective Audio Masked Multimodal Bottleneck Transformer for Audio-Video Classification0
Efficient Multiscale Multimodal Bottleneck Transformer for Audio-Video Classification0
Time- Memory- and Parameter-Efficient Visual Adaptation0
Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based ApproachCode1
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksCode1
A Simple Video Segmenter by Tracking Objects Along Axial TrajectoriesCode1
Quantized Distillation: Optimizing Driver Activity Recognition Models for Resource-Constrained EnvironmentsCode1
Neural architecture impact on identifying temporally extended Reinforcement Learning tasks0
Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding0
Language as the Medium: Multimodal Video Classification through text only0
AV-MaskEnhancer: Enhancing Video Representations through Audio-Visual Masked Autoencoder0
Differentiable Resolution Compression and Alignment for Efficient Video Classification and RetrievalCode0
Text-to-feature diffusion for audio-visual few-shot learningCode0
Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer ModelsCode0
MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor DiagnosisCode1
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and ResolutionCode6
The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework0
Active Learning for Video Classification with Frame Level Queries0
Learning Unseen Modality InteractionCode0
Boosting Breast Ultrasound Video Classification by the Guidance of Keyframe Feature Centers0
Inflated 3D Convolution-Transformer for Weakly-supervised Carotid Stenosis Grading with Ultrasound VideosCode0
Multi-label Video Classification for Underwater Ship Inspection0
Show:102550
← PrevPage 4 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)95.2Unverified
2MA-LMMAccuracy (%)93Unverified
3S5Accuracy (%)90.7Unverified
4TranS4merAccuracy (%)90.27Unverified
5D-Sprv.Accuracy (%)89.9Unverified
6ViS4merAccuracy (%)88.2Unverified
7GHRMAccuracy (%)75.5Unverified
8TimeceptionAccuracy (%)71.3Unverified
9VideoGraphAccuracy (%)69.5Unverified
#ModelMetricClaimedVerifiedStatus
1HERMESAccuracy (%)93.5Unverified
2MA-LMMAccuracy (%)93.2Unverified
3S5Accuracy (%)90.8Unverified
4D-Sprv.Accuracy (%)90Unverified
5TranS4merAccuracy (%)89.3Unverified
6ViS4merAccuracy (%)88.4Unverified
7TSNAccuracy (%)73.4Unverified
#ModelMetricClaimedVerifiedStatus
1VTNAccuracy77.85Unverified
2I3DAccuracy72.11Unverified
3ConvLSTMAccuracy69.71Unverified
#ModelMetricClaimedVerifiedStatus
1DCGN (self-attention graph pooling)Hit@187.7Unverified
2Hierarchical LSTM with MoEHit@186.8Unverified
3Mixture-of-2-ExpertsHit@170.1Unverified
#ModelMetricClaimedVerifiedStatus
1Structured Keypoint PoolingAccuracy99.5Unverified
2CNN+LSTM1:1 Accuracy98Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridmAP38.2Unverified
#ModelMetricClaimedVerifiedStatus
1Cooperative Ours (3rd-person)Accuracy (%)24.7Unverified
#ModelMetricClaimedVerifiedStatus
1MultigridTop-177.6Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAccuracy (%)73.95Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy84Unverified
#ModelMetricClaimedVerifiedStatus
1MSNet-R50En (ours)Top-5 Accuracy91Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Label Prototypes Contrastive LearningAUPR88.4Unverified