SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 151200 of 2759 papers

TitleStatusHype
Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognition0
Video-to-Task Learning via Motion-Guided Attention for Few-Shot Action Recognition0
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense EvaluationCode1
TDSM: Triplet Diffusion for Skeleton-Text Matching in Zero-Shot Action RecognitionCode1
Extended multi-stream temporal-attention module for skeleton-based human action recognition (HAR)0
Video RWKV:Video Action Recognition Based RWKV0
Explaining Human Activity Recognition with SHAP: Validating Insights with Perturbation and Quantitative MeasuresCode0
ARN-LSTM: A Multi-Stream Fusion Model for Skeleton-based Action Recognition0
AM Flow: Adapters for Temporal Processing in Action Recognition0
STAA: Spatio-Temporal Attention Attribution for Real-Time Interpreting Transformer-based Video ModelsCode0
Love in Action: Gamifying Public Video Cameras for Fostering Social Relationships in Real World0
Human Action Recognition (HAR) Using Skeleton-based Spatial Temporal Relative Transformer Network: ST-RTR0
Recovering Complete Actions for Cross-dataset Skeleton Action Recognition0
AtGCN: A Graph Convolutional Network For Ataxic Gait Detection0
ProMQA: Question Answering Dataset for Multimodal Procedural Activity UnderstandingCode0
Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image DatasetsCode0
Zero-Shot Action Recognition in Surveillance Videos0
Enhancing Action Recognition by Leveraging the Hierarchical Structure of Actions and Textual ContextCode0
Egocentric and Exocentric Methods: A Short Survey0
Idempotent Unsupervised Representation Learning for Skeleton-Based Action RecognitionCode0
Unsupervised Domain Adaptation for Action Recognition via Self-Ensembling and Conditional Embedding Alignment0
Activity Recognition on Avatar-Anonymized Datasets with Masked Differential Privacy0
SpikMamba: When SNN meets Mamba in Event-based Human Action RecognitionCode1
Are Visual-Language Models Effective in Action Recognition? A Comparative Study0
Improving the Multi-label Atomic Activity Recognition by Robust Visual Feature and Advanced Attention @ ROAD++ Atomic Activity Recognition 20240
Storyboard guided Alignment for Fine-grained Video Action Recognition0
Continual Learning Improves Zero-Shot Action Recognition0
Joint Mixing Data Augmentation for Skeleton-based Action RecognitionCode0
Multi class activity classification in videos using Motion History Image generationCode0
EITNet: An IoT-Enhanced Framework for Real-Time Basketball Action Recognition0
Human Stone Toolmaking Action Grammar (HSTAG): A Challenging Benchmark for Fine-grained Motor Behavior Recognition0
Understanding Spatio-Temporal Relations in Human-Object Interaction using Pyramid Graph Convolutional Network0
Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Cameras0
CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action RecognitionCode1
ActionAtlas: A VideoQA Benchmark for Domain-specialized Action Recognition0
Shadow Augmentation for Handwashing Action Recognition: from Synthetic to Real Datasets0
Action Selection Learning for Multi-label Multi-view Action RecognitionCode0
LS-HAR: Language Supervised Human Action Recognition with Salient Fusion, Construction Sites as a Use-Case0
Sparse Covariance Neural NetworksCode0
SurgPETL: Parameter-Efficient Image-to-Surgical-Video Transfer Learning for Surgical Phase Recognition0
SOAR: Self-supervision Optimized UAV Action Recognition with Efficient Object-Aware Pretraining0
EAGLE: Egocentric AGgregated Language-video Engine0
Spatial Hierarchy and Temporal Attention Guided Cross Masking for Self-supervised Skeleton-based Action RecognitionCode0
Path-adaptive Spatio-Temporal State Space Model for Event-based Recognition with Arbitrary Duration0
Cross-Model Cross-Stream Learning for Self-Supervised Human Action RecognitionCode0
Zero-Shot Skeleton-based Action Recognition with Dual Visual-Text Alignment0
Egocentric zone-aware action recognition across environments0
Interpretable Action Recognition on Hard to Classify Actions0
StableMamba: Distillation-free Scaling of Large SSMs for Images and Videos0
Mamba Fusion: Learning Actions Through QuestioningCode0
Show:102550
← PrevPage 4 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified