SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 2759 papers

TitleStatusHype
HENASY: Learning to Assemble Scene-Entities for Egocentric Video-Language Model—0
Skeleton-OOD: An End-to-End Skeleton-Based Model for Robust Out-of-Distribution Human Action DetectionCode0
Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation LearningCode0
Multimodal Cross-Domain Few-Shot Learning for Egocentric Action Recognition—0
From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehaveCode0
EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery VideosCode1
Matrix Manifold Neural Networks++—0
Exploring AI-based Anonymization of Industrial Image and Video Data in the Context of Feature Preservation—0
Hierarchical Action Recognition: A Contrastive Video-Language Approach with Hierarchical Interactions—0
EgoNCE++: Do Egocentric Video-Language Models Really Understand Hand-Object Interactions?Code1
A Cross-Dataset Study for Text-based 3D Human Motion Retrieval—0
Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion PerceptionCode0
MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models—0
Enhanced Spatiotemporal Prediction Using Physical-guided And Frequency-enhanced Recurrent Neural Networks—0
From CNNs to Transformers in Multimodal Human Action Recognition: A Survey—0
Counterfactual Gradients-based Quantification of Prediction Trust in Neural NetworksCode0
Identity-free Artificial Emotional Intelligence via Micro-Gesture Understanding—0
The impact of Compositionality in Zero-shot Multi-label action recognition for Object-based tasks—0
Coarse or Fine? Recognising Action End States without LabelsCode0
PRENet: A Plane-Fit Redundancy Encoding Point Cloud Sequence Network for Real-Time 3D Action Recognition—0
Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMambaCode2
A Survey on Backbones for Deep Video Action Recognition—0
JOSENet: A Joint Stream Embedding Network for Violence Detection in Surveillance VideosCode0
MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognition—0
Multi-view Action Recognition via Directed Gromov-Wasserstein Discrepancy—0
Cross-Block Fine-Grained Semantic Cascade for Skeleton-Based Sports Action Recognition—0
Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation—0
Learning Discriminative Spatio-temporal Representations for Semi-supervised Action Recognition—0
An Improved Graph Pooling Network for Skeleton-Based Action Recognition—0
HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action RecognitionCode1
Interactive Generation of Laparoscopic Videos with Diffusion Models—0
DENOISER: Rethinking the Robustness for Open-Vocabulary Action Recognition—0
Driver Activity Classification Using Generalizable Representations from Vision-Language Models—0
Combating Missing Modalities in Egocentric Videos at Test Time—0
CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction AlignmentCode1
Attack on Scene Flow using Point CloudsCode0
Aligning Actions and Walking to LLM-Generated Textual DescriptionsCode0
Simultaneous Detection and Interaction Reasoning for Object-Centric Action Recognition—0
VG4D: Vision-Language Model Goes 4D Video RecognitionCode1
Lower Limb Movements Recognition Based on Feature Recursive Elimination and Backpropagation Neural Network—0
Learning to Score Sign Language with Two-stage Method—0
HumMUSS: Human Motion Understanding using State Space Models—0
MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognition—0
Leveraging Temporal Contextualization for Video Action RecognitionCode2
A Survey on Multimodal Wearable Sensor-based Human Action Recognition—0
In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action RecognitionCode0
Multimodal Attack Detection for Action Recognition ModelsCode0
Exploring Explainability in Video Action Recognition—0
MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition—0
Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in VideosCode1
Show:102550
← PrevPage 7 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified