SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 601–650 of 2759 papers

TitleStatusHype
A Short Overview of Multi-Modal Wi-Fi Sensing—0
Task-Adapter++: Task-specific Adaptation with Order-aware Alignment for Few-shot Action RecognitionCode0
DetReIDX: A Stress-Test Dataset for Real-World UAV-Based Person RecognitionCode0
Direct Motion Models for Assessing Generated Videos—0
Talk is Not Always Cheap: Promoting Wireless Sensing Models with Text PromptsCode0
Balancing Privacy and Action Performance: A Penalty-Driven Approach to Image Anonymization—0
Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation—0
PCBEAR: Pose Concept Bottleneck for Explainable Action Recognition—0
H-MoRe: Learning Human-centric Motion Representation for Action AnalysisCode0
Knowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities—0
Towards Micro-Action Recognition with Limited Annotations: An Asynchronous Pseudo Labeling and Training Approach—0
MultiSensor-Home: A Wide-area Multi-modal Multi-view Dataset for Action Recognition and Transformer-based Sensor FusionCode0
MultiTSF: Transformer-based Sensor Fusion for Human-Centric Multi-view and Multi-modal Action Recognition—0
LSC-ADL: An Activity of Daily Living (ADL)-Annotated Lifelog Dataset Generated via Semi-Automatic Clustering—0
Is Temporal Prompting All We Need For Limited Labeled Action Recognition?—0
CA^2ST: Cross-Attention in Audio, Space, and Time for Holistic Video Recognition—0
OwlSight: A Robust Illumination Adaptation Framework for Dark Video Human Action Recognition—0
Action Recognition in Real-World Ambient Assisted Living EnvironmentCode0
ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection—0
fine-CLIP: Enhancing Zero-Shot Fine-Grained Surgical Action Recognition with Vision-Language Models—0
Temporal-Guided Spiking Neural Networks for Event-Based Human Action Recognition—0
Towards Achieving Perfect Multimodal Alignment—0
A Comprehensive Survey on Architectural Advances in Deep CNNs: Challenges, Applications, and Emerging Research Directions—0
Body-Hand Modality Expertized Networks with Cross-attention for Fine-grained Skeleton Action RecognitionCode0
STEP: Simultaneous Tracking and Estimation of Pose for Animals and HumansCode0
Towards Scalable Modeling of Compressed Videos for Efficient Action Recognition—0
VA-AR: Learning Velocity-Aware Action Representations with Mixture of Window Attention—0
SurgRAW: Multi-Agent Workflow with Chain-of-Thought Reasoning for Surgical Intelligence—0
Joint Image-Instance Spatial-Temporal Attention for Few-shot Action Recognition—0
A Survey on Wi-Fi Sensing Generalizability: Taxonomy, Techniques, Datasets, and Future Research Prospects—0
Multi-Grained Feature Pruning for Video-Based Human Pose Estimation—0
Gate-Shift-Pose: Enhancing Action Recognition in Sports with Skeleton InformationCode0
Semi-Supervised Audio-Visual Video Action Recognition with Audio Source Localization Guided Mixup—0
A Simple and Efficient Baseline for Video Action Recognition—0
QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects—0
Learning to Generalize without Bias for Open-Vocabulary Action Recognition—0
EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity—0
Trunk-branch Contrastive Network with Multi-view Deformable Aggregation for Multi-view Action Recognition—0
Online hand gesture recognition using Continual Graph Transformers—0
SNN-Driven Multimodal Human Action Recognition via Event Camera and Skeleton Data Fusion—0
Activation-wise Propagation: A Universal Strategy to Break Timestep Constraints in Spiking Neural Networks for 3D Data Processing—0
MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrieval—0
Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis—0
From Image to Video: An Empirical Study of Diffusion Representations—0
HyLiFormer: Hyperbolic Linear Attention for Skeleton-based Human Action Recognition—0
MD-BERT: Action Recognition in Dark Videos via Dynamic Multi-Stream Fusion and Temporal ModelingCode0
HD-EPIC: A Highly-Detailed Egocentric Video Dataset—0
Kronecker Mask and Interpretive Prompts are Language-Action Video LearnersCode0
ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition—0
Action Recognition Using Temporal Shift Module and Ensemble LearningCode0
Show:102550
← PrevPage 13 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified