SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 51100 of 2759 papers

TitleStatusHype
Temporal-Guided Spiking Neural Networks for Event-Based Human Action Recognition0
A Comprehensive Survey on Architectural Advances in Deep CNNs: Challenges, Applications, and Emerging Research Directions0
Towards Achieving Perfect Multimodal Alignment0
Body-Hand Modality Expertized Networks with Cross-attention for Fine-grained Skeleton Action RecognitionCode0
DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid FrameworkCode4
STEP: Simultaneous Tracking and Estimation of Pose for Animals and HumansCode0
Towards Scalable Modeling of Compressed Videos for Efficient Action Recognition0
VA-AR: Learning Velocity-Aware Action Representations with Mixture of Window Attention0
SurgRAW: Multi-Agent Workflow with Chain-of-Thought Reasoning for Surgical Intelligence0
Joint Image-Instance Spatial-Temporal Attention for Few-shot Action Recognition0
A Survey on Wi-Fi Sensing Generalizability: Taxonomy, Techniques, Datasets, and Future Research Prospects0
MPTSNet: Integrating Multiscale Periodic Local Patterns and Global Dependencies for Multivariate Time Series ClassificationCode1
Multi-Grained Feature Pruning for Video-Based Human Pose Estimation0
Gate-Shift-Pose: Enhancing Action Recognition in Sports with Skeleton InformationCode0
Semi-Supervised Audio-Visual Video Action Recognition with Audio Source Localization Guided Mixup0
A Simple and Efficient Baseline for Video Action Recognition0
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
Learning to Generalize without Bias for Open-Vocabulary Action Recognition0
QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects0
EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity0
Trunk-branch Contrastive Network with Multi-view Deformable Aggregation for Multi-view Action Recognition0
Online hand gesture recognition using Continual Graph Transformers0
SNN-Driven Multimodal Human Action Recognition via Event Camera and Skeleton Data Fusion0
MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrieval0
Activation-wise Propagation: A Universal Strategy to Break Timestep Constraints in Spiking Neural Networks for 3D Data Processing0
Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis0
From Image to Video: An Empirical Study of Diffusion Representations0
HyLiFormer: Hyperbolic Linear Attention for Skeleton-based Human Action Recognition0
HD-EPIC: A Highly-Detailed Egocentric Video Dataset0
MD-BERT: Action Recognition in Dark Videos via Dynamic Multi-Stream Fusion and Temporal ModelingCode0
Kronecker Mask and Interpretive Prompts are Language-Action Video LearnersCode0
ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition0
XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and GlassesCode1
Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation ModelsCode3
Action Recognition Using Temporal Shift Module and Ensemble LearningCode0
Recognize Any Surgical Object: Unleashing the Power of Weakly-Supervised Data0
Optimizing Human Pose Estimation Through Focused Human and Joint Regions0
MV-GMN: State Space Model for Multi-View Action Recognition0
SMART-Vision: Survey of Modern Action Recognition Techniques in Vision0
Can masking background and object reduce static bias for zero-shot action recognition?0
BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation0
DSTSA-GCN: Advancing Skeleton-Based Gesture Recognition with Semantic-Aware Spatio-Temporal Topology ModelingCode1
InsTALL: Context-aware Instructional Task Assistance with Multi-modal Large Language Models0
HFGCN:Hypergraph Fusion Graph Convolutional Networks for Skeleton-Based Action Recognition0
Visual WetlandBirds Dataset: Bird Species Identification and Behavior Recognition in VideosCode0
Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics0
Improving Skeleton-based Action Recognition with Interactive Object InformationCode0
Video Summarisation with Incident and Context Information using Generative AI0
Large Language Models for Video Surveillance Applications0
Evolving Skeletons: Motion Dynamics in Action Recognition0
Show:102550
← PrevPage 2 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified