SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 651700 of 2759 papers

TitleStatusHype
Recognize Any Surgical Object: Unleashing the Power of Weakly-Supervised Data0
Optimizing Human Pose Estimation Through Focused Human and Joint Regions0
MV-GMN: State Space Model for Multi-View Action Recognition0
Can masking background and object reduce static bias for zero-shot action recognition?0
SMART-Vision: Survey of Modern Action Recognition Techniques in Vision0
InsTALL: Context-aware Instructional Task Assistance with Multi-modal Large Language Models0
BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation0
HFGCN:Hypergraph Fusion Graph Convolutional Networks for Skeleton-Based Action Recognition0
Visual WetlandBirds Dataset: Bird Species Identification and Behavior Recognition in Videos0
Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics0
Improving Skeleton-based Action Recognition with Interactive Object InformationCode0
Video Summarisation with Incident and Context Information using Generative AI0
Large Language Models for Video Surveillance Applications0
Evolving Skeletons: Motion Dynamics in Action Recognition0
Event Masked Autoencoder: Point-wise Action Recognition with Event-Based Cameras0
Sound Bridge: Associating Egocentric and Exocentric Videos via Audio CuesCode0
MODA: Motion-Drift Augmentation for Inertial Human Motion Analysis0
Beyond Image Classification: A Video Benchmark and Dual-Branch Hybrid Discrimination Framework for Compositional Zero-Shot Learning0
FSBench: A Figure Skating Benchmark for Advancing Artistic Sports UnderstandingCode0
DejaVid: Encoder-Agnostic Learned Temporal Matching for Video ClassificationCode0
Heterogeneous Skeleton-Based Action Representation Learning0
Action Detail Matters: Refining Video Recognition with Local Action Queries0
Viewpoint Rosetta Stone: Unlocking Unpaired Ego-Exo Videos for View-invariant Representation Learning0
LoKi: Low-dimensional KAN for Efficient Fine-tuning Image Models0
Semantic-guided Cross-Modal Prompt Learning for Skeleton-based Zero-shot Action Recognition0
Frequency-aware Event Cloud Network0
DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments0
Skeleton-based Action Recognition with Non-linear Dependency Modeling and Hilbert-Schmidt Independence CriterionCode0
HumanVBench: Exploring Human-Centric Video Understanding Capabilities of MLLMs with Synthetic Benchmark Data0
Video Domain Incremental Learning for Human Action Recognition in Home Environments0
FACTS: Fine-Grained Action Classification for Tactical Sports0
MSA-GCN: Exploiting Multi-Scale Temporal Dynamics With Adaptive Graph Convolution for Skeleton-Based Action Recognition0
Synchronized and Fine-Grained Head for Skeleton-Based Ambiguous Action RecognitionCode0
CompactFlowNet: Efficient Real-time Optical Flow Estimation on Mobile Devices0
Future Aspects in Human Action Recognition: Exploring Emerging Techniques and Ethical Influences0
Manta: Enhancing Mamba for Few-Shot Action Recognition of Long Sub-Sequence0
Action Recognition based Industrial Safety Violation Detection0
CCS: Continuous Learning for Customized Incremental Wireless Sensing Services0
Proximal Control of UAVs with Federated Learning for Human-Robot Collaborative Domains0
EdgeOAR: Real-time Online Action Recognition On Edge Devices0
SkelMamba: A State Space Model for Efficient Skeleton Action Recognition of Neurological Disorders0
An End-to-End Two-Stream Network Based on RGB Flow and Representation Flow for Human Action Recognition0
LoCATe-GAT: Modeling Multi-Scale Local Context and Action Relationships for Zero-Shot Action RecognitionCode0
EventCrab: Harnessing Frame and Point Synergy for Event-based Action Recognition and Beyond0
Pre-training for Action Recognition with Automatically Generated Fractal DatasetsCode0
OccludeNet: A Causal Journey into Mixed-View Actor-Centric Video Action Recognition under OcclusionsCode0
When Spatial meets Temporal in Action Recognition0
Adaptive Hyper-Graph Convolution Network for Skeleton-based Human Action Recognition with Virtual Connections0
Rethinking Top Probability from Multi-view for Distracted Driver Behaviour Localization0
Topological Symmetry Enhanced Graph Convolution for Skeleton-Based Action RecognitionCode0
Show:102550
← PrevPage 14 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified