SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1451–1500 of 2759 papers

TitleStatusHype
Multi-Expert Human Action Recognition with Hierarchical Super-Class Learning—0
Self-supervised Spatiotemporal Representation Learning by Exploiting Video Continuity—0
Contextualized Spatio-Temporal Contrastive Learning with Self-SupervisionCode0
Time-Equivariant Contrastive Video Representation Learning—0
Cross-modal Manifold Cutmix for Self-supervised Video Representation Learning—0
Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition—0
STSM: Spatio-Temporal Shift Module for Efficient Action Recognition—0
Make A Long Image Short: Adaptive Token Length for Vision Transformers—0
Deep Efficient Continuous Manifold Learning for Time Series ModelingCode0
Stacked Temporal Attention: Improving First-person Action Recognition by Emphasizing Discriminative Clips—0
Reformulating Zero-shot Action Recognition for Multi-label Actions—0
Graph Convolutional Module for Temporal Action Localization in Videos—0
Dynamic Normalization and Relay for Video Action RecognitionCode0
Spatiotemporal Joint Filter Decomposition in 3D Convolutional Neural Networks—0
Your head is there to move you around: Goal-driven models of the primate dorsal pathway—0
Cross Your Body: A Cognitive Assessment System for Children—0
MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation LearningCode0
Contrast-reconstruction Representation Learning for Self-supervised Skeleton-based Action Recognition—0
Action Recognition with Domain Invariant Features of Skeleton Image—0
Evaluating Transformers for Lightweight Action Recognition—0
A Central Difference Graph Convolutional Operator for Skeleton-Based Action RecognitionCode0
Multi-Scale Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition—0
Action Recognition using Transfer Learning and Majority Voting for CSGO—0
Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing—0
Skeleton-Split Framework using Spatial Temporal Graph Convolutional Networks for Action RecogntionCode0
Event and Activity Recognition in Video Surveillance for Cyber-Physical Systems—0
Sequence-to-Sequence Modeling for Action Identification at High Temporal ResolutionCode0
Re-ID-AR: Improved Person Re-identification in Video via Joint Weakly Supervised Action RecognitionCode0
Livestock Monitoring with Transformer—0
MetaVD: A Meta Video Dataset for enhancing human action recognition datasetsCode0
Gradient Frequency Modulation for Visually Explaining Video Understanding Models—0
LSTA-Net: Long short-term Spatio-Temporal Aggregation Network for Skeleton-based Action RecognitionCode0
Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding—0
Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition—0
Zero-Shot Action Recognition from Diverse Object-Scene CompositionsCode0
IIP-Transformer: Intra-Inter-Part Transformer for Skeleton-Based Action Recognition—0
A Variational Graph Autoencoder for Manipulation Action Recognition and PredictionCode0
Spatio-Temporal Graph Complementary Scattering Networks—0
GTM: Gray Temporal Model for Video Recognition—0
Spatial-Temporal Transformer for 3D Point Cloud Sequences—0
Domain Generalization through Audio-Visual Relative Norm Alignment in First Person Action Recognition—0
TEAM-Net: Multi-modal Learning for Video Action Recognition with Partial DecodingCode0
SCA Net: Sparse Channel Attention Module for Action Recognition—0
"Knights": First Place Submission for VIPriors21 Action Recognition Challenge at ICCV 2021—0
Video-based cattle identification and action recognitionCode0
Nuisance-Label Supervision: Robustness Improvement by Free Labels—0
Video Is Graph: Structured Graph Module for Video Action Recognition—0
TAda! Temporally-Adaptive Convolutions for Video UnderstandingCode0
Joint Learning On The Hierarchy Representation for Fine-Grained Human Action Recognition—0
High-order Tensor Pooling with Attention for Action Recognition—0
Show:102550
← PrevPage 30 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified