SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 22512300 of 2759 papers

TitleStatusHype
Pose Encoding for Robust Skeleton-Based Action Recognition0
Two Stream Self-Supervised Learning for Action Recognition0
Massively Parallel Video Networks0
Action4D: Real-time Action Recognition in the Crowd and Clutter0
Videos as Space-Time Region Graphs0
Squeeze-and-Excitation on Spatial and Temporal Deep Feature Space for Action Recognition0
Learning and Using the Arrow of Time0
Pulling Actions out of Context: Explicit Separation for Effective Combination0
MiCT: Mixed 3D/2D Convolutional Tube for Human Action Recognition0
Recognize Actions by Disentangling Components of Dynamics0
Recognizing Human Actions as the Evolution of Pose Estimation Maps0
PoTion: Pose MoTion Representation for Action Recognition0
Making Convolutional Networks Recurrent for Visual Sequence Learning0
PoseFlow: A Deep Motion Representation for Understanding Human Behaviors in Videos0
Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning0
RNN for Affects at SemEval-2018 Task 1: Formulating Affect Identification as a Binary Classification Problem0
Deep Progressive Reinforcement Learning for Skeleton-Based Action Recognition0
SSNet: Scale Selection Network for Online 3D Action Prediction0
Coding Kendall's Shape Trajectories for 3D Action Recognition0
Temporal Hallucinating for Action Recognition With Few Still Images0
A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition0
Pose-Based Two-Stream Relational Networks for Action Recognition in Videos0
DEEPEYE: A Compact and Accurate Video Comprehension at Terminal Devices Compressed with Quantization and Tensorization0
Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action RecognitionCode0
Graph Edge Convolutional Neural Networks for Skeleton Based Action Recognition0
Fast Retinomorphic Event Stream for Video Recognition and Reinforcement Learning0
Towards an Unequivocal Representation of Actions0
Low-Latency Human Action Recognition with Weighted Multi-Region Convolutional Neural Network0
Visual Attribute-augmented Three-dimensional Convolutional Neural Network for Enhanced Human Action Recognition0
Relational Network for Skeleton-Based Action Recognition0
Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning0
Learning Optical Flow via Dilated Networks and Occlusion Reasoning0
Object Activity Scene Description, Construction and Recognition0
Unsupervised representation learning with long-term dynamics for skeleton based action recognition0
Actor and Observer: Joint Modeling of First and Third-Person VideosCode0
ECO: Efficient Convolutional Network for Online Video UnderstandingCode0
Memory Attention Networks for Skeleton-based Action RecognitionCode0
View Adaptive Neural Networks for High Performance Skeleton-based Human Action RecognitionCode0
PM-GANs: Discriminative Representation Learning for Action Recognition Using Partial-modalities0
STAIR Actions: A Video Dataset of Everyday Home ActionsCode0
Audio-Visual Scene Analysis with Self-Supervised Multisensory FeaturesCode0
End-to-End Learning of Motion Representation for Video UnderstandingCode0
DIY Human Action Data Set Generation0
Non-Linear Temporal Subspace Representations for Activity Recognition0
Video Representation Learning Using Discriminative Pooling0
Towards Universal Representation for Unseen Action Recognition0
T-RECS: Training for Rate-Invariant Embeddings by Controlling Speed for Action Recognition0
Exploiting deep residual networks for human action recognition from skeletal data0
Learning and Recognizing Human Action from Skeleton Movement with Deep Residual Neural Networks0
Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition0
Show:102550
← PrevPage 46 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified