SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 24012450 of 2759 papers

TitleStatusHype
Are current long-term video understanding datasets long-term?Code0
A^2-Nets: Double Attention NetworksCode0
Appearance-and-Relation Networks for Video ClassificationCode0
Action Selection Learning for Multi-label Multi-view Action RecognitionCode0
LSTA-Net: Long short-term Spatio-Temporal Aggregation Network for Skeleton-based Action RecognitionCode0
A Perceptual Prediction Framework for Self Supervised Event SegmentationCode0
OccamNets: Mitigating Dataset Bias by Favoring Simpler HypothesesCode0
OccludeNet: A Causal Journey into Mixed-View Actor-Centric Video Action Recognition under OcclusionsCode0
Fine-grained Action Analysis: A Multi-modality and Multi-task Dataset of Figure SkatingCode0
LSTA: Long Short-Term Attention for Egocentric Action RecognitionCode0
Few-Shot Fine-Grained Action Recognition via Bidirectional Attention and Contrastive Meta-LearningCode0
LSFB-CONT and LSFB-ISOL: Two New Datasets for Vision-Based Sign Language RecognitionCode0
Skeleton Image Representation for 3D Action Recognition based on Tree Structure and Reference JointsCode0
Low-light Environment Neural SurveillanceCode0
Few-shot Action Recognition with Permutation-invariant AttentionCode0
Long-term Temporal Convolutions for Action RecognitionCode0
Compressed Video Action RecognitionCode0
Long-Term Feature Banks for Detailed Video UnderstandingCode0
On Geometric Features for Skeleton-Based Action Recognition using Multilayer LSTM NetworksCode0
Online Action RecognitionCode0
Action Recognition with Trajectory-Pooled Deep-Convolutional DescriptorsCode0
Online Action Recognition for Human Risk Prediction with Anticipated Haptic Alert via WearablesCode0
Action Recognition with Multi-stream Motion Modeling and Mutual Information MaximizationCode0
Online Human Action Detection using Joint Classification-Regression Recurrent Neural NetworksCode0
Skeleton-Split Framework using Spatial Temporal Graph Convolutional Networks for Action RecogntionCode0
SoccerDB: A Large-Scale Database for Comprehensive Video UnderstandingCode0
Online Recognition of Actions Involving ObjectsCode0
LoCATe-GAT: Modeling Multi-Scale Local Context and Action Relationships for Zero-Shot Action RecognitionCode0
Online Spatiotemporal Action Detection and Prediction via Causal RepresentationsCode0
On Modality Bias Recognition and ReductionCode0
Features Understanding in 3D CNNs for Actions Recognition in VideoCode0
Local Spherical Harmonics Improve Skeleton-Based Hand Action RecognitionCode0
3D Pose from Motion for Cross-view Action Recognition via Non-linear Circulant Temporal EncodingCode0
Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized?Code0
Comparative Analysis: Violence Recognition from Videos using Transfer LearningCode0
Unmasked Teacher: Towards Training-Efficient Video Foundation ModelsCode0
The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy OptimizationCode0
Video Relationship Detection Using Mixture of ExpertsCode0
Lightweight Recurrent Cross-modal Encoder for Video Question AnsweringCode0
Let's Dance: Learning From Online Dance VideosCode0
Opening the Vocabulary of Egocentric ActionsCode0
Video Representation Learning by Dense Predictive CodingCode0
Open Set Domain Adaptation for Image and Action RecognitionCode0
EV-Action: Electromyography-Vision Multi-Modal Action DatasetCode0
Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action RecognitionCode0
Expressive Keypoints for Skeleton-based Action Recognition via Skeleton TransformationCode0
Exploring Temporal Information for Improved Video UnderstandingCode0
Comparative Analysis of CNN-based Spatiotemporal Reasoning in VideosCode0
The Spike Gating Flow: A Hierarchical Structure Based Spiking Neural Network for Online Gesture RecognitionCode0
What Makes Training Multi-Modal Classification Networks Hard?Code0
Show:102550
← PrevPage 49 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified