SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1551–1600 of 2759 papers

TitleStatusHype
Training for temporal sparsity in deep neural networks, application in video processing—0
Delta Sampling R-BERT for limited data and low-light action recognition—0
Interpretable Deep Feature Propagation for Early Action Recognition—0
Aligning Correlation Information for Domain Adaptation in Action Recognition—0
Review of Video Predictive Understanding: Early Action Recognition and Future Action Prediction—0
Video 3D Sampling for Self-supervised Representation Learning—0
PoliTO-IIT Submission to the EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition—0
VideoLightFormer: Lightweight Action Recognition using Transformers—0
Long-Short Temporal Modeling for Efficient Action Recognition—0
Attention Bottlenecks for Multimodal FusionCode0
Word-level Sign Language Recognition with Multi-stream Neural Networks Focusing on Local Regions and Skeletal Information—0
Team PyKale (xy9) Submission to the EPIC-Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition—0
Transfer Learning of Deep Spatiotemporal Networks to Model Arbitrarily Long Videos of SeizuresCode0
SHREC 2021: Track on Skeleton-based Hand Gesture Recognition in the Wild—0
Learning Graphs for Knowledge Transfer With Limited Labels—0
Graph-Based High-Order Relation Modeling for Long-Term Action Recognition—0
Spatio-temporal Contrastive Domain Adaptation for Action Recognition—0
EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 2021: Team M3EM Technical Report—0
MaCLR: Motion-aware Contrastive Learning of Representations for VideosCode0
Long-Short Temporal Contrastive Learning of Video Transformers—0
Gradient Forward-Propagation for Large-Scale Temporal Video Modelling—0
Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action Recognition—0
Transformed ROIs for Capturing Visual Transformations in Videos—0
ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency—0
Cross-Domain First Person Audio-Visual Action Recognition through Relative Norm Alignment—0
TSI: Temporal Saliency Integration for Video Action Recognition—0
A Study On the Effects of Pre-processing On Spatio-temporal Action Recognition Using Spiking Neural Networks Trained with STDP—0
Inertial Sensor Data To Image Encoding For Human Action Recognition—0
The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy OptimizationCode0
SSAN: Separable Self-Attention Network for Video Representation Learning—0
The Imaginative Generative Adversarial Network: Automatic Data Augmentation for Dynamic Skeleton-Based Hand Gesture and Human Action Recognition—0
Anticipating human actions by correlating past with the future with Jaccard similarity measures—0
GAN for Vision, KG for Relation: a Two-stage Deep Network for Zero-shot Action Recognition—0
Real-time Human Action Recognition Using Locally Aggregated Kinematic-Guided Skeletonlet and Supervised Hashing-by-Analysis Model—0
Egocentric Activity Recognition and Localization on a 3D Map—0
REGINA - Reasoning Graph Convolutional Networks in Human Action Recognition—0
Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency—0
An Empirical Review of Deep Learning Frameworks for Change Detection: Model Design, Experimental Frameworks, Challenges and Research Needs—0
Motion-Augmented Self-Training for Video Recognition at Smaller Scale—0
Action in Mind: A Neural Network Approach to Action Recognition and Segmentation—0
Unsupervised Discriminative Embedding for Sub-Action Learning in Complex Activities—0
Three-stream network for enriched Action Recognition—0
Modeling long-term interactions to enhance action recognition—0
3D Convolutional Neural Networks for Ultrasound-Based Silent Speech Interfaces—0
VidTr: Video Transformer Without Convolutions—0
H2O: Two Hands Manipulating Objects for First Person Interaction Recognition—0
Hierarchical growing grid networks for skeleton based action recognitionCode0
Skimming and Scanning for Untrimmed Video Action Recognition—0
Temporal Query Networks for Fine-grained Video Understanding—0
First and Second Order Dynamics in a Hierarchical SOM system for Action RecognitionCode0
Show:102550
← PrevPage 32 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified