SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 12011250 of 2759 papers

TitleStatusHype
Action Recognition using Transfer Learning and Majority Voting for CSGO0
Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing0
Skeleton-Split Framework using Spatial Temporal Graph Convolutional Networks for Action RecogntionCode0
Sequence-to-Sequence Modeling for Action Identification at High Temporal ResolutionCode0
Event and Activity Recognition in Video Surveillance for Cyber-Physical Systems0
Relational Self-Attention: What's Missing in Attention for Video UnderstandingCode1
Revisiting spatio-temporal layouts for compositional action recognitionCode1
Re-ID-AR: Improved Person Re-identification in Video via Joint Weakly Supervised Action RecognitionCode0
MetaVD: A Meta Video Dataset for enhancing human action recognition datasetsCode0
Gradient Frequency Modulation for Visually Explaining Video Understanding Models0
LSTA-Net: Long short-term Spatio-Temporal Aggregation Network for Skeleton-based Action RecognitionCode0
With a Little Help from my Temporal Context: Multimodal Egocentric Action RecognitionCode1
Livestock Monitoring with Transformer0
Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding0
Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition0
Zero-Shot Action Recognition from Diverse Object-Scene CompositionsCode0
IIP-Transformer: Intra-Inter-Part Transformer for Skeleton-Based Action Recognition0
A Variational Graph Autoencoder for Manipulation Action Recognition and PredictionCode0
Logsig-RNN: a novel network for robust and efficient skeleton-based action recognitionCode1
Spatio-Temporal Graph Complementary Scattering Networks0
GTM: Gray Temporal Model for Video Recognition0
Spatial-Temporal Transformer for 3D Point Cloud Sequences0
Domain Generalization through Audio-Visual Relative Norm Alignment in First Person Action Recognition0
LSTC: Boosting Atomic Action Detection with Long-Short-Term ContextCode1
Counterfactual Debiasing Inference for Compositional Action RecognitionCode1
TEAM-Net: Multi-modal Learning for Video Action Recognition with Partial DecodingCode0
SCA Net: Sparse Channel Attention Module for Action Recognition0
Video-based cattle identification and action recognitionCode0
"Knights": First Place Submission for VIPriors21 Action Recognition Challenge at ICCV 20210
Nuisance-Label Supervision: Robustness Improvement by Free Labels0
Object-Region Video TransformersCode1
Sign Language Recognition via Skeleton-Aware Multi-Model EnsembleCode1
Video Is Graph: Structured Graph Module for Video Action Recognition0
Joint Learning On The Hierarchy Representation for Fine-Grained Human Action Recognition0
TAda! Temporally-Adaptive Convolutions for Video UnderstandingCode0
High-order Tensor Pooling with Attention for Action Recognition0
Cross-modal Knowledge Distillation for Vision-to-Sensor Action RecognitionCode0
A Multi-viewpoint Outdoor Dataset for Human Action RecognitionCode0
A Baseline Framework for Part-level Action Parsing and Action Recognition0
Construction Site Safety Monitoring and Excavator Activity Analysis System0
SAIC_Cambridge-HuPBA-FBK Submission to the EPIC-Kitchens-100 Action Recognition Challenge 20210
Efficient Modelling Across Time of Human Actions and Interactions0
Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learning0
Spatio-Temporal Video Representation Learning for AI Based Video Playback Style Prediction0
Unsupervised Motion Representation Learning with Capsule AutoencodersCode0
Deep Learning-based Action Detection in Untrimmed Videos: A Survey0
Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark0
Motion-aware Contrastive Video Representation Learning via Foreground-background MergingCode1
Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation0
Transductive Universal Transport for Zero-Shot Action Recognition0
Show:102550
← PrevPage 25 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified