SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 1201–1250 of 2759 papers

TitleStatusHype
Action Recognition using Transfer Learning and Majority Voting for CSGO—0
Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing—0
Skeleton-Split Framework using Spatial Temporal Graph Convolutional Networks for Action RecogntionCode0
Sequence-to-Sequence Modeling for Action Identification at High Temporal ResolutionCode0
Event and Activity Recognition in Video Surveillance for Cyber-Physical Systems—0
Relational Self-Attention: What's Missing in Attention for Video UnderstandingCode1
Revisiting spatio-temporal layouts for compositional action recognitionCode1
Re-ID-AR: Improved Person Re-identification in Video via Joint Weakly Supervised Action RecognitionCode0
MetaVD: A Meta Video Dataset for enhancing human action recognition datasetsCode0
Gradient Frequency Modulation for Visually Explaining Video Understanding Models—0
LSTA-Net: Long short-term Spatio-Temporal Aggregation Network for Skeleton-based Action RecognitionCode0
With a Little Help from my Temporal Context: Multimodal Egocentric Action RecognitionCode1
Livestock Monitoring with Transformer—0
Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding—0
Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition—0
Zero-Shot Action Recognition from Diverse Object-Scene CompositionsCode0
IIP-Transformer: Intra-Inter-Part Transformer for Skeleton-Based Action Recognition—0
A Variational Graph Autoencoder for Manipulation Action Recognition and PredictionCode0
Logsig-RNN: a novel network for robust and efficient skeleton-based action recognitionCode1
Spatio-Temporal Graph Complementary Scattering Networks—0
GTM: Gray Temporal Model for Video Recognition—0
Spatial-Temporal Transformer for 3D Point Cloud Sequences—0
Domain Generalization through Audio-Visual Relative Norm Alignment in First Person Action Recognition—0
LSTC: Boosting Atomic Action Detection with Long-Short-Term ContextCode1
Counterfactual Debiasing Inference for Compositional Action RecognitionCode1
TEAM-Net: Multi-modal Learning for Video Action Recognition with Partial DecodingCode0
SCA Net: Sparse Channel Attention Module for Action Recognition—0
Video-based cattle identification and action recognitionCode0
"Knights": First Place Submission for VIPriors21 Action Recognition Challenge at ICCV 2021—0
Nuisance-Label Supervision: Robustness Improvement by Free Labels—0
Object-Region Video TransformersCode1
Sign Language Recognition via Skeleton-Aware Multi-Model EnsembleCode1
Video Is Graph: Structured Graph Module for Video Action Recognition—0
Joint Learning On The Hierarchy Representation for Fine-Grained Human Action Recognition—0
TAda! Temporally-Adaptive Convolutions for Video UnderstandingCode0
High-order Tensor Pooling with Attention for Action Recognition—0
Cross-modal Knowledge Distillation for Vision-to-Sensor Action RecognitionCode0
A Multi-viewpoint Outdoor Dataset for Human Action RecognitionCode0
A Baseline Framework for Part-level Action Parsing and Action Recognition—0
Construction Site Safety Monitoring and Excavator Activity Analysis System—0
SAIC_Cambridge-HuPBA-FBK Submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021—0
Efficient Modelling Across Time of Human Actions and Interactions—0
Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learning—0
Spatio-Temporal Video Representation Learning for AI Based Video Playback Style Prediction—0
Unsupervised Motion Representation Learning with Capsule AutoencodersCode0
Deep Learning-based Action Detection in Untrimmed Videos: A Survey—0
Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark—0
Motion-aware Contrastive Video Representation Learning via Foreground-background MergingCode1
Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation—0
Transductive Universal Transport for Zero-Shot Action Recognition—0
Show:102550
← PrevPage 25 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4InternVideoTop-1 Accuracy77.2—Unverified
5DejaVidTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec3-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec23-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
10Text4Vis3-fold Accuracy98.2—Unverified