SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2051–2100 of 2759 papers

TitleStatusHype
Cross-Modal Message Passing for Two-stream Fusion—0
Curvature: A signature for Action Recognition in Video Sequences—0
Actional-Structural Graph Convolutional Networks for Skeleton-based Action RecognitionCode0
Large Scale Holistic Video UnderstandingCode1
DynamoNet: Dynamic Action and Motion Network—0
A Large-scale Varying-view RGB-D Action Dataset for Arbitrary-view Human Action Recognition—0
HAUAR: Home Automation Using Action Recognition—0
Learning Actor Relation Graphs for Group Activity RecognitionCode0
EV-Action: Electromyography-Vision Multi-Modal Action DatasetCode0
Temporal Unet: Sample Level Human Action Recognition using WiFiCode0
STEP: Spatio-Temporal Progressive Learning for Video Action DetectionCode0
Simple yet efficient real-time pose-based action recognitionCode0
Out-of-Distribution Detection for Generalized Zero-Shot Action RecognitionCode0
DDLSTM: Dual-Domain LSTM for Cross-Dataset Action Recognition—0
REPAIR: Removing Representation Bias by Dataset ResamplingCode0
Audio-Visual Model Distillation Using Acoustic ImagesCode0
Multi-View Region Adaptive Multi-temporal DMM and RGB Action Recognition—0
Recurrent Space-time Graph Neural NetworksCode0
Localized Trajectories for 2D and 3D Action Recognition—0
Attentive Action and Context Factorization—0
Knowledge Distillation for Human Action Anticipation—0
Action Recognition from Single Timestamp Supervision in Untrimmed VideosCode0
SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition—0
What and How Well You Performed? A Multitask Learning Approach to Action Quality AssessmentCode1
Relational Action Forecasting—0
Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance StatisticsCode1
LP-3DCNN: Unveiling Local Phase in 3D Convolutional Neural Networks—0
Attention Distillation for Learning Video Representations—0
End-to-End Video Captioning—0
Resource Efficient 3D Convolutional Neural NetworksCode0
Video Classification with Channel-Separated Convolutional NetworksCode0
Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action RecognitionCode0
On the Importance of Video Action Recognition for Visual Lipreading—0
Contextual Action Cues from Camera Sensor for Multi-Stream Action Recognition—0
Spatiotemporal Filtering for Event-Based Action Recognition—0
MFAS: Multimodal Fusion Architecture Search—0
Two-Stream Action Recognition-Oriented Video Super-ResolutionCode0
Investigation on Combining 3D Convolution of Image Data and Optical Flow to Generate Temporal Action Proposals—0
A Hybrid Framework for Action Recognition in Low-Quality Video Sequences—0
Spatiotemporal Pyramid Network for Video Action Recognition—0
Collaborative Spatio-temporal Feature Learning for Video Action RecognitionCode0
Beyond the Self: Using Grounded Affordances to Interpret and Describe Others' ActionsCode0
STAR-Net: Action Recognition using Spatio-Temporal Activation Reprojection—0
IF-TTN: Information Fused Temporal Transformation Network for Video Action Recognition—0
An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition—0
Privacy-Preserving Action Recognition using Coded Aperture Videos—0
Learning Transferable Self-attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision—0
Dynamic Matrix Decomposition for Action Recognition—0
A Mobile Robot Generating Video Summaries of Seniors' Indoor Activities—0
Real-time Hand Gesture Detection and Classification Using Convolutional Neural NetworksCode1
Show:102550
← PrevPage 42 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified