SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 17011750 of 2759 papers

TitleStatusHype
Human activity recognition using improved dynamic image0
Prototypical Contrast and Reverse Prediction: Unsupervised Skeleton Based Action RecognitionCode0
Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition0
Unsupervised Video Representation Learning by Bidirectional Feature Prediction0
FlowCaps: Optical Flow Estimation with Capsule Networks For Action Recognition0
Learning Representations from Audio-Visual Spatial Alignment0
Memory Group Sampling Based Online Action Recognition Using Kinetic Skeleton Features0
A Survey on Contrastive Self-supervised Learning0
Bubblenet: A Disperse Recurrent Structure To Recognize Activities0
Pose-based Body Language Recognition for Emotion and Psychiatric Symptom Interpretation0
CNN based Multistage Gated Average Fusion (MGAF) for Human Action Recognition Using Depth and Inertial SensorsCode0
SAR-NAS: Skeleton-based Action Recognition via Neural Architecture Searching0
ElderSim: A Synthetic Data Generation Platform for Human Action Recognition in Eldercare Applications0
Cycle-Contrast for Self-Supervised Video Representation Learning0
Nested Grassmannians for Dimensionality Reduction with ApplicationsCode0
Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition0
View-Invariant, Occlusion-Robust Probabilistic Embedding for Human PoseCode0
Learning to Sort Image Sequences via Accumulated Temporal Differences0
Temporal Binary Representation for Event-Based Action RecognitionCode0
A Grid-based Representation for Human Action Recognition0
Toward Accurate Person-level Action Recognition in Videos of Crowded Scenes0
HPERL: 3D Human Pose Estimation from RGB and LiDARCode0
Pose And Joint-Aware Action RecognitionCode0
Pose Refinement Graph Convolutional Network for Skeleton-based Action Recognition0
Back to the Future: Cycle Encoding Prediction for Self-supervised Contrastive Video Representation LearningCode0
Few-shot Action Recognition with Implicit Temporal Alignment and Pair Similarity Optimization0
Reconfigurable Cyber-Physical System for Lifestyle Video-Monitoring via Deep Learning0
A Variational Information Bottleneck Based Method to Compress Sequential Networks for Human Action Recognition0
Features Understanding in 3D CNNs for Actions Recognition in VideoCode0
Knowledge Fusion Transformers for Video Action Recognition0
Action Concept Grounding Network for Semantically-Consistent Video Generation0
Event-based Action Recognition Using Timestamp Image Encoding Network0
PERF-Net: Pose Empowered RGB-Flow Net0
Online Learnable Keyframe Extraction in Videos and its Application with Semantic Word Vector in Action Recognition0
DeepActsNet: Spatial and Motion features from Face, Hands, and Body Combined with Convolutional and Graph Networks for Improved Action Recognition0
Knowledge Guided Learning: Towards Open Domain Egocentric Action Recognition with Zero Supervision0
Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition0
Collaborative Attention Mechanism for Multi-View Action Recognition0
HAA500: Human-Centric Atomic Action Dataset with Curated Videos0
Unmanned Aerial Vehicle Control Through Domain-based Automatic Speech Recognition0
A novel action recognition system for smart monitoring of elderly people using Action Pattern Image and Series CNN with transfer learning0
View-invariant action recognition0
Online Spatiotemporal Action Detection and Prediction via Causal RepresentationsCode0
All About Knowledge Graphs for Actions0
Effective Action Recognition with Embedded Key Point Shifts0
Visual Concept Reasoning Networks0
A Prospective Study on Sequence-Driven Temporal Sampling and Ego-Motion Compensation for Action Recognition in the EPIC-Kitchens Dataset0
Spatiotemporal Action Recognition in Restaurant VideosCode0
Two-Stream Networks for Lane-Change Prediction of Surrounding Vehicles0
Decision Support for Video-based Detection of Flu Symptoms0
Show:102550
← PrevPage 35 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified