SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1101–1150 of 2759 papers

TitleStatusHype
Multi-scale spatial–temporal convolutional neural network for skeleton-based action recognitionCode0
Few-shot Action Recognition via Intra- and Inter-Video Information Maximization—0
Learning Video-Conditioned Policies for Unseen Manipulation Tasks—0
Self-Supervised Video Representation Learning via Latent Time Navigation—0
Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach—0
Modelling Spatio-Temporal Interactions for Compositional Action Recognition—0
Cross-Stream Contrastive Learning for Self-Supervised Skeleton-Based Action Recognition—0
Cross-view Action Recognition via Contrastive View-invariant Representation—0
Physical Adversarial Attacks for Surveillance: A Survey—0
Deep Graph Reprogramming—0
End-to-End Spatio-Temporal Action Localisation with Video Transformers—0
RHM: Robot House Multi-view Human Activity Recognition DatasetCode0
Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis—0
Search-Map-Search: A Frame Selection Paradigm for Action Recognition—0
A baseline on continual learning methods for video action recognition—0
Human activity recognition using deep learning approaches and single frame cnn and convolutional lstm—0
Self-Supervised 3D Action Representation Learning with Skeleton Cloud Colorization—0
GoferBot: A Visual Guided Human-Robot Collaborative Assembly System—0
ATTACH Dataset: Annotated Two-Handed Assembly Actions for Human Action Understanding—0
Peer-to-Peer Federated Continual Learning for Naturalistic Driving Action Recognition—0
PMI Sampler: Patch Similarity Guided Frame Selection for Aerial Action RecognitionCode0
NEV-NCD: Negative Learning, Entropy, and Variance regularization based novel action categories discoveryCode0
Skeleton-based action analysis for ADHD diagnosis—0
Attack-Augmentation Mixing-Contrastive Skeletal Representation LearningCode0
Therbligs in Action: Video Understanding through Motion Primitives—0
DIR-AS: Decoupling Individual Identification and Temporal Reasoning for Action Segmentation—0
A real-time algorithm for human action recognition in RGB and thermal video—0
Focalized Contrastive View-invariant Learning for Self-supervised Skeleton-based Action Recognition—0
DOAD: Decoupled One Stage Action Detection Network—0
HaLP: Hallucinating Latent Positives for Skeleton-based Self-Supervised Learning of ActionsCode0
HARFLOW3D: A Latency-Oriented 3D-CNN Accelerator Toolflow for HAR on FPGA DevicesCode0
A Video-based End-to-end Pipeline for Non-nutritive Sucking Action Recognition and Segmentation in Young InfantsCode0
Colo-SCRL: Self-Supervised Contrastive Representation Learning for Colonoscopic Video Retrieval—0
Structured Video-Language Modeling with Temporal Grouping and Spatial Grounding—0
Unmasked Teacher: Towards Training-Efficient Video Foundation ModelsCode0
Rethinking matching-based few-shot action recognition—0
CycleACR: Cycle Modeling of Actor-Context Relations for Video Action DetectionCode0
Prompt-Guided Zero-Shot Anomaly Action Recognition using Pretrained Deep Skeleton Features—0
Unified Keypoint-based Action Recognition Framework via Structured Keypoint Pooling—0
Multi-view knowledge distillation transformer for human action recognition—0
3Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognition—0
Towards Scalable Neural Representation for Diverse Videos—0
Automatic evaluation of herding behavior in towed fishing gear using end-to-end training of CNN and attention-based networks—0
ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked AutoencodersCode0
Actionlet-Dependent Contrastive Learning for Unsupervised Skeleton-Based Action Recognition—0
Augmenting and Aligning Snippets for Few-Shot Video Domain Adaptation—0
Video Action Recognition with Attentive Semantic Units—0
EgoViT: Pyramid Video Transformer for Egocentric Action Recognition—0
Challenges of the Creation of a Dataset for Vision Based Human Hand Action Recognition in Industrial Assembly—0
Event Voxel Set Transformer for Spatiotemporal Representation Learning on Event StreamsCode0
Show:102550
← PrevPage 23 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4InternVideoTop-1 Accuracy77.2—Unverified
5DejaVidTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3OmniVec3-fold Accuracy99.6—Unverified
4VideoMAE V2-g3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
10Text4Vis3-fold Accuracy98.2—Unverified