SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1201–1250 of 2759 papers

TitleStatusHype
Deep set conditioned latent representations for action recognition—0
MoQuad: Motion-focused Quadruple Construction for Video Contrastive Learning—0
A Survey on Human Action Recognition—0
Video Segmentation Learning Using Cascade Residual Convolutional Neural Network—0
2D Pose Estimation based Child Action RecognitionCode0
Inductive Attention for Video Action Anticipation—0
iCub! Do you recognize what I am doing?: multimodal human action recognition on multisensory-enabled iCub robot—0
Cross-Modal Learning with 3D Deformable Attention for Action Recognition—0
Reconstructing Humpty Dumpty: Multi-feature Graph Autoencoder for Open Set Action Recognition—0
Contextual Explainable Video Representation: Human Perception-based UnderstandingCode0
FLAG3D: A 3D Fitness Activity Dataset with Language InstructionCode0
Multimodal Prototype-Enhanced Network for Few-Shot Action Recognition—0
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data—0
From Actions to Events: A Transfer Learning Approach Using Improved Deep Belief Networks—0
Hand Guided High Resolution Feature Enhancement for Fine-Grained Atomic Action Segmentation within Complex Human Assemblies—0
Query Efficient Cross-Dataset Transferable Black-Box Attack on Action Recognition—0
Dynamic Appearance: A Video Representation for Action Recognition with Joint Training—0
Global Temporal Difference Network for Action Recognition—0
Event Transformer+. A multi-purpose solution for efficient event data processing—0
Knowledge Prompting for Few-shot Action Recognition—0
3d human motion generation from the text via gesture action classification and the autoregressive model—0
Language-Assisted Deep Learning for Autistic Behaviors Recognition—0
edBB-Demo: Biometrics and Behavior Analysis for Online Educational PlatformsCode0
CoNFies: Controllable Neural Face Avatars—0
EVA: Exploring the Limits of Masked Visual Representation Learning at ScaleCode0
Extending Temporal Data Augmentation for Video Action Recognition—0
Quantifying and Learning Static vs. Dynamic Information in Deep Spatiotemporal Networks—0
Could Giant Pretrained Image Models Extract Universal Representations?—0
Learning a Condensed Frame for Memory-Efficient Video Class-Incremental Learning—0
Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing—0
No-audio speaking status detection in crowded settings via visual pose-based filtering and wearable acceleration—0
Temporal-Viewpoint Transportation Plan for Skeletal Few-shot Action Recognition—0
Uncertainty-DTW for Time Series and SequencesCode0
Text2Model: Text-based Model Induction for Zero-shot Image Classification—0
Learning Joint Representation of Human Motion and Language—0
Handwashing Action Detection System for an Autonomous Social RobotCode0
Adversarial Domain Adaptation for Action Recognition Around the Clock—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
Baby Physical Safety Monitoring in Smart Home Using Action Recognition System—0
3D Human Pose Estimation in Multi-View Operating Room Videos Using Differentiable Camera Projections—0
Transformer-based Action recognition in hand-object interacting scenarios—0
STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition—0
Improving Transfer Learning with a Dual Image and Video Transformer for Multi-label Movie Trailer Genre ClassificationCode0
Real-time Action Recognition for Fine-Grained Actions and The Hand Wash DatasetCode0
DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action RecognitionCode0
Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition—0
Students taught by multimodal teachers are superior action recognizers—0
BlanketSet -- A clinical real-world in-bed action recognition and qualitative semi-synchronised MoCap dataset—0
Self-Aligned Concave Curve: Illumination Enhancement for Unsupervised Adaptation—0
Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognition—0
Show:102550
← PrevPage 25 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified