SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 2759 papers

TitleStatusHype
HYperbolic Self-Paced Learning for Self-Supervised Skeleton-based Action RepresentationsCode1
Hypergraph Transformer for Skeleton-based Action RecognitionCode1
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
Context-Aware RCNN: A Baseline for Action Detection in VideosCode1
Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video DatasetCode1
Compressing Recurrent Neural Networks with Tensor Ring for Action RecognitionCode1
Volterra Neural Networks (VNNs)Code1
Constructing Stronger and Faster Baselines for Skeleton-based Action RecognitionCode1
Actor-Context-Actor Relation Network for Spatio-Temporal Action LocalizationCode1
Conquering the cnn over-parameterization dilemma: A volterra filtering approach for action recognitionCode1
Action-Conditioned 3D Human Motion Synthesis with Transformer VAECode1
Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed GradientCode1
IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in VideosCode1
Integrating Human Gaze into Attention for Egocentric Activity RecognitionCode1
Hierarchical Consistent Contrastive Learning for Skeleton-Based Action Recognition with Growing AugmentationsCode1
Interactive Spatiotemporal Token Attention Network for Skeleton-based General Interactive Action RecognitionCode1
Higher Order Recurrent Space-Time Transformer for Video Action PredictionCode1
ConvNet Architecture Search for Spatiotemporal Feature LearningCode1
Cross-Architecture Self-supervised Video Representation LearningCode1
E^2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action RecognitionCode1
BEVT: BERT Pretraining of Video TransformersCode1
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily LivingCode1
CT-Net: Channel Tensorization Network for Video ClassificationCode1
Lane Change Classification and Prediction with Action Recognition NetworksCode1
Attention-Based Context Aware Reasoning for Situation RecognitionCode1
Graph Contrastive Learning for Skeleton-based Action RecognitionCode1
Graph in Graph Neural NetworkCode1
CZU-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and 10 wearable inertial sensorsCode1
Attention Prompt Tuning: Parameter-efficient Adaptation of Pre-trained Models for Spatiotemporal ModelingCode1
3DV: 3D Dynamic Voxel for Action Recognition in Depth VideoCode1
Action Genome: Actions as Composition of Spatio-temporal Scene GraphsCode1
D^2ST-Adapter: Disentangled-and-Deformable Spatio-Temporal Adapter for Few-shot Action RecognitionCode1
Data Efficient Video Transformer for Violence DetectionCode1
DailyDVS-200: A Comprehensive Benchmark Dataset for Event-Based Action RecognitionCode1
Benchmarking Micro-action Recognition: Dataset, Methods, and ApplicationsCode1
Decoupled Spatial-Temporal Attention Network for Skeleton-Based Action RecognitionCode1
Deep Analysis of CNN-based Spatio-temporal Representations for Action RecognitionCode1
Grad-CAM++: Improved Visual Explanations for Deep Convolutional NetworksCode1
Audio-Visual Instance Discrimination with Cross-Modal AgreementCode1
DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 PandemicCode1
Graph Convolution with Low-rank Learnable Local FiltersCode1
Augmented Neural Fine-Tuning for Efficient Backdoor PurificationCode1
BASAR:Black-box Attack on Skeletal Action RecognitionCode1
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense EvaluationCode1
A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic InformationCode1
Depth Guided Adaptive Meta-Fusion Network for Few-shot Video RecognitionCode1
Gimme Signals: Discriminative signal encoding for multimodal activity recognitionCode1
Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D SpaceCode1
A Dense-Sparse Complementary Network for Human Action Recognition based on RGB and Skeleton ModalitiesCode1
Anonymization for Skeleton Action RecognitionCode1
Show:102550
← PrevPage 7 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified