SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 451500 of 2759 papers

TitleStatusHype
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
InfoGCN: Representation Learning for Human Skeleton-Based Action RecognitionCode1
CDFSL-V: Cross-Domain Few-Shot Learning for VideosCode1
IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like SettingCode1
Interactive Spatiotemporal Token Attention Network for Skeleton-based General Interactive Action RecognitionCode1
Full-Body Articulated Human-Object InteractionCode1
An Action Is Worth Multiple Words: Handling Ambiguity in Action RecognitionCode1
Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the ArtCode1
IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in VideosCode1
Integrating Human Gaze into Attention for Egocentric Activity RecognitionCode1
Interactive Fusion of Multi-level Features for Compositional Activity RecognitionCode1
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action RecognitionCode1
Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video DatasetCode1
Volterra Neural Networks (VNNs)Code1
Compressing Recurrent Neural Networks with Tensor Ring for Action RecognitionCode1
CIAGAN: Conditional Identity Anonymization Generative Adversarial NetworksCode1
Leveraging Spatio-Temporal Dependency for Skeleton-Based Action RecognitionCode1
Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action RecognitionCode1
Isolated Sign Recognition from RGB Video using Pose Flow and Self-AttentionCode1
Is Appearance Free Action Recognition Possible?Code1
Lane Change Classification and Prediction with Action Recognition NetworksCode1
Iterate & Cluster: Iterative Semi-Supervised Action RecognitionCode1
TALLFormer: Temporal Action Localization with a Long-memory TransformerCode1
TAM: Temporal Adaptive Module for Video RecognitionCode1
CLIP-guided Prototype Modulating for Few-shot Action RecognitionCode1
Task-adaptive Spatial-Temporal Video Sampler for Few-shot Action RecognitionCode1
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily LivingCode1
Keeping Your Eye on the Ball: Trajectory Attention in Video TransformersCode1
E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action RecognitionCode1
A Comprehensive Study of Deep Video Action RecognitionCode1
Generative Action Description Prompts for Skeleton-based Action RecognitionCode1
TDSM: Triplet Diffusion for Skeleton-Text Matching in Zero-Shot Action RecognitionCode1
Complex Sequential Understanding through the Awareness of Spatial and Temporal ConceptsCode1
CoCon: Cooperative-Contrastive LearningCode1
Late Temporal Modeling in 3D CNN Architectures with BERT for Action RecognitionCode1
CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction AlignmentCode1
FLAVR: Flow-Agnostic Video Representations for Fast Frame InterpolationCode1
Collaborating Domain-shared and Target-specific Feature Clustering for Cross-domain 3D Action RecognitionCode1
Learning from Failure: Training Debiased Classifier from Biased ClassifierCode1
Learning from Temporal Gradient for Semi-supervised Action RecognitionCode1
Temporal Alignment Networks for Long-term VideoCode1
Temporal Alignment Prediction for Supervised Representation Learning and Few-Shot Sequence ClassificationCode1
Temporally Guided Articulated Hand Pose Tracking in Surgical VideosCode1
Temporal Pyramid Network for Action RecognitionCode1
Learning Self-Similarity in Space and Time as a Generalized Motion for Action RecognitionCode1
Learning Representational Invariances for Data-Efficient Action RecognitionCode1
Animal Kingdom: A Large and Diverse Dataset for Animal Behavior UnderstandingCode1
Learning Self-Similarity in Space and Time as Generalized Motion for Video Action RecognitionCode1
Learning Spatio-Temporal Representation with Pseudo-3D Residual NetworksCode1
An Image is Worth 16x16 Words, What is a Video Worth?Code1
Show:102550
← PrevPage 10 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified