SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 10511100 of 2759 papers

TitleStatusHype
Actionlet-Dependent Contrastive Learning for Unsupervised Skeleton-Based Action Recognition0
Distribution of Action Movements (DAM): A Descriptor for Human Action Recognition0
Distributed non-parametric deep and wide networks0
DistInit: Learning Video Representations Without a Single Labeled Video0
Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgery0
A discussion on the validation tests employed to compare human action recognition methods using the MSR Action3D dataset0
Distilling Knowledge from CNN-Transformer Models for Enhanced Human Action Recognition0
Distillation of Human-Object Interaction Contexts for Action Recognition0
Automatic evaluation of herding behavior in towed fishing gear using end-to-end training of CNN and attention-based networks0
StableMamba: Distillation-free Scaling of Large SSMs for Images and Videos0
Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding0
Automatic Curation of Golf Highlights using Multimodal Excitement Features0
ADHD diagnosis based on action characteristics recorded in videos using machine learning0
Disentangled Action Recognition with Knowledge Bases0
A^2-Nets: Double Attention Networks0
HumMUSS: Human Motion Understanding using State Space Models0
HyLiFormer: Hyperbolic Linear Attention for Skeleton-based Human Action Recognition0
iCub! Do you recognize what I am doing?: multimodal human action recognition on multisensory-enabled iCub robot0
DiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks0
Discriminative Video Representation Learning Using Support Vector Classifiers0
Discriminatively Trained Latent Ordinal Model for Video Classification0
Discriminative Hierarchical Rank Pooling for Activity Recognition0
A Unified Model Selection Technique for Spectral Clustering Based Motion Segmentation0
Discriminative Dictionary Design for Action Classification in Still Images and Videos0
Discriminative convolutional Fisher vector network for action recognition0
A Unified Method for First and Third Person Action Recognition0
Discriminative Bayesian Dictionary Learning for Classification0
A Unified Framework to Analyze and Design the Nonlocal Blocks for Neural Networks0
A Deep Learning Approach for Real-Time 3D Human Action Recognition from Skeletal Data0
Action Keypoint Network for Efficient Video Recognition0
3Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognition0
Discriminability Distillation in Group Representation Learning0
A Unified Framework for Human-centric Point Cloud Video Understanding0
Direct Motion Models for Assessing Generated Videos0
Directional Temporal Modeling for Action Recognition0
A Unified Deep Framework for Joint 3D Pose Estimation and Action Recognition from a Single RGB Camera0
Direct Dense Pose Estimation0
Augmenting and Aligning Snippets for Few-Shot Video Domain Adaptation0
DIR-AS: Decoupling Individual Identification and Temporal Reasoning for Action Segmentation0
Clustering and Recognition of Spatiotemporal Features through Interpretable Embedding of Sequence to Sequence Recurrent Neural Networks0
Adding Attentiveness to the Neurons in Recurrent Neural Networks0
Action in Mind: A Neural Network Approach to Action Recognition and Segmentation0
Human Stone Toolmaking Action Grammar (HSTAG): A Challenging Benchmark for Fine-grained Motor Behavior Recognition0
Differential Recurrent Neural Networks for Action Recognition0
Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition0
Dictionary Learning and Sparse Coding on Grassmann Manifolds: An Extrinsic Solution0
AdaSGN: Adapting Joint Number and Model Size for Efficient Skeleton-Based Action Recognition0
Action Genome: Actions As Compositions of Spatio-Temporal Scene Graphs0
Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events0
DevNet: A Deep Event Network for Multimedia Event Detection and Evidence Recounting0
Show:102550
← PrevPage 22 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified