SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 201250 of 2759 papers

TitleStatusHype
EZ-CLIP: Efficient Zeroshot Video Action RecognitionCode1
Fast Fourier ConvolutionCode1
A Body Part Embedding Model With Datasets for Measuring 2D Human Motion SimilarityCode1
Federated Learning for Multi-Center Imaging Diagnostics: A Study in Cardiovascular DiseaseCode1
ActionCLIP: A New Paradigm for Video Action RecognitionCode1
Few-shot Action Recognition with Prototype-centered Attentive LearningCode1
AR-Net: Adaptive Frame Resolution for Efficient Action RecognitionCode1
FreqMixFormerV2: Lightweight Frequency-aware Mixed Transformer for Human Skeleton Action RecognitionCode1
CDFSL-V: Cross-Domain Few-Shot Learning for VideosCode1
CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D NetworksCode1
A Large-Scale Study on Video Action Dataset CondensationCode1
GCN-DevLSTM: Path Development for Skeleton-Based Action RecognitionCode1
Gimme Signals: Discriminative signal encoding for multimodal activity recognitionCode1
GliTr: Glimpse Transformers with Spatiotemporal Consistency for Online Action PredictionCode1
C2C: Component-to-Composition Learning for Zero-Shot Compositional Action RecognitionCode1
A Lie Group Approach to Riemannian Batch NormalizationCode1
Group Contextualization for Video RecognitionCode1
Full-Body Articulated Human-Object InteractionCode1
A Closer Look at Spatiotemporal Convolutions for Action RecognitionCode1
HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action RecognitionCode1
Hidden Two-Stream Convolutional Networks for Action RecognitionCode1
A Local-to-Global Approach to Multi-modal Movie Scene SegmentationCode1
Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB VideosCode1
HierVL: Learning Hierarchical Video-Language EmbeddingsCode1
A Multigrid Method for Efficiently Training Video ModelsCode1
Holistic Interaction Transformer Network for Action DetectionCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
An Action Is Worth Multiple Words: Handling Ambiguity in Action RecognitionCode1
Human-centric Scene Understanding for 3D Large-scale ScenariosCode1
Bringing Online Egocentric Action Recognition into the wildCode1
HyRSM++: Hybrid Relation Guided Temporal Set Matching for Few-shot Action RecognitionCode1
ImageNet-21K Pretraining for the MassesCode1
MViTv2: Improved Multiscale Vision Transformers for Classification and DetectionCode1
Improved Residual Networks for Image and Video RecognitionCode1
InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action RecognitionCode1
InfoGCN: Representation Learning for Human Skeleton-Based Action RecognitionCode1
InHARD - Industrial Human Action Recognition Dataset in the Context of Industrial Collaborative RoboticsCode1
IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in VideosCode1
Building a Multi-modal Spatiotemporal Expert for Zero-shot Action Recognition with CLIPCode1
ViViT: A Video Vision TransformerCode1
Action Transformer: A Self-Attention Model for Short-Time Pose-Based Human Action RecognitionCode1
Is Appearance Free Action Recognition Possible?Code1
3D Human Action Representation Learning via Cross-View Consistency PursuitCode1
Bridging Video-text Retrieval with Multiple Choice QuestionsCode1
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily LivingCode1
Keeping Your Eye on the Ball: Trajectory Attention in Video TransformersCode1
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
An Evaluation of Action Recognition Models on EPIC-KitchensCode1
Large-Scale Video Classification with Convolutional Neural NetworksCode1
Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the ArtCode1
Show:102550
← PrevPage 5 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified