SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 51100 of 2759 papers

TitleStatusHype
Omnivore: A Single Model for Many Visual ModalitiesCode2
Video Swin TransformerCode2
Learning Transferable Visual Models From Natural Language SupervisionCode2
Is Space-Time Attention All You Need for Video Understanding?Code2
Omni-sourced Webly-supervised Learning for Video RecognitionCode2
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?Code2
Temporal Segment Networks for Action Recognition in VideosCode2
Temporal Action Detection with Structured Segment NetworksCode2
Temporal Segment Networks: Towards Good Practices for Deep Action RecognitionCode2
Learning Spatiotemporal Features with 3D Convolutional NetworksCode2
Zero-shot Skeleton-based Action Recognition with Prototype-guided Feature AlignmentCode1
EPFL-Smart-Kitchen-30: Densely annotated cooking dataset with 3D kinematics to challenge video and language modelsCode1
EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity UnderstandingCode1
SkeletonX: Data-Efficient Skeleton-based Action Recognition via Cross-sample Feature AggregationCode1
Temporal Alignment-Free Video Matching for Few-shot Action RecognitionCode1
Siformer: Feature-isolated Transformer for Efficient Skeleton-based Sign Language RecognitionCode1
MPTSNet: Integrating Multiscale Periodic Local Patterns and Global Dependencies for Multivariate Time Series ClassificationCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and GlassesCode1
DSTSA-GCN: Advancing Skeleton-Based Gesture Recognition with Semantic-Aware Spatio-Temporal Topology ModelingCode1
SeFAR: Semi-supervised Fine-grained Action Recognition with Temporal Perturbation and Learning StabilizationCode1
Mamba4D: Efficient 4D Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space ModelsCode1
A Large-Scale Study on Video Action Dataset CondensationCode1
FreqMixFormerV2: Lightweight Frequency-aware Mixed Transformer for Human Skeleton Action RecognitionCode1
Prototypical Calibrating Ambiguous Samples for Micro-Action RecognitionCode1
WiFi CSI Based Temporal Activity Detection via Dual Pyramid NetworkCode1
Do Language Models Understand Time?Code1
Building a Multi-modal Spatiotemporal Expert for Zero-shot Action Recognition with CLIPCode1
USDRL: Unified Skeleton-Based Dense Representation Learning with Multi-Grained Feature DecorrelationCode1
KNN-MMD: Cross Domain Wireless Sensing via Local Distribution AlignmentCode1
TAMT: Temporal-Aware Model Tuning for Cross-Domain Few-Shot Action RecognitionCode1
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense EvaluationCode1
TDSM: Triplet Diffusion for Skeleton-Text Matching in Zero-Shot Action RecognitionCode1
SpikMamba: When SNN meets Mamba in Event-based Human Action RecognitionCode1
CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action RecognitionCode1
TASAR: Transfer-based Attack on Skeletal Action RecognitionCode1
Fisher Information guided Purification against Backdoor AttacksCode1
TWLV-I: Analysis and Insights from Holistic Evaluation on Video Foundation ModelsCode1
TDS-CLIP: Temporal Difference Side Network for Image-to-Video Transfer LearningCode1
SHARP: Segmentation of Hands and Arms by Range using Pseudo-Depth for Enhanced Egocentric 3D Hand Pose Estimation and Action RecognitionCode1
Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and AlgorithmsCode1
EPAM-Net: An Efficient Pose-driven Attention-guided Multimodal Network for Video Action RecognitionCode1
Multi-Modality Co-Learning for Efficient Skeleton-based Action RecognitionCode1
SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational AutoencodersCode1
Shap-Mix: Shapley Value Guided Mixing for Long-Tailed Skeleton Based Action RecognitionCode1
Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed TransformerCode1
STARS: Self-supervised Tuning for 3D Action Recognition in Skeleton SequencesCode1
Augmented Neural Fine-Tuning for Efficient Backdoor PurificationCode1
C2C: Component-to-Composition Learning for Zero-Shot Compositional Action RecognitionCode1
DailyDVS-200: A Comprehensive Benchmark Dataset for Event-Based Action RecognitionCode1
Show:102550
← PrevPage 2 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified