SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 11011150 of 2759 papers

TitleStatusHype
On Modality Bias Recognition and ReductionCode0
Motion-driven Visual Tempo Learning for Video-based Action RecognitionCode1
Skeleton Sequence and RGB Frame Based Multi-Modality Feature Fusion Network for Action Recognition0
Delving Deep into One-Shot Skeleton-based Action Recognition with Diverse OcclusionsCode1
Student Dangerous Behavior Detection in SchoolCode1
Going Deeper into Recognizing Actions in Dark Environments: A Comprehensive Benchmark Study0
ActionFormer: Localizing Moments of Actions with TransformersCode2
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision0
HAA4D: Few-Shot Human Atomic Action Recognition via 3D Spatio-Temporal Skeletal Alignment0
HAKE: A Knowledge Engine Foundation for Human Activity UnderstandingCode2
Source-Free Progressive Graph Learning for Open-Set Domain AdaptationCode1
Joint-bone Fusion Graph Convolutional Network for Semi-supervised Skeleton Action Recognition0
CZU-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and 10 wearable inertial sensorsCode1
Bootstrapped Representation Learning for Skeleton-Based Action Recognition0
Towards To-a-T Spatio-Temporal Focus for Skeleton-Based Action Recognition0
ADG-Pose: Automated Dataset Generation for Real-World Human Pose EstimationCode0
Benchmarking Conventional Vision Models on Neuromorphic Fall Detection and Action Recognition Dataset0
Head and eye egocentric gesture recognition for human-robot interaction using eyewear cameras0
Capturing Temporal Information in a Single Frame: Channel Sampling Strategies for Action RecognitionCode0
Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks0
Omnivore: A Single Model for Many Visual ModalitiesCode2
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video RecognitionCode1
Self-supervised Video Representation Learning with Cascade Positive RetrievalCode0
Action Keypoint Network for Efficient Video Recognition0
Multi-level Second-order Few-shot LearningCode0
Real-World Graph Convolution Networks (RW-GCNs) for Action Recognition in Smart Video SurveillanceCode0
Bridging Video-text Retrieval with Multiple Choice QuestionsCode1
Hand-Object Interaction Reasoning0
Semantic Labeling of Human Action For Visually Impaired And Blind People Scene Interaction0
Multiview Transformers for Video Recognition0
Boosting Video Representation Learning with Multi-Faceted Integration0
Representing Videos as Discriminative Sub-graphs for Action Recognition0
TSA-Net: Tube Self-Attention Network for Action Quality AssessmentCode1
Spatio-Temporal Tuples Transformer for Skeleton-Based Action RecognitionCode1
Complex Video Action Reasoning via Learnable Markov Logic Network0
Recurring the Transformer for Video Action Recognition0
Multi-Grained Spatio-Temporal Features Perceived Network for Event-Based Lip-Reading0
Motion-Modulated Temporal Fragment Alignment Network for Few-Shot Action Recognition0
E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action RecognitionCode1
Object-Relation Reasoning Graph for Action Recognition0
Uncertainty-Guided Probabilistic Transformer for Complex Action Recognition0
Learning Video Representations of Human Motion From Synthetic Data0
InfoGCN: Representation Learning for Human Skeleton-Based Action RecognitionCode1
Interact Before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition0
3D Skeleton-based Few-shot Action Recognition with JEANIE is not so Naïve0
Fine-grained Multi-Modal Self-Supervised Learning0
Recur, Attend or Convolve? On Whether Temporal Modeling Matters for Cross-Domain Robustness in Action RecognitionCode0
Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition0
Dynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition0
Precondition and Effect Reasoning for Action RecognitionCode0
Show:102550
← PrevPage 23 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified