SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 101150 of 2759 papers

TitleStatusHype
Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video DatasetCode1
Motion meets Attention: Video Motion PromptsCode1
Referring Atomic Video Action RecognitionCode1
Graph in Graph Neural NetworkCode1
Snakes and Ladders: Two Steps Up for VideoMambaCode1
Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNNCode1
Part-aware Unified Representation of Language and Skeleton for Zero-shot Action RecognitionCode1
EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery VideosCode1
EgoNCE++: Do Egocentric Video-Language Models Really Understand Hand-Object Interactions?Code1
HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action RecognitionCode1
CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction AlignmentCode1
VG4D: Vision-Language Model Goes 4D Video RecognitionCode1
Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in VideosCode1
Disentangled Pre-training for Human-Object Interaction DetectionCode1
PREGO: online mistake detection in PRocedural EGOcentric videosCode1
GCN-DevLSTM: Path Development for Skeleton-Based Action RecognitionCode1
ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and MoreCode1
A Lie Group Approach to Riemannian Batch NormalizationCode1
EventRPG: Event Data Augmentation with Relevance Propagation GuidanceCode1
On the Utility of 3D Hand Poses for Action RecognitionCode1
Attention Prompt Tuning: Parameter-efficient Adaptation of Pre-trained Models for Spatiotemporal ModelingCode1
Real-Time Multimodal Cognitive Assistant for Emergency Medical ServicesCode1
Benchmarking Micro-action Recognition: Dataset, Methods, and ApplicationsCode1
Rethinking CLIP-based Video Learners in Cross-Domain Open-Vocabulary Action RecognitionCode1
Taylor Videos for Action RecognitionCode1
Explore Human Parsing Modality for Action RecognitionCode1
SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy ChallengeCode1
A Dense-Sparse Complementary Network for Human Action Recognition based on RGB and Skeleton ModalitiesCode1
Generative Model-based Feature Knowledge Distillation for Action RecognitionCode1
EZ-CLIP: Efficient Zeroshot Video Action RecognitionCode1
Navigating Open Set Scenarios for Skeleton-based Action RecognitionCode1
Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven ReasoningCode1
D^2ST-Adapter: Disentangled-and-Deformable Spatio-Temporal Adapter for Few-shot Action RecognitionCode1
CAST: Cross-Attention in Space and Time for Video Action RecognitionCode1
DEVIAS: Learning Disentangled Video Representations of Action and SceneCode1
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily LivingCode1
Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic ScenesCode1
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningCode1
VSViG: Real-time Video-based Seizure Detection via Skeleton-based Spatiotemporal ViGCode1
Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the ArtCode1
Concatenated Masked Autoencoders as Spatial-Temporal LearnerCode1
IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like SettingCode1
InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action RecognitionCode1
3DYoga90: A Hierarchical Video Dataset for Yoga Pose UnderstandingCode1
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to VideoCode1
Training a Large Video Model on a Single Machine in a DayCode1
End-to-End Streaming Video Temporal Action Segmentation with Reinforce LearningCode1
Exploring Self-supervised Skeleton-based Action Recognition in Occluded EnvironmentsCode1
Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action RecognitionCode1
Show:102550
← PrevPage 3 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified