SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 851900 of 2759 papers

TitleStatusHype
edBB-Demo: Biometrics and Behavior Analysis for Online Educational PlatformsCode0
A Unified Multimodal De- and Re-coupling Framework for RGB-D Motion RecognitionCode1
CoNFies: Controllable Neural Face Avatars0
EVA: Exploring the Limits of Masked Visual Representation Learning at ScaleCode0
Extending Temporal Data Augmentation for Video Action Recognition0
Bringing Online Egocentric Action Recognition into the wildCode1
Quantifying and Learning Static vs. Dynamic Information in Deep Spatiotemporal Networks0
Could Giant Pretrained Image Models Extract Universal Representations?0
Learning a Condensed Frame for Memory-Efficient Video Class-Incremental Learning0
Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing0
No-audio speaking status detection in crowded settings via visual pose-based filtering and wearable acceleration0
Uncertainty-DTW for Time Series and SequencesCode0
Temporal-Viewpoint Transportation Plan for Skeletal Few-shot Action Recognition0
Handwashing Action Detection System for an Autonomous Social RobotCode0
Text2Model: Text-based Model Induction for Zero-shot Image Classification0
Learning Joint Representation of Human Motion and Language0
Adversarial Domain Adaptation for Action Recognition Around the Clock0
GliTr: Glimpse Transformers with Spatiotemporal Consistency for Online Action PredictionCode1
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation0
Holistic Interaction Transformer Network for Action DetectionCode1
Baby Physical Safety Monitoring in Smart Home Using Action Recognition System0
3D Human Pose Estimation in Multi-View Operating Room Videos Using Differentiable Camera Projections0
Transformer-based Action recognition in hand-object interacting scenarios0
STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition0
Improving Transfer Learning with a Dual Image and Video Transformer for Multi-label Movie Trailer Genre ClassificationCode0
Real-time Action Recognition for Fine-Grained Actions and The Hand Wash DatasetCode0
MotionBERT: A Unified Perspective on Learning Human Motion RepresentationsCode3
DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action RecognitionCode0
Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition0
An Action Is Worth Multiple Words: Handling Ambiguity in Action RecognitionCode1
Students taught by multimodal teachers are superior action recognizers0
Self-Aligned Concave Curve: Illumination Enhancement for Unsupervised Adaptation0
BlanketSet -- A clinical real-world in-bed action recognition and qualitative semi-synchronised MoCap dataset0
Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognition0
TimesNet: Temporal 2D-Variation Modeling for General Time Series AnalysisCode6
Towards a Unified View on Visual Parameter-Efficient Transfer LearningCode1
Alignment-guided Temporal Attention for Video Action Recognition0
Application-Driven AI Paradigm for Human Action Recognition0
REST: REtrieve & Self-Train for generative action recognition0
Spiking Neural Networks for event-based action recognition: A new task to understand their advantageCode1
Speeding Up Action Recognition Using Dynamic Accumulation of Residuals in Compressed Domain0
RALACs: Action Recognition in Autonomous Vehicles using Interaction Encoding and Optical FlowCode0
Low-Resolution Action Recognition for Tiny Actions Challenge0
Attention Spiking Neural Networks0
Learning State-Aware Visual Representations from Audible InteractionsCode1
Ani-GIFs: A benchmark dataset for domain generalization of action recognition from GIFs0
Multi-dataset Training of Transformers for Robust Action RecognitionCode1
Global Semantic Descriptors for Zero-Shot Action RecognitionCode0
Leveraging Self-Supervised Training for Unintentional Action Recognition0
View-Invariant Skeleton-based Action Recognition via Global-Local Contrastive Learning0
Show:102550
← PrevPage 18 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified