SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 19512000 of 2759 papers

TitleStatusHype
Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgery0
A Variational Information Bottleneck Based Method to Compress Sequential Networks for Human Action Recognition0
AVT: Audio-Video Transformer for Multimodal Action Recognition0
AZTR: Aerial Video Action Recognition with Auto Zoom and Temporal Reasoning0
BabyNet: A Lightweight Network for Infant Reaching Action Recognition in Unconstrained Environments to Support Future Pediatric Rehabilitation Applications0
Baby Physical Safety Monitoring in Smart Home Using Action Recognition System0
Knowledge Distillation for Human Action Anticipation0
Bag of Visual Words and Fusion Methods for Action Recognition: Comprehensive Study and Good Practice0
Baidu-UTS Submission to the EPIC-Kitchens Action Recognition Challenge 20190
Balancing Privacy and Action Performance: A Penalty-Driven Approach to Image Anonymization0
Bayesian Graph Convolution LSTM for Skeleton Based Action Recognition0
Bayesian Non-Parametric Inference for Manifold Based MoCap Representation0
Behavior Recognition Based on the Integration of Multigranular Motion Features0
Benchmarking Conventional Vision Models on Neuromorphic Fall Detection and Action Recognition Dataset0
Benchmarking Sensitivity of Continual Graph Learning for Skeleton-Based Action Recognition0
Better Exploiting Motion for Better Action Recognition0
Beyond Covariance: Feature Representation With Nonlinear Kernel Matrices0
Beyond Gaussian Pyramid: Multi-skip Feature Stacking for Action Recognition0
Beyond Image Classification: A Video Benchmark and Dual-Branch Hybrid Discrimination Framework for Compositional Zero-Shot Learning0
Beyond Short Clips: End-to-End Video-Level Learning with Collaborative Memories0
Beyond Spatial Pyramid Matching: Space-time Extended Descriptor for Action Recognition0
Beyond the Camera: Neural Networks in World Coordinates0
Beyond the Pixels: Exploring the Effects of Bit-Level Network and File Corruptions on Video Model Robustness0
Activation-wise Propagation: A Universal Strategy to Break Timestep Constraints in Spiking Neural Networks for 3D Data Processing0
BiaSwap: Removing dataset bias with bias-tailored swapping augmentation0
Big Data and Deep Learning in Smart Cities: A Comprehensive Dataset for AI-Driven Traffic Accident Detection and Computer Vision Systems0
Bilinear Heterogeneous Information Machine for RGB-D Action Recognition0
Binary Coding for Partial Action Analysis With Limited Observation Ratios0
Bio-Inspired Human Action Recognition using Hybrid Max-Product Neuro-Fuzzy Classifier and Quantum-Behaved PSO0
BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation0
BlanketSet -- A clinical real-world in-bed action recognition and qualitative semi-synchronised MoCap dataset0
Blockwise Temporal-Spatial Pathway Network0
Body Joint guided 3D Deep Convolutional Descriptors for Action Recognition0
Boosting Adversarial Transferability for Skeleton-based Action Recognition via Exploring the Model Posterior Space0
Boosting Video Representation Learning with Multi-Faceted Integration0
Bootstrapped Representation Learning for Skeleton-Based Action Recognition0
Boundary-Aware Proposal Generation Method for Temporal Action Localization0
BQN: Busy-Quiet Net Enabled by Motion Band-Pass Module for Action Recognition0
Brain-inspired Computational Modeling of Action Recognition with Recurrent Spiking Neural Networks Equipped with Reinforcement Delay Learning0
Bregman Divergences for Infinite Dimensional Covariance Matrices0
Bridging the gap between Human Action Recognition and Online Action Detection0
Bringing Image Scene Structure to Video via Frame-Clip Consistency of Object Tokens0
Bubblenet: A Disperse Recurrent Structure To Recognize Activities0
Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach0
Bullying10K: A Large-Scale Neuromorphic Dataset towards Privacy-Preserving Bullying Recognition0
Bypass Enhancement RGB Stream Model for Pedestrian Action Recognition of Autonomous Vehicles0
CA^2ST: Cross-Attention in Audio, Space, and Time for Holistic Video Recognition0
CAMREP- Concordia Action and Motion Repository0
Can Humans Fly? Action Understanding With Multiple Classes of Actors0
Can masking background and object reduce static bias for zero-shot action recognition?0
Show:102550
← PrevPage 40 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4InternVideoTop-1 Accuracy77.2Unverified
5DejaVidTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3OmniVec3-fold Accuracy99.6Unverified
4VideoMAE V2-g3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
8OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
9PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
10Text4Vis3-fold Accuracy98.2Unverified