SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 10511100 of 2759 papers

TitleStatusHype
Fusing Hand and Body Skeletons for Human Action Recognition in Assembly0
Human Action Recognition in Still Images Using ConViT0
Measuring Student Behavioral Engagement using Histogram of Actions0
Similarity Min-Max: Zero-Shot Day-Night Domain Adaptation0
Cross-Model Cross-Stream Learning for Self-Supervised Human Action RecognitionCode0
SoccerKDNet: A Knowledge Distillation Framework for Action Recognition in Soccer Videos0
One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching0
Free-Form Composition Networks for Egocentric Action Recognition0
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation0
A Study on Differentiable Logic and LLMs for EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 20230
HA-ViD: A Human Assembly Video Dataset for Comprehensive Assembly Knowledge UnderstandingCode0
Fine-grained Action Analysis: A Multi-modality and Multi-task Dataset of Figure SkatingCode0
VideoGLUE: Video General Understanding Evaluation of Foundation Models0
Task-Specific Alignment and Multiple Level Transformer for Few-Shot Action RecognitionCode0
Make A Long Image Short: Adaptive Token Length for Vision Transformers0
SpATr: MoCap 3D Human Action Recognition based on Spiral Auto-encoder and Transformer NetworkCode0
Lightweight Recurrent Cross-modal Encoder for Video Question AnsweringCode0
Miniaturized Graph Convolutional Networks with Topologically Consistent Pruning0
Theater Aid System for the Visually Impaired Through Transfer Learning of Spatio-Temporal Graph Convolution Networks0
Multi-Dimensional Refinement Graph Convolutional Network with Robust Decouple Loss for Fine-Grained Skeleton-Based Action Recognition0
Learning Scene Flow With Skeleton Guidance For 3D Action Recognition0
Spiking Two-Stream Methods with Unsupervised STDP-based Learning for Action Recognition0
Bullying10K: A Large-Scale Neuromorphic Dataset towards Privacy-Preserving Bullying Recognition0
How can objects help action recognition?0
FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation0
What can a cook in Italy teach a mechanic in India? Action Recognition Generalisation Over Scenarios and Locations0
Action Recognition with Multi-stream Motion Modeling and Mutual Information MaximizationCode0
How Object Information Improves Skeleton-based Human Action Recognition in Assembly Tasks0
Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Pose0
Optimizing ViViT Training: Time and Memory Reduction for Action Recognition0
HomE: Homography-Equivariant Video Representation LearningCode0
Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie StimuliCode0
Pedestrian Crossing Action Recognition and Trajectory Prediction with 3D Human Keypoints0
Hiera: A Hierarchical Vision Transformer without the Bells-and-WhistlesCode0
fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs0
High-Performance Inference Graph Convolutional Networks for Skeleton-Based Action RecognitionCode0
Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action RecognitionCode0
FMM-X3D: FPGA-based modeling and mapping of X3D for Human Action Recognition0
CVB: A Video Dataset of Cattle Visual Behaviors0
Deep Neural Networks in Video Human Action Recognition: A Review0
Cross-view Action Recognition Understanding From Exocentric to Egocentric Perspective0
High Speed Human Action Recognition using a Photonic Reservoir Computer0
Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning0
Spatiotemporal Attention-based Semantic Compression for Real-time Video Recognition0
SCP: Soft Conditional Prompt Learning for Aerial Video Action Recognition0
Motion-Scenario Decoupling for Rat-Aware Video Position Prediction: Strategy and Benchmark0
Learning Higher-order Object Interactions for Keypoint-based Video Understanding0
Is end-to-end learning enough for fitness activity recognition?0
Lightweight Delivery Detection on Doorbell Cameras0
Multi-scale spatial–temporal convolutional neural network for skeleton-based action recognitionCode0
Show:102550
← PrevPage 22 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified