SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Showing 101150 of 2759 papers

TitleStatusHype
A Body Part Embedding Model With Datasets for Measuring 2D Human Motion SimilarityCode1
CZU-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and 10 wearable inertial sensorsCode1
DDGCN: A Dynamic Directed Graph Convolutional Network for Action RecognitionCode1
Decoupled Spatial-Temporal Attention Network for Skeleton-Based Action RecognitionCode1
Deep Analysis of CNN-based Spatio-temporal Representations for Action RecognitionCode1
Complex Sequential Understanding through the Awareness of Spatial and Temporal ConceptsCode1
Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video DatasetCode1
Depth Guided Adaptive Meta-Fusion Network for Few-shot Video RecognitionCode1
A Closer Look at Spatiotemporal Convolutions for Action RecognitionCode1
DirecFormer: A Directed Attention in Transformer Approach to Robust Action RecognitionCode1
Conquering the cnn over-parameterization dilemma: A volterra filtering approach for action recognitionCode1
Do Language Models Understand Time?Code1
CoCon: Cooperative-Contrastive LearningCode1
DSANet: Dynamic Segment Aggregation Network for Video-Level Representation LearningCode1
Dual-path Adaptation from Image to Video TransformersCode1
CMD: Self-supervised 3D Action Representation Learning with Cross-modal Mutual DistillationCode1
Dynamic Perceiver for Efficient Visual RecognitionCode1
E^2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action RecognitionCode1
A Comprehensive Study of Deep Video Action RecognitionCode1
EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal TokensCode1
3D Human Action Representation Learning via Cross-View Consistency PursuitCode1
CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction AlignmentCode1
EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery VideosCode1
CIDEr: Consensus-based Image Description EvaluationCode1
Elaborative Rehearsal for Zero-shot Action RecognitionCode1
Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven ReasoningCode1
Action knowledge for video captioning with graph neural networksCode1
CLIP-guided Prototype Modulating for Few-shot Action RecognitionCode1
Collaborating Domain-shared and Target-specific Feature Clustering for Cross-domain 3D Action RecognitionCode1
Constructing Stronger and Faster Baselines for Skeleton-based Action RecognitionCode1
Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the ArtCode1
Full-Body Articulated Human-Object InteractionCode1
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action RecognitionCode1
CAST: Cross-Attention in Space and Time for Video Action RecognitionCode1
3DYoga90: A Hierarchical Video Dataset for Yoga Pose UnderstandingCode1
CDFSL-V: Cross-Domain Few-Shot Learning for VideosCode1
CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action RecognitionCode1
Action Genome: Actions as Composition of Spatio-temporal Scene GraphsCode1
3DV: 3D Dynamic Voxel for Action Recognition in Depth VideoCode1
C2C: Component-to-Composition Learning for Zero-Shot Compositional Action RecognitionCode1
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D NetworksCode1
CIAGAN: Conditional Identity Anonymization Generative Adversarial NetworksCode1
Context-Aware RCNN: A Baseline for Action Detection in VideosCode1
BMN: Boundary-Matching Network for Temporal Action Proposal GenerationCode1
Action-Conditioned 3D Human Motion Synthesis with Transformer VAECode1
Bridging Video-text Retrieval with Multiple Choice QuestionsCode1
Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion PerceptionCode1
Bringing Online Egocentric Action Recognition into the wildCode1
ActionCLIP: A New Paradigm for Video Action RecognitionCode1
Show:102550
← PrevPage 3 of 56Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3Unverified
4DejaVidTop-1 Accuracy77.2Unverified
5InternVideoTop-1 Accuracy77.2Unverified
6InternVideo2-1BTop-1 Accuracy77.1Unverified
7VideoMAE V2-gTop-1 Accuracy77Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5Unverified
10TubeViT-LTop-1 Accuracy76.1Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7Unverified
2OmniVec23-fold Accuracy99.6Unverified
3VideoMAE V2-g3-fold Accuracy99.6Unverified
4OmniVec3-fold Accuracy99.6Unverified
5BIKE3-fold Accuracy98.8Unverified
6SMART3-fold Accuracy98.64Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6Unverified
10LGD-3D Two-stream3-fold Accuracy98.2Unverified