SOTAVerified

Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 2759 papers

TitleStatusHype
Language Knowledge-Assisted Representation Learning for Skeleton-Based Action RecognitionCode1
FreqMixFormerV2: Lightweight Frequency-aware Mixed Transformer for Human Skeleton Action RecognitionCode1
Large-Scale Video Classification with Convolutional Neural NetworksCode1
CoCon: Cooperative-Contrastive LearningCode1
CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction AlignmentCode1
Just Add π! Pose Induced Video Transformers for Understanding Activities of Daily LivingCode1
A Body Part Embedding Model With Datasets for Measuring 2D Human Motion SimilarityCode1
Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion PerceptionCode1
Anonymization for Skeleton Action RecognitionCode1
Risky Action Recognition in Lane Change Video Clips using Deep Spatiotemporal Networks with Segmentation Mask TransferCode1
CMD: Self-supervised 3D Action Representation Learning with Cross-modal Mutual DistillationCode1
BMN: Boundary-Matching Network for Temporal Action Proposal GenerationCode1
GCN-DevLSTM: Path Development for Skeleton-Based Action RecognitionCode1
Generative Model-based Feature Knowledge Distillation for Action RecognitionCode1
Holistic Interaction Transformer Network for Action DetectionCode1
Scaling Autoregressive Video ModelsCode1
Grad-CAM++: Improved Visual Explanations for Deep Convolutional NetworksCode1
SeCo: Exploring Sequence Supervision for Unsupervised Representation LearningCode1
Graph in Graph Neural NetworkCode1
Graph Contrastive Learning for Skeleton-based Action RecognitionCode1
A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action RecognitionCode1
Graph Convolution with Low-rank Learnable Local FiltersCode1
Bridging Video-text Retrieval with Multiple Choice QuestionsCode1
A Large-Scale Study on Video Action Dataset CondensationCode1
Self-supervised learning using consistency regularization of spatio-temporal data augmentation for action recognitionCode1
Bringing Online Egocentric Action Recognition into the wildCode1
BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket SportsCode1
Collaborating Domain-shared and Target-specific Feature Clustering for Cross-domain 3D Action RecognitionCode1
Building a Multi-modal Spatiotemporal Expert for Zero-shot Action Recognition with CLIPCode1
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
Keeping Your Eye on the Ball: Trajectory Attention in Video TransformersCode1
Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed GradientCode1
Late Temporal Modeling in 3D CNN Architectures with BERT for Action RecognitionCode1
C2C: Component-to-Composition Learning for Zero-Shot Compositional Action RecognitionCode1
HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action RecognitionCode1
CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D NetworksCode1
Hidden Two-Stream Convolutional Networks for Action RecognitionCode1
Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action LocalizationCode1
A Closer Look at Spatiotemporal Convolutions for Action RecognitionCode1
Hierarchical Contrast for Unsupervised Skeleton-based Action Representation LearningCode1
CIAGAN: Conditional Identity Anonymization Generative Adversarial NetworksCode1
Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action RecognitionCode1
Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB VideosCode1
CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action RecognitionCode1
A Local-to-Global Approach to Multi-modal Movie Scene SegmentationCode1
HierVL: Learning Hierarchical Video-Language EmbeddingsCode1
CIDEr: Consensus-based Image Description EvaluationCode1
Home Action Genome: Cooperative Compositional Action UnderstandingCode1
Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the ArtCode1
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action RecognitionCode1
Show:102550
← PrevPage 9 of 56Next →
All datasetsSomething-Something V2UCF101HMDB-51Something-Something V1AVA v2.2EPIC-KITCHENS-100NTU RGB+DNTU RGB+D 120Diving-48ActivityNetAVA v2.1H2O (2 Hands and Objects)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MViTv2-B (IN-21K + Kinetics400 pretrain)Top-5 Accuracy93.4—Unverified
2RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)Top-5 Accuracy91.1—Unverified
3MVD (Kinetics400 pretrain, ViT-H, 16 frame)Top-1 Accuracy77.3—Unverified
4DejaVidTop-1 Accuracy77.2—Unverified
5InternVideoTop-1 Accuracy77.2—Unverified
6InternVideo2-1BTop-1 Accuracy77.1—Unverified
7VideoMAE V2-gTop-1 Accuracy77—Unverified
8MVD (Kinetics400 pretrain, ViT-L, 16 frame)Top-1 Accuracy76.7—Unverified
9Hiera-L (no extra data)Top-1 Accuracy76.5—Unverified
10TubeViT-LTop-1 Accuracy76.1—Unverified
#ModelMetricClaimedVerifiedStatus
1FTP-UniFormerV2-L/143-fold Accuracy99.7—Unverified
2OmniVec23-fold Accuracy99.6—Unverified
3VideoMAE V2-g3-fold Accuracy99.6—Unverified
4OmniVec3-fold Accuracy99.6—Unverified
5BIKE3-fold Accuracy98.8—Unverified
6SMART3-fold Accuracy98.64—Unverified
7OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)3-fold Accuracy98.6—Unverified
8PERF-Net (multi-distilled S3D)3-fold Accuracy98.6—Unverified
9ZeroI2V ViT-L/143-fold Accuracy98.6—Unverified
10LGD-3D Two-stream3-fold Accuracy98.2—Unverified