Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 801–825 of 2759 papers

Title	Date	Tasks	Status	Score
Learning To Score Olympic Events	Nov 16, 2016	Action Quality AssessmentAction Recognition	CodeCode Available	5
Learn to cycle: Time-consistent feature discovery for action recognition	Jun 15, 2020	Action ClassificationAction Recognition	CodeCode Available	5
Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognition	Aug 25, 2017	Action RecognitionHand-Gesture Recognition	CodeCode Available	5
Attentive Semantic Video Generation using Captions	Aug 20, 2017	Action RecognitionStyle Transfer	CodeCode Available	5
Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation	Aug 16, 2021	3D Human Pose Estimation3D Pose Estimation	CodeCode Available	5
Learning Mutual Excitation for Hand-to-Hand and Human-to-Human Interaction Recognition	Feb 4, 2024	Action RecognitionHuman Interaction Recognition	CodeCode Available	5
Learning Human Action Recognition Representations Without Real Humans	Nov 10, 2023	Action RecognitionEthics	CodeCode Available	5
Learning long-term dependencies for action recognition with a biologically-inspired deep network	Nov 16, 2016	Action RecognitionTemporal Action Localization	CodeCode Available	5
Delving Deeper into Convolutional Networks for Learning Video Representations	Nov 19, 2015	Action RecognitionDecoder	CodeCode Available	5
Learning from Video and Text via Large-Scale Discriminative Clustering	Jul 27, 2017	Action RecognitionClustering	CodeCode Available	5
Deja Vu: Motion Prediction in Static Images	Mar 19, 2018	Action Recognitionmotion prediction	CodeCode Available	5
DejaVid: Encoder-Agnostic Learned Temporal Matching for Video Classification	Jan 1, 2025	Action ClassificationAction Recognition	CodeCode Available	5
Learning Gating ConvNet for Two-Stream based Methods in Action Recognition	Sep 12, 2017	Action ClassificationAction Recognition	CodeCode Available	5
Attention Bottlenecks for Multimodal Fusion	Jun 30, 2021	Action ClassificationAction Recognition	CodeCode Available	5
Adaptive frame selection in two dimensional convolutional neural network action recognition	Dec 28, 2022	Action RecognitionVideo Summarization	CodeCode Available	5
Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action Recognition	Jul 17, 2022	Action RecognitionDomain Adaptation	CodeCode Available	5
Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searching	Nov 11, 2019	Action RecognitionNeural Architecture Search	CodeCode Available	5
Learning Spatio-Temporal Representation with Local and Global Diffusion	Jun 13, 2019	Action ClassificationAction Detection	CodeCode Available	5
Large-scale weakly-supervised pre-training for video action recognition	May 2, 2019	Action ClassificationAction Recognition	CodeCode Available	5
Adaptive and Iteratively Improving Recurrent Lateral Connections	Oct 16, 2019	Action Recognition	CodeCode Available	5
Real-Time Action Detection in Video Surveillance using Sub-Action Descriptor with Multi-CNN	Oct 10, 2017	Action DetectionAction Recognition	CodeCode Available	5
Learning Actor Relation Graphs for Group Activity Recognition	Apr 23, 2019	Action RecognitionActivity Recognition	CodeCode Available	5
Attentional Pooling for Action Recognition	Nov 4, 2017	Action RecognitionHuman-Object Interaction Detection	CodeCode Available	5
Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie Stimuli	Jun 2, 2023	Action RecognitionImage Classification	CodeCode Available	5
Language Model Guided Interpretable Video Action Reasoning	Apr 2, 2024	Action RecognitionDecision Making	CodeCode Available	5

Show:10 25 50

← PrevPage 33 of 111Next →

All datasets Something-Something V2 UCF101 HMDB-51 Something-Something V1 AVA v2.2 EPIC-KITCHENS-100 NTU RGB+D NTU RGB+D 120 Diving-48 ActivityNet AVA v2.1 H2O (2 Hands and Objects)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	MViTv2-B (IN-21K + Kinetics400 pretrain)	Top-5 Accuracy	93.4	—	Unverified
2	RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)	Top-5 Accuracy	91.1	—	Unverified
3	MVD (Kinetics400 pretrain, ViT-H, 16 frame)	Top-1 Accuracy	77.3	—	Unverified
4	DejaVid	Top-1 Accuracy	77.2	—	Unverified
5	InternVideo	Top-1 Accuracy	77.2	—	Unverified
6	InternVideo2-1B	Top-1 Accuracy	77.1	—	Unverified
7	VideoMAE V2-g	Top-1 Accuracy	77	—	Unverified
8	MVD (Kinetics400 pretrain, ViT-L, 16 frame)	Top-1 Accuracy	76.7	—	Unverified
9	Hiera-L (no extra data)	Top-1 Accuracy	76.5	—	Unverified
10	TubeViT-L	Top-1 Accuracy	76.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FTP-UniFormerV2-L/14	3-fold Accuracy	99.7	—	Unverified
2	OmniVec2	3-fold Accuracy	99.6	—	Unverified
3	VideoMAE V2-g	3-fold Accuracy	99.6	—	Unverified
4	OmniVec	3-fold Accuracy	99.6	—	Unverified
5	BIKE	3-fold Accuracy	98.8	—	Unverified
6	SMART	3-fold Accuracy	98.64	—	Unverified
7	OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)	3-fold Accuracy	98.6	—	Unverified
8	PERF-Net (multi-distilled S3D)	3-fold Accuracy	98.6	—	Unverified
9	ZeroI2V ViT-L/14	3-fold Accuracy	98.6	—	Unverified
10	LGD-3D Two-stream	3-fold Accuracy	98.2	—	Unverified