Action Recognition

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2426–2450 of 2759 papers

Title	Date	Tasks	Status	Hype
Context-based Object Viewpoint Estimation: A 2D Relational Approach	Apr 21, 2017	Action RecognitionObject	—Unverified	0
Invariant recognition drives neural representations of action sequences	Apr 20, 2017	Action RecognitionObject Recognition	—Unverified	0
Temporal Action Detection with Structured Segment Networks	Apr 20, 2017	Action DetectionAction Recognition	CodeCode Available	2
Skeleton Boxes: Solving skeleton based action detection with a single deep convolutional neural network	Apr 19, 2017	Action DetectionAction Recognition	—Unverified	0
Skeleton based action recognition using translation-scale invariant image mapping and multi-scale deep cnn	Apr 19, 2017	Action Recognitionimage-classification	—Unverified	0
Interpretable 3D Human Action Analysis with Temporal Convolutional Networks	Apr 14, 2017	3D Action RecognitionAction Analysis	CodeCode Available	0
Learning to Estimate Pose by Watching Videos	Apr 13, 2017	Action RecognitionPose Estimation	CodeCode Available	0
UC Merced Submission to the ActivityNet Challenge 2016	Apr 11, 2017	Action RecognitionGeneral Classification	—Unverified	0
Modeling Temporal Dynamics and Spatial Configurations of Actions Using Two-Stream Recurrent Neural Networks	Apr 9, 2017	3D Action RecognitionAction Recognition	—Unverified	0
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations	Apr 8, 2017	3D Hand Pose EstimationAction Recognition	CodeCode Available	0
Generalized Rank Pooling for Activity Recognition	Apr 7, 2017	Action RecognitionActivity Recognition	—Unverified	0
Action Representation Using Classifier Decision Boundaries	Apr 6, 2017	Action RecognitionMultiple Instance Learning	—Unverified	0
Two Stream LSTM: A Deep Fusion Framework for Human Action Recognition	Apr 4, 2017	Action RecognitionTemporal Action Localization	—Unverified	0
Unsupervised Action Proposal Ranking through Proposal Recombination	Apr 3, 2017	Action DetectionAction Recognition	—Unverified	0
Chained Multi-stream Networks Exploiting Pose, Motion, and Appearance for Action Classification and Detection	Apr 3, 2017	Action ClassificationAction Localization	CodeCode Available	0
Hidden Two-Stream Convolutional Networks for Action Recognition	Apr 2, 2017	Action RecognitionOptical Flow Estimation	CodeCode Available	1
Skeletonnet: Mining deep part features for 3-d action recognition	Mar 31, 2017	Action RecognitionDeep Learning	—Unverified	0
TS-LSTM and Temporal-Inception: Exploiting Spatiotemporal Dynamics for Activity Recognition	Mar 30, 2017	Action ClassificationAction Recognition	CodeCode Available	0
Pose-conditioned Spatio-Temporal Attention for Human Action Recognition	Mar 29, 2017	Action RecognitionActivity Recognition	—Unverified	0
Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences	Mar 28, 2017	Action RecognitionGeneral Classification	—Unverified	0
Locality preserving projection on SPD matrix Lie group: algorithm and analysis	Mar 28, 2017	Action RecognitionDimensionality Reduction	—Unverified	0
View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data	Mar 24, 2017	Action RecognitionSkeleton Based Action Recognition	CodeCode Available	0
A Bag-of-Words Equivalent Recurrent Neural Network for Action Recognition	Mar 23, 2017	Action RecognitionGeneral Classification	CodeCode Available	0
Two-Stream RNN/CNN for Action Recognition in 3D Videos	Mar 22, 2017	Action RecognitionTemporal Action Localization	—Unverified	0
PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understanding	Mar 22, 2017	Action DetectionAction Recognition	—Unverified	0

Show:10 25 50

← PrevPage 98 of 111Next →

All datasets Something-Something V2 UCF101 HMDB-51 Something-Something V1 AVA v2.2 EPIC-KITCHENS-100 NTU RGB+D NTU RGB+D 120 Diving-48 ActivityNet AVA v2.1 H2O (2 Hands and Objects)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	MViTv2-B (IN-21K + Kinetics400 pretrain)	Top-5 Accuracy	93.4	—	Unverified
2	RSANet-R50 (8+16 frames, ImageNet pretrained, 2 clips)	Top-5 Accuracy	91.1	—	Unverified
3	MVD (Kinetics400 pretrain, ViT-H, 16 frame)	Top-1 Accuracy	77.3	—	Unverified
4	DejaVid	Top-1 Accuracy	77.2	—	Unverified
5	InternVideo	Top-1 Accuracy	77.2	—	Unverified
6	InternVideo2-1B	Top-1 Accuracy	77.1	—	Unverified
7	VideoMAE V2-g	Top-1 Accuracy	77	—	Unverified
8	MVD (Kinetics400 pretrain, ViT-L, 16 frame)	Top-1 Accuracy	76.7	—	Unverified
9	Hiera-L (no extra data)	Top-1 Accuracy	76.5	—	Unverified
10	TubeViT-L	Top-1 Accuracy	76.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FTP-UniFormerV2-L/14	3-fold Accuracy	99.7	—	Unverified
2	OmniVec2	3-fold Accuracy	99.6	—	Unverified
3	VideoMAE V2-g	3-fold Accuracy	99.6	—	Unverified
4	OmniVec	3-fold Accuracy	99.6	—	Unverified
5	BIKE	3-fold Accuracy	98.8	—	Unverified
6	SMART	3-fold Accuracy	98.64	—	Unverified
7	OmniSource (SlowOnly-8x8-R101-RGB + I3D-Flow)	3-fold Accuracy	98.6	—	Unverified
8	PERF-Net (multi-distilled S3D)	3-fold Accuracy	98.6	—	Unverified
9	ZeroI2V ViT-L/14	3-fold Accuracy	98.6	—	Unverified
10	LGD-3D Two-stream	3-fold Accuracy	98.2	—	Unverified