Video Classification

Video Classification is the task of producing a label that is relevant to the video given its frames. A good video level classifier is one that not only provides accurate frame labels, but also best describes the entire video given the features and the annotations of the various frames in the video. For example, a video might contain a tree in some frame, but the label that is central to the video might be something else (e.g., “hiking”). The granularity of the labels that are needed to describe the frames and the video depends on the task. Typical tasks include assigning one or more global labels to the video, and assigning one or more labels for each frame inside the video.

Source: Efficient Large Scale Video Classification

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 251–275 of 455 papers

Title	Date	Tasks	Status	Hype
Multi-Label Activity Recognition using Activity-specific Features and Activity Correlations	Sep 16, 2020	Activity RecognitionVideo Classification	—Unverified	0
Defending Against Multiple and Unforeseen Adversarial Videos	Sep 11, 2020	Adversarial RobustnessGeneral Classification	—Unverified	0
Active Contrastive Learning of Audio-Visual Video Representations	Aug 31, 2020	Contrastive LearningRepresentation Learning	CodeCode Available	1
Making a Case for 3D Convolutions for Object Segmentation in Videos	Aug 26, 2020	DecoderSegmentation	CodeCode Available	1
Recurrent Deconvolutional Generative Adversarial Networks with Application to Text Guided Video Generation	Aug 13, 2020	Generative Adversarial NetworkVideo Classification	—Unverified	0
Self-Supervised Multi-Task Procedure Learning from Instructional Videos	Aug 1, 2020	Procedure LearningVideo Classification	—Unverified	0
Actor-Action Video Classification CSC 249/449 Spring 2020 Challenge Report	Aug 1, 2020	General ClassificationVideo Classification	CodeCode Available	0
Approximated Bilinear Modules for Temporal Modeling	Jul 25, 2020	Action RecognitionVideo Classification	CodeCode Available	1
AttentionNAS: Spatiotemporal Attention Cell Search for Video Classification	Jul 23, 2020	ClassificationGeneral Classification	—Unverified	0
Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos	Jul 21, 2020	Action DetectionAction Recognition	—Unverified	0
MotionSqueeze: Neural Motion Feature Learning for Video Understanding	Jul 20, 2020	Action ClassificationAction Recognition	CodeCode Available	1
Region-based Non-local Operation for Video Classification	Jul 17, 2020	Action ClassificationAction Recognition	CodeCode Available	1
3D CNN-PCA: A Deep-Learning-Based Parameterization for Complex Geomodels	Jul 16, 2020	Uncertainty QuantificationVideo Classification	—Unverified	0
Generalized Few-Shot Video Classification with Video Retrieval and Feature Generation	Jul 9, 2020	Few-Shot Image ClassificationFew-Shot Learning	CodeCode Available	1
NLP-based Feature Extraction for the Detection of COVID-19 Misinformation Videos on YouTube	Jul 1, 2020	MisinformationTransfer Learning	CodeCode Available	0
SmallBigNet: Integrating Core and Contextual Views for Video Classification	Jun 25, 2020	ClassificationGeneral Classification	CodeCode Available	1
Pyramidal Convolution: Rethinking Convolutional Neural Networks for Visual Recognition	Jun 20, 2020	Action ClassificationAction Recognition	CodeCode Available	1
Learn to cycle: Time-consistent feature discovery for action recognition	Jun 15, 2020	Action ClassificationAction Recognition	CodeCode Available	0
Video Understanding as Machine Translation	Jun 12, 2020	Machine TranslationMetric Learning	—Unverified	0
Non-Local Neural Networks With Grouped Bilinear Attentional Transforms	Jun 1, 2020	Image ClassificationVideo Classification	CodeCode Available	1
Optimizing Temporal Convolutional Network inference on FPGA-based accelerators	May 7, 2020	SchedulingTime Series Analysis	—Unverified	0
Video Contents Understanding using Deep Neural Networks	Apr 29, 2020	object-detectionObject Detection	—Unverified	0
PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing	Apr 24, 2020	Face Anti-SpoofingGeneral Classification	CodeCode Available	1
TAEN: Temporal Aware Embedding Network for Few-Shot Action Recognition	Apr 21, 2020	3D Face ReconstructionAction Detection	—Unverified	0
Would Mega-scale Datasets Further Enhance Spatiotemporal 3D CNNs?	Apr 10, 2020	General ClassificationOpen-Ended Question Answering	CodeCode Available	2

Show:10 25 50

← PrevPage 11 of 19Next →

All datasets Breakfast COIN MoB YouTube-8M Hockey Fight Detection Dataset Charades Home Action Genome Kinetics Multimodal PISA Something-Something V1 Something-Something V2 SRI-APPROVE Fine-Grained Video Classification

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	HERMES	Accuracy (%)	95.2	—	Unverified
2	MA-LMM	Accuracy (%)	93	—	Unverified
3	S5	Accuracy (%)	90.7	—	Unverified
4	TranS4mer	Accuracy (%)	90.27	—	Unverified
5	D-Sprv.	Accuracy (%)	89.9	—	Unverified
6	ViS4mer	Accuracy (%)	88.2	—	Unverified
7	GHRM	Accuracy (%)	75.5	—	Unverified
8	Timeception	Accuracy (%)	71.3	—	Unverified
9	VideoGraph	Accuracy (%)	69.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HERMES	Accuracy (%)	93.5	—	Unverified
2	MA-LMM	Accuracy (%)	93.2	—	Unverified
3	S5	Accuracy (%)	90.8	—	Unverified
4	D-Sprv.	Accuracy (%)	90	—	Unverified
5	TranS4mer	Accuracy (%)	89.3	—	Unverified
6	ViS4mer	Accuracy (%)	88.4	—	Unverified
7	TSN	Accuracy (%)	73.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	VTN	Accuracy	77.85	—	Unverified
2	I3D	Accuracy	72.11	—	Unverified
3	ConvLSTM	Accuracy	69.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DCGN (self-attention graph pooling)	Hit@1	87.7	—	Unverified
2	Hierarchical LSTM with MoE	Hit@1	86.8	—	Unverified
3	Mixture-of-2-Experts	Hit@1	70.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Structured Keypoint Pooling	Accuracy	99.5	—	Unverified
2	CNN+LSTM	1:1 Accuracy	98	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Multigrid	mAP	38.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Cooperative Ours (3rd-person)	Accuracy (%)	24.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Multigrid	Top-1	77.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Video	Accuracy (%)	73.95	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MSNet-R50En (ours)	Top-5 Accuracy	84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MSNet-R50En (ours)	Top-5 Accuracy	91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Multi-Label Prototypes Contrastive Learning	AUPR	88.4	—	Unverified