Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 751–800 of 817 papers

Title	Date	Tasks	Status	Hype
R-C3D: Region Convolutional 3D Network for Temporal Activity Detection	Mar 22, 2017	Action DetectionAction Recognition In Videos	CodeCode Available	0
A Pursuit of Temporal Accuracy in General Activity Detection	Mar 8, 2017	Action DetectionActivity Detection	CodeCode Available	0
Efficient Action Detection in Untrimmed Videos via Multi-Task Learning	Dec 22, 2016	Action DetectionAction Localization	—Unverified	0
Temporal Tessellation: A Unified Approach for Video Analysis	Dec 21, 2016	Action DetectionVideo Captioning	CodeCode Available	0
Temporal-Needle: A view and appearance invariant video descriptor	Dec 14, 2016	Action DetectionClustering	—Unverified	0
Unsupervised Human Action Detection by Action Matching	Dec 2, 2016	Action DetectionActivity Recognition	—Unverified	0
Video Event Detection by Exploiting Word Dependencies from Image Captions	Dec 1, 2016	Action DetectionEvent Detection	—Unverified	0
An End-to-End Architecture for Keyword Spotting and Voice Activity Detection	Nov 28, 2016	Action DetectionActivity Detection	CodeCode Available	1
Learning recurrent representations for hierarchical behavior modeling	Nov 1, 2016	Action Detectionmotion prediction	—Unverified	0
Real-time Online Action Detection Forests using Spatio-temporal Contexts	Oct 28, 2016	Action DetectionOnline Action Detection	—Unverified	0
Review of Action Recognition and Detection Methods	Oct 21, 2016	Action DetectionAction Recognition	CodeCode Available	0
Multi-region two-stream R-CNN for action detection	Sep 17, 2016	Action DetectionAction Recognition	—Unverified	0
Temporal Activity Detection in Untrimmed Videos with Recurrent Neural Networks	Aug 29, 2016	Action DetectionActivity Detection	CodeCode Available	0
Deep Learning for Detecting Multiple Space-Time Action Tubes in Videos	Aug 4, 2016	Action DetectionMotion Detection	—Unverified	0
Efficient Activity Detection in Untrimmed Video with Max-Subgraph Search	Jul 11, 2016	Action DetectionActivity Detection	—Unverified	0
Transition Forests: Learning Discriminative Temporal Transitions for Action Recognition and Detection	Jul 10, 2016	Action DetectionAction Recognition	—Unverified	0
Untrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge	Jul 7, 2016	Action DetectionActivity Detection	CodeCode Available	0
Aggressive actions and anger detection from multiple modalities using Kinect	Jul 5, 2016	Action Detection	—Unverified	0
Hand Action Detection from Ego-centric Depth Sequences with Error-correcting Hough Transform	Jun 7, 2016	Action DetectionAction Recognition	—Unverified	0
A Multi-Stream Bi-Directional Recurrent Neural Network for Fine-Grained Action Detection	Jun 1, 2016	Action DetectionAction Recognition	—Unverified	0
Progressively Parsing Interactional Objects for Fine Grained Action Detection	Jun 1, 2016	Action AnalysisAction Detection	—Unverified	0
Learning Activity Progression in LSTMs for Activity Detection and Early Detection	Jun 1, 2016	Action DetectionActivity Detection	—Unverified	0
Fast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos	Jun 1, 2016	Action DetectionAction Recognition	—Unverified	0
Temporal Action Detection Using a Statistical Language Model	Jun 1, 2016	Action DetectionAction Recognition	CodeCode Available	0
Actionness Estimation Using Hybrid Fully Convolutional Networks	Apr 25, 2016	Action DetectionAction Recognition	—Unverified	0
Online Action Detection	Apr 21, 2016	Action DetectionOnline Action Detection	—Unverified	0
Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks	Apr 19, 2016	Action DetectionAction Recognition	CodeCode Available	0
Kernel-based Sensor Fusion with Application to Audio-Visual Voice Activity Detection	Apr 11, 2016	Action DetectionActivity Detection	—Unverified	0
Leaving Some Stones Unturned: Dynamic Feature Prioritization for Activity Detection in Streaming Video	Apr 1, 2016	Action DetectionActivity Detection	—Unverified	0
Cross-modal Supervision for Learning Active Speaker Detection in Video	Mar 29, 2016	Action DetectionActive Speaker Detection	—Unverified	0
Fast Optical Flow using Dense Inverse Search	Mar 11, 2016	Action DetectionActivity Detection	—Unverified	0
Action Detection by Implicit Intentional Motion Clustering	Dec 1, 2015	Action DetectionAction Recognition	—Unverified	0
Actionness-Assisted Recognition of Actions	Dec 1, 2015	Action DetectionAction Recognition	—Unverified	0
End-to-end Learning of Action Detection from Frame Glimpses in Videos	Nov 22, 2015	Action DetectionTemporal Action Localization	CodeCode Available	0
Application of Machine Learning Techniques in Human Activity Recognition	Oct 19, 2015	Action DetectionActivity Detection	—Unverified	0
A Novel Approach for Human Action Recognition from Silhouette Images	Oct 15, 2015	Action DetectionAction Recognition	—Unverified	0
Tensor vs Matrix Methods: Robust Tensor Decomposition under Block Sparse Perturbations	Oct 15, 2015	Action DetectionActivity Detection	—Unverified	0
Continuous control with deep reinforcement learning	Sep 9, 2015	Action Detectioncontinuous-control	CodeCode Available	1
The Cohort and Speechify Libraries for Rapid Construction of Speech Enabled Applications for Android	Sep 1, 2015	Action DetectionSpeech Recognition	—Unverified	0
User Adaptive Restoration for Incorrectly-Segmented Utterances in Spoken Dialogue Systems	Sep 1, 2015	Action DetectionSpeech Recognition	—Unverified	0
Online Anomaly Detection via Class-Imbalance Learning	Aug 27, 2015	Action DetectionActivity Detection	—Unverified	0
Fast Action Proposals for Human Action Detection and Search	Jun 1, 2015	Action DetectionVideo Segmentation	—Unverified	0
Encoding Based Saliency Detection for Videos and Images	Jun 1, 2015	Action DetectionActivity Detection	—Unverified	0
ActivityNet: A Large-Scale Video Benchmark for Human Activity Understanding	Jun 1, 2015	Action DetectionAction Recognition	CodeCode Available	0
Group Event Detection with a Varying Number of Group Members for Video Surveillance	Feb 28, 2015	Action DetectionActivity Detection	—Unverified	0
A new network-based algorithm for human activity recognition in video	Feb 21, 2015	Action DetectionActivity Detection	—Unverified	0
Linear-time Online Action Detection From 3D Skeletal Data Using Bags of Gesturelets	Feb 4, 2015	Action DetectionAction Recognition	—Unverified	0
A Survey on Recent Advances of Computer Vision Algorithms for Egocentric Video	Jan 12, 2015	Action DetectionActivity Detection	—Unverified	0
Voice Activity Detection using Temporal Characteristics of Autocorrelation Lag and Maximum Spectral Amplitude in Sub-bands	Dec 1, 2014	Action DetectionActivity Detection	—Unverified	0
Multiple Instance Reinforcement Learning for Efficient Weakly-Supervised Detection in Images	Nov 29, 2014	Action Detectionreinforcement-learning	—Unverified	0

Show:10 25 50

← PrevPage 16 of 17Next →

All datasets UCF101-24 J-HMDB Charades Multi-THUMOS UCF Sports THUMOS' 14 MultiSports TSU TTStroke-21 ME21 TTStroke-21 ME22 MultiTHUMOS

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	STAR/L	Frame-mAP 0.5	90.3	—	Unverified
2	SiA	Frame-mAP 0.5	88.5	—	Unverified
3	YOWO + LFB	Frame-mAP 0.5	87.3	—	Unverified
4	HIT	Frame-mAP 0.5	84.8	—	Unverified
5	HISAN (ResNet-101 + FPN)	Video-mAP 0.2	82.3	—	Unverified
6	YOWO	Frame-mAP 0.5	80.4	—	Unverified
7	Two-in-one Two Stream	Video-mAP 0.2	78.48	—	Unverified
8	MOC	Frame-mAP 0.5	77.8	—	Unverified
9	Faster-RCNN + two-stream I3D conv	Frame-mAP 0.5	76.3	—	Unverified
10	Two-in-one	Video-mAP 0.2	75.48	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SiA	Frame-mAP 0.5	88.5	—	Unverified
2	HISAN (ResNet-101 + FPN)	Video-mAP 0.2	87.59	—	Unverified
3	HIT	Frame-mAP 0.5	83.8	—	Unverified
4	HISAN (VGG-16)	Frame-mAP 0.5	76.72	—	Unverified
5	DTS	Video-mAP 0.2	76.1	—	Unverified
6	YOWO + LFB	Frame-mAP 0.5	75.7	—	Unverified
7	Two-in-one Two Stream	Video-mAP 0.5	74.74	—	Unverified
8	YOWO	Frame-mAP 0.5	74.4	—	Unverified
9	MOC	Frame-mAP 0.5	74	—	Unverified
10	Faster-RCNN + two-stream I3D conv	Frame-mAP 0.5	73.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TTM	mAP	28.79	—	Unverified
2	CTRN	mAP	27.8	—	Unverified
3	Coarse-Fine Networks (w/ self-supervised detection pretraining)	mAP	26.95	—	Unverified
4	UniMD+Sync. (RGB+Flow)	mAP	26.53	—	Unverified
5	PDAN (RGB+Flow)	mAP	26.5	—	Unverified
6	PAT	mAP	26.5	—	Unverified
7	MS-TCT (RGB only)	mAP	25.4	—	Unverified
8	3D ResNet-50 + super-events pretrained on AViD	mAP	25.2	—	Unverified
9	Coarse-Fine Networks	mAP	25.1	—	Unverified
10	MLAD (RGB + Flow)	mAP	23.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLAD	mAP	51.5	—	Unverified
2	CTRN	mAP	51.2	—	Unverified
3	PDAN	mAP	47.6	—	Unverified
4	TGM	mAP	46.4	—	Unverified
5	MS-TCT (RGB only)	mAP	43.1	—	Unverified
6	I3D + our super-event	mAP	36.4	—	Unverified
7	Two-stream + LSTM	mAP	28.1	—	Unverified
8	Two-stream	mAP	27.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Two-in-one Two Stream	Video-mAP 0.5	96.52	—	Unverified
2	DTS	Video-mAP 0.2	94.3	—	Unverified
3	Two-in-one	Video-mAP 0.5	92.74	—	Unverified
4	T-CNN	Frame-mAP 0.5	86.7	—	Unverified
5	MR-TS R-CNN	Frame-mAP 0.5	84.52	—	Unverified
6	TS R-CNN	Frame-mAP 0.5	82.3	—	Unverified
7	Action Tubes	Frame-mAP 0.5	68.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MAT (Ours) Trans	mAP	71.6	—	Unverified
2	TadML-two stream	mAP	59.7	—	Unverified
3	MAT (ours)	mAP	58.2	—	Unverified
4	TadML-rgb	mAP	53.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HIT	Frame-mAP 0.5	33.3	—	Unverified
2	SiA	Frame-mAP 0.5	28.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MS-TCT	Frame-mAP	33.7	—	Unverified
2	PDAN	Frame-mAP	32.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STCNN	IoU	0.14	—	Unverified
2	Two Stream Network	IoU	0.07	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STCNN-V2 (Vote decision)	IoU	0.52	—	Unverified
2	RGB and PRGB	IoU	0.35	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PAT	mAP	44.6	—	Unverified