Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–100 of 110 papers

Title	Date	Tasks	Status	Hype
Shifted Chunk Transformer for Spatio-Temporal Representational Learning	Aug 26, 2021	Action AnticipationAction Recognition	—Unverified	0
TransAction: ICL-SJTU Submission to EPIC-Kitchens Action Anticipation Challenge 2021	Jul 28, 2021	Action Anticipation	CodeCode Available	0
Multi-Modal Temporal Convolutional Network for Anticipating Actions in Egocentric Videos	Jul 18, 2021	Action AnticipationAutonomous Driving	—Unverified	0
A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidents	Jun 18, 2021	Accident AnticipationAction Anticipation	CodeCode Available	1
Technical Report: Temporal Aggregate Representations	Jun 6, 2021	Action AnticipationAction Recognition	CodeCode Available	1
Anticipative Video Transformer	Jun 3, 2021	Action Anticipation	CodeCode Available	1
Anticipating human actions by correlating past with the future with Jaccard similarity measures	May 26, 2021	Action AnticipationAction Recognition	—Unverified	0
Higher Order Recurrent Space-Time Transformer for Video Action Prediction	Apr 17, 2021	Action AnticipationAction Recognition	CodeCode Available	1
Forecasting Action through Contact Representations from First Person Video	Feb 1, 2021	Action AnticipationObject	—Unverified	0
Learning to Anticipate Egocentric Actions by Imagination	Jan 13, 2021	Action AnticipationAutonomous Driving	—Unverified	0
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic	Oct 9, 2020	Action Anticipation	—Unverified	0
Video Representation Learning with Visual Tempo Consistency	Jun 28, 2020	Action AnticipationAction Detection	CodeCode Available	1
Rescaling Egocentric Vision	Jun 23, 2020	Action AnticipationAction Detection	CodeCode Available	1
Egocentric Object Manipulation Graphs	Jun 5, 2020	Action AnticipationAttribute	—Unverified	0
Temporal Aggregate Representations for Long-Range Video Understanding	Jun 1, 2020	Action AnticipationAction Recognition	CodeCode Available	1
Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNs	May 13, 2020	Action AnticipationAutonomous Vehicles	CodeCode Available	1
Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video	May 4, 2020	Action AnticipationAction Recognition	CodeCode Available	1
Knowledge Distillation for Action Anticipation via Label Smoothing	Apr 16, 2020	Action AnticipationAutonomous Driving	—Unverified	0
TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation	Mar 7, 2020	Action AnticipationPrediction	—Unverified	0
Predicting the Future: A Jointly Learnt Model for Action Anticipation	Dec 16, 2019	Action AnticipationGenerative Adversarial Network	—Unverified	0
HalluciNet-ing Spatiotemporal Representations Using a 2D-CNN	Dec 10, 2019	Action AnticipationAction Classification	CodeCode Available	0
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video	Nov 25, 2019	Action AnticipationHuman-Object Interaction Detection	CodeCode Available	0
Action Anticipation with RBF Kernelized Feature Mapping RNN	Nov 18, 2019	Action Anticipation	—Unverified	0
Action Anticipation for Collaborative Environments: The Impact of Contextual Information and Uncertainty-Based Prediction	Oct 1, 2019	Action AnticipationDecision Making	—Unverified	0
Delving into 3D Action Anticipation from Streaming Videos	Jun 15, 2019	Action AnticipationAction Classification	—Unverified	0

Show:10 25 50

← PrevPage 4 of 5Next →

All datasets EPIC-KITCHENS-100 EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEA Assembly101 EgoExoLearn 50 Salads

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PlausiVL	Recall@5	27.6	—	Unverified
2	InAViT	Recall@5	25.89	—	Unverified
3	UADT	Recall@5	23	—	Unverified
4	S-GEAR	Recall@5	19.9	—	Unverified
5	AFFT	Recall@5	18.5	—	Unverified
6	MeMViT-24	Recall@5	17.7	—	Unverified
7	AVT+	Recall@5	15.9	—	Unverified
8	TempAgg	Recall@5	14.73	—	Unverified
9	RU-LSTM	Recall@5	13.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InAViT	recall@5	23.75	—	Unverified
2	AVT++	recall@5	16.7	—	Unverified
3	AFFT	recall@5	14.9	—	Unverified
4	Abstract Goal	recall@5	14.29	—	Unverified
5	AVT+	recall@5	12.6	—	Unverified
6	TempAgg	recall@5	12.6	—	Unverified
7	RULSTM	recall@5	11.2	—	Unverified
8	TBN	recall@5	11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	22.03	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	16.84	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	14.66	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	14.39	—	Unverified
5	ED	Top 1 Accuracy - Act.	8.08	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	6	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	4.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	13.28	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	10.41	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	9.25	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	8.16	—	Unverified
5	ED	Top 1 Accuracy - Act.	2.65	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	2.39	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	2.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	68.4	—	Unverified
2	InAViT	Top-1 Accuracy	67.8	—	Unverified
3	Abstract Goal	Top-1 Accuracy	49.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Goal Consistency	Verbs Recall@5	60.04	—	Unverified
2	TempAgg	Verbs Recall@5	59.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Action anticipation baseline (co-training, with gaze)	Accuracy	45.45	—	Unverified
2	Action anticipation baseline (co-training, no gaze)	Accuracy	38.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	62.7	—	Unverified