Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–100 of 110 papers

Title	Date	Tasks	Status
NVIDIA-UNIBZ Submission for EPIC-KITCHENS-100 Action Anticipation Challenge 2022	Jun 22, 2022	Action AnticipationPrediction	—Unverified
Precise Affordance Annotation for Egocentric Action Video Datasets	Jun 11, 2022	Action AnticipationAffordance Recognition	—Unverified
Unified Recurrence Modeling for Video Action Anticipation	Jun 2, 2022	Action AnticipationDecision Making	CodeCode Available
A-ACT: Action Anticipation through Cycle Transformations	Apr 2, 2022	Action Anticipation	—Unverified
Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities	Mar 28, 2022	3D Action RecognitionAction Anticipation	CodeCode Available
Untrimmed Action Anticipation	Feb 8, 2022	Action AnticipationAction Detection	—Unverified
Weakly-Supervised Dense Action Anticipation	Nov 15, 2021	Action Anticipation	CodeCode Available
Towards Streaming Egocentric Action Anticipation	Oct 11, 2021	Action AnticipationKnowledge Distillation	—Unverified
Learning to Discriminate Information for Online Action Detection: Analysis and Application	Sep 8, 2021	Action AnticipationAction Detection	—Unverified
SlowFast Rolling-Unrolling LSTMs for Action Anticipation in Egocentric Videos	Sep 2, 2021	Action AnticipationOptical Flow Estimation	—Unverified
Shifted Chunk Transformer for Spatio-Temporal Representational Learning	Aug 26, 2021	Action AnticipationAction Recognition	—Unverified
TransAction: ICL-SJTU Submission to EPIC-Kitchens Action Anticipation Challenge 2021	Jul 28, 2021	Action Anticipation	CodeCode Available
Multi-Modal Temporal Convolutional Network for Anticipating Actions in Egocentric Videos	Jul 18, 2021	Action AnticipationAutonomous Driving	—Unverified
Anticipating human actions by correlating past with the future with Jaccard similarity measures	May 26, 2021	Action AnticipationAction Recognition	—Unverified
Forecasting Action through Contact Representations from First Person Video	Feb 1, 2021	Action AnticipationObject	—Unverified
Learning to Anticipate Egocentric Actions by Imagination	Jan 13, 2021	Action AnticipationAutonomous Driving	—Unverified
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic	Oct 9, 2020	Action Anticipation	—Unverified
Egocentric Object Manipulation Graphs	Jun 5, 2020	Action AnticipationAttribute	—Unverified
Knowledge Distillation for Action Anticipation via Label Smoothing	Apr 16, 2020	Action AnticipationAutonomous Driving	—Unverified
TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation	Mar 7, 2020	Action AnticipationPrediction	—Unverified
Predicting the Future: A Jointly Learnt Model for Action Anticipation	Dec 16, 2019	Action AnticipationGenerative Adversarial Network	—Unverified
HalluciNet-ing Spatiotemporal Representations Using a 2D-CNN	Dec 10, 2019	Action AnticipationAction Classification	CodeCode Available
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video	Nov 25, 2019	Action AnticipationHuman-Object Interaction Detection	CodeCode Available
Action Anticipation with RBF Kernelized Feature Mapping RNN	Nov 18, 2019	Action Anticipation	—Unverified
Action Anticipation for Collaborative Environments: The Impact of Contextual Information and Uncertainty-Based Prediction	Oct 1, 2019	Action AnticipationDecision Making	—Unverified

Show:10 25 50

← PrevPage 4 of 5Next →

All datasets EPIC-KITCHENS-100 EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEA Assembly101 EgoExoLearn 50 Salads

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PlausiVL	Recall@5	27.6	—	Unverified
2	InAViT	Recall@5	25.89	—	Unverified
3	UADT	Recall@5	23	—	Unverified
4	S-GEAR	Recall@5	19.9	—	Unverified
5	AFFT	Recall@5	18.5	—	Unverified
6	MeMViT-24	Recall@5	17.7	—	Unverified
7	AVT+	Recall@5	15.9	—	Unverified
8	TempAgg	Recall@5	14.73	—	Unverified
9	RU-LSTM	Recall@5	13.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InAViT	recall@5	23.75	—	Unverified
2	AVT++	recall@5	16.7	—	Unverified
3	AFFT	recall@5	14.9	—	Unverified
4	Abstract Goal	recall@5	14.29	—	Unverified
5	AVT+	recall@5	12.6	—	Unverified
6	TempAgg	recall@5	12.6	—	Unverified
7	RULSTM	recall@5	11.2	—	Unverified
8	TBN	recall@5	11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	22.03	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	16.84	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	14.66	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	14.39	—	Unverified
5	ED	Top 1 Accuracy - Act.	8.08	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	6	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	4.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	13.28	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	10.41	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	9.25	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	8.16	—	Unverified
5	ED	Top 1 Accuracy - Act.	2.65	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	2.39	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	2.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	68.4	—	Unverified
2	InAViT	Top-1 Accuracy	67.8	—	Unverified
3	Abstract Goal	Top-1 Accuracy	49.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Goal Consistency	Verbs Recall@5	60.04	—	Unverified
2	TempAgg	Verbs Recall@5	59.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Action anticipation baseline (co-training, with gaze)	Accuracy	45.45	—	Unverified
2	Action anticipation baseline (co-training, no gaze)	Accuracy	38.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	62.7	—	Unverified