Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 110 papers

Title	Date	Tasks	Status	Score
Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities	Mar 28, 2022	3D Action RecognitionAction Anticipation	CodeCode Available	5
TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation	Mar 7, 2020	Action AnticipationPrediction	—Unverified	0
Uncertainty-aware Action Decoupling Transformer for Action Anticipation	Jan 1, 2024	Action Anticipation	—Unverified	0
Untrimmed Action Anticipation	Feb 8, 2022	Action AnticipationAction Detection	—Unverified	0
VEDIT: Latent Prediction Architecture For Procedural Video Representation Learning	Oct 4, 2024	Action AnticipationDenoising	—Unverified	0
VIENA2: A Driving Anticipation Dataset	Oct 22, 2018	Action Anticipation	—Unverified	0
Vision and Intention Boost Large Language Model in Long-Term Action Anticipation	May 3, 2025	Action AnticipationIn-Context Learning	—Unverified	0
Visual Forecasting by Imitating Dynamics in Natural Sequences	Aug 19, 2017	Action AnticipationReinforcement Learning	—Unverified	0
VS-TransGRU: A Novel Transformer-GRU-based Framework Enhanced by Visual-Semantic Fusion for Egocentric Action Anticipation	Jul 8, 2023	Action AnticipationDecoder	—Unverified	0
On the Efficacy of Text-Based Input Modalities for Action Anticipation	Jan 23, 2024	Action Anticipation	—Unverified	0
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance	Aug 4, 2024	Action AnticipationBenchmarking	—Unverified	0
A-ACT: Action Anticipation through Cycle Transformations	Apr 2, 2022	Action Anticipation	—Unverified	0
ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipation	Dec 5, 2024	Action AnticipationAction Segmentation	—Unverified	0
Action Anticipation By Predicting Future Dynamic Images	Aug 1, 2018	Action AnticipationAutonomous Driving	—Unverified	0
Action Anticipation for Collaborative Environments: The Impact of Contextual Information and Uncertainty-Based Prediction	Oct 1, 2019	Action AnticipationDecision Making	—Unverified	0
Action Anticipation with RBF Kernelized Feature Mapping RNN	Nov 18, 2019	Action Anticipation	—Unverified	0
Analysis over vision-based models for pedestrian action anticipation	May 27, 2023	Action AnticipationAutonomous Vehicles	—Unverified	0
Anticipating human actions by correlating past with the future with Jaccard similarity measures	May 26, 2021	Action AnticipationAction Recognition	—Unverified	0
Anticipation and next action forecasting in video: an end-to-end model with memory	Jan 11, 2019	Action Anticipation	—Unverified	0
A Survey on Deep Learning Techniques for Action Anticipation	Sep 29, 2023	Action AnticipationAutonomous Driving	—Unverified	0
Knowledge Distillation for Human Action Anticipation	Apr 9, 2019	Action AnticipationAction Recognition	—Unverified	0
Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models	May 30, 2024	Action Anticipationcounterfactual	—Unverified	0
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic	Oct 9, 2020	Action Anticipation	—Unverified	0
Delving into 3D Action Anticipation from Streaming Videos	Jun 15, 2019	Action AnticipationAction Classification	—Unverified	0
DiffAnt: Diffusion Models for Action Anticipation	Nov 27, 2023	Action Anticipation	—Unverified	0

Show:10 25 50

← PrevPage 3 of 5Next →

All datasets EPIC-KITCHENS-100 EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEA Assembly101 EgoExoLearn 50 Salads

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PlausiVL	Recall@5	27.6	—	Unverified
2	InAViT	Recall@5	25.89	—	Unverified
3	UADT	Recall@5	23	—	Unverified
4	S-GEAR	Recall@5	19.9	—	Unverified
5	AFFT	Recall@5	18.5	—	Unverified
6	MeMViT-24	Recall@5	17.7	—	Unverified
7	AVT+	Recall@5	15.9	—	Unverified
8	TempAgg	Recall@5	14.73	—	Unverified
9	RU-LSTM	Recall@5	13.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InAViT	recall@5	23.75	—	Unverified
2	AVT++	recall@5	16.7	—	Unverified
3	AFFT	recall@5	14.9	—	Unverified
4	Abstract Goal	recall@5	14.29	—	Unverified
5	AVT+	recall@5	12.6	—	Unverified
6	TempAgg	recall@5	12.6	—	Unverified
7	RULSTM	recall@5	11.2	—	Unverified
8	TBN	recall@5	11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	22.03	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	16.84	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	14.66	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	14.39	—	Unverified
5	ED	Top 1 Accuracy - Act.	8.08	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	6	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	4.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Abstract Goal	Top 1 Accuracy - Act.	13.28	—	Unverified
2	AVT+	Top 1 Accuracy - Act.	10.41	—	Unverified
3	ImagineRNN	Top 1 Accuracy - Act.	9.25	—	Unverified
4	RULSTM [24, 23]	Top 1 Accuracy - Act.	8.16	—	Unverified
5	ED	Top 1 Accuracy - Act.	2.65	—	Unverified
6	ATSN	Top 1 Accuracy - Act.	2.39	—	Unverified
7	2SCNN	Top 1 Accuracy - Act.	2.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	68.4	—	Unverified
2	InAViT	Top-1 Accuracy	67.8	—	Unverified
3	Abstract Goal	Top-1 Accuracy	49.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Goal Consistency	Verbs Recall@5	60.04	—	Unverified
2	TempAgg	Verbs Recall@5	59.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Action anticipation baseline (co-training, with gaze)	Accuracy	45.45	—	Unverified
2	Action anticipation baseline (co-training, no gaze)	Accuracy	38.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UADT	Top-1 Accuracy	62.7	—	Unverified