SOTAVerified

Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 110 papers

TitleStatusHype
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningCode7
Vision and Intention Boost Large Language Model in Long-Term Action Anticipation—0
Hierarchical and Multimodal Data for Daily Activity UnderstandingCode0
Action Anticipation from SoccerNet Football Video BroadcastsCode0
ICPR 2024 Competition on Rider Intention Prediction—0
Learning to Generate Long-term Future Narrations Describing Activities of Daily Living—0
MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Action AnticipationCode1
Multimodal Large Models Are Effective Action AnticipatorsCode1
Temporal Context Consistency Above All: Enhancing Long-Term Anticipation by Learning and Enforcing Temporal Constraints—0
ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipation—0
HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation—0
Human Action Anticipation: A Survey—0
VEDIT: Latent Prediction Architecture For Procedural Video Representation Learning—0
Mamba Fusion: Learning Actions Through QuestioningCode0
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance—0
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person ViewCode0
Gated Temporal Diffusion for Stochastic Long-Term Dense AnticipationCode1
QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024—0
Semantically Guided Representation Learning For Action AnticipationCode1
EgoVideo: Exploring Egocentric Foundation Model and Downstream AdaptationCode2
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought—0
Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models—0
PhilHumans: Benchmarking Machine Learning for Personal Health—0
Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention—0
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real WorldCode2
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism—0
On the Efficacy of Text-Based Input Modalities for Action Anticipation—0
Uncertainty-aware Action Decoupling Transformer for Action Anticipation—0
Action Scene Graphs for Long-Form Understanding of Egocentric VideosCode1
PALM: Predicting Actions through Language Models—0
DiffAnt: Diffusion Models for Action Anticipation—0
Object-centric Video Representation for Long-term Action AnticipationCode0
A Survey on Deep Learning Techniques for Action Anticipation—0
Knowledge-Guided Short-Context Action Anticipation in Human-Centric Videos—0
JOADAA: joint online action detection and action anticipation—0
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos—0
AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?Code1
Multiscale Video Pretraining for Long-Term Activity Forecasting—0
VS-TransGRU: A Novel Transformer-GRU-based Framework Enhanced by Visual-Semantic Fusion for Egocentric Action Anticipation—0
Technical Report for Ego4D Long Term Action Anticipation Challenge 2023Code0
Streaming egocentric action anticipation: An evaluation scheme and approach—0
Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023Code1
Action Anticipation with Goal ConsistencyCode1
Analysis over vision-based models for pedestrian action anticipation—0
Enhancing Next Active Object-based Egocentric Action Anticipation with Guided AttentionCode0
Therbligs in Action: Video Understanding through Motion Primitives—0
Off-Policy Action Anticipation in Multi-Agent Reinforcement Learning—0
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction VideosCode0
Leveraging Temporal Context in Low Representational Power Regimes—0
Show:102550
← PrevPage 1 of 3Next →
All datasetsEPIC-KITCHENS-100EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEAAssembly101EgoExoLearn50 Salads

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PlausiVLRecall@527.6—Unverified
2InAViTRecall@525.89—Unverified
3UADTRecall@523—Unverified
4S-GEARRecall@519.9—Unverified
5AFFTRecall@518.5—Unverified
6MeMViT-24Recall@517.7—Unverified
7AVT+Recall@515.9—Unverified
8TempAggRecall@514.73—Unverified
9RU-LSTMRecall@513.94—Unverified
#ModelMetricClaimedVerifiedStatus
1InAViTrecall@523.75—Unverified
2AVT++recall@516.7—Unverified
3AFFTrecall@514.9—Unverified
4Abstract Goalrecall@514.29—Unverified
5AVT+recall@512.6—Unverified
6TempAggrecall@512.6—Unverified
7RULSTMrecall@511.2—Unverified
8TBNrecall@511—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.22.03—Unverified
2AVT+Top 1 Accuracy - Act.16.84—Unverified
3ImagineRNNTop 1 Accuracy - Act.14.66—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.14.39—Unverified
5EDTop 1 Accuracy - Act.8.08—Unverified
6ATSNTop 1 Accuracy - Act.6—Unverified
72SCNNTop 1 Accuracy - Act.4.32—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.13.28—Unverified
2AVT+Top 1 Accuracy - Act.10.41—Unverified
3ImagineRNNTop 1 Accuracy - Act.9.25—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.8.16—Unverified
5EDTop 1 Accuracy - Act.2.65—Unverified
6ATSNTop 1 Accuracy - Act.2.39—Unverified
72SCNNTop 1 Accuracy - Act.2.29—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy68.4—Unverified
2InAViTTop-1 Accuracy67.8—Unverified
3Abstract GoalTop-1 Accuracy49.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Goal ConsistencyVerbs Recall@560.04—Unverified
2TempAggVerbs Recall@559.11—Unverified
#ModelMetricClaimedVerifiedStatus
1Action anticipation baseline (co-training, with gaze)Accuracy45.45—Unverified
2Action anticipation baseline (co-training, no gaze)Accuracy38.7—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy62.7—Unverified