SOTAVerified

Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 110 papers

TitleStatusHype
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningCode7
EgoVideo: Exploring Egocentric Foundation Model and Downstream AdaptationCode2
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real WorldCode2
Multimodal Large Models Are Effective Action AnticipatorsCode1
MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Action AnticipationCode1
Gated Temporal Diffusion for Stochastic Long-Term Dense AnticipationCode1
Semantically Guided Representation Learning For Action AnticipationCode1
Action Scene Graphs for Long-Form Understanding of Egocentric VideosCode1
AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?Code1
Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023Code1
Action Anticipation with Goal ConsistencyCode1
Anticipative Feature Fusion Transformer for Multi-Modal Action AnticipationCode1
Rethinking Learning Approaches for Long-Term Action AnticipationCode1
Learning State-Aware Visual Representations from Audible InteractionsCode1
Real-time Online Video Detection with Temporal Smoothing TransformersCode1
Intention-Conditioned Long-Term Human Egocentric Action ForecastingCode1
Video + CLIP Baseline for Ego4D Long-term Action AnticipationCode1
Pedestrian 3D Bounding Box PredictionCode1
Future Transformer for Long-term Action AnticipationCode1
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video RecognitionCode1
A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic AccidentsCode1
Technical Report: Temporal Aggregate RepresentationsCode1
Anticipative Video TransformerCode1
Higher Order Recurrent Space-Time Transformer for Video Action PredictionCode1
Video Representation Learning with Visual Tempo ConsistencyCode1
Rescaling Egocentric VisionCode1
Temporal Aggregate Representations for Long-Range Video UnderstandingCode1
Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNsCode1
Rolling-Unrolling LSTMs for Action Anticipation from First-Person VideoCode1
What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality AttentionCode1
Vision and Intention Boost Large Language Model in Long-Term Action Anticipation—0
Hierarchical and Multimodal Data for Daily Activity UnderstandingCode0
Action Anticipation from SoccerNet Football Video BroadcastsCode0
ICPR 2024 Competition on Rider Intention Prediction—0
Learning to Generate Long-term Future Narrations Describing Activities of Daily Living—0
Temporal Context Consistency Above All: Enhancing Long-Term Anticipation by Learning and Enforcing Temporal Constraints—0
ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipation—0
HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation—0
Human Action Anticipation: A Survey—0
VEDIT: Latent Prediction Architecture For Procedural Video Representation Learning—0
Mamba Fusion: Learning Actions Through QuestioningCode0
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance—0
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person ViewCode0
QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024—0
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought—0
Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models—0
PhilHumans: Benchmarking Machine Learning for Personal Health—0
Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention—0
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism—0
Show:102550
← PrevPage 1 of 3Next →
All datasetsEPIC-KITCHENS-100EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEAAssembly101EgoExoLearn50 Salads

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PlausiVLRecall@527.6—Unverified
2InAViTRecall@525.89—Unverified
3UADTRecall@523—Unverified
4S-GEARRecall@519.9—Unverified
5AFFTRecall@518.5—Unverified
6MeMViT-24Recall@517.7—Unverified
7AVT+Recall@515.9—Unverified
8TempAggRecall@514.73—Unverified
9RU-LSTMRecall@513.94—Unverified
#ModelMetricClaimedVerifiedStatus
1InAViTrecall@523.75—Unverified
2AVT++recall@516.7—Unverified
3AFFTrecall@514.9—Unverified
4Abstract Goalrecall@514.29—Unverified
5AVT+recall@512.6—Unverified
6TempAggrecall@512.6—Unverified
7RULSTMrecall@511.2—Unverified
8TBNrecall@511—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.22.03—Unverified
2AVT+Top 1 Accuracy - Act.16.84—Unverified
3ImagineRNNTop 1 Accuracy - Act.14.66—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.14.39—Unverified
5EDTop 1 Accuracy - Act.8.08—Unverified
6ATSNTop 1 Accuracy - Act.6—Unverified
72SCNNTop 1 Accuracy - Act.4.32—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.13.28—Unverified
2AVT+Top 1 Accuracy - Act.10.41—Unverified
3ImagineRNNTop 1 Accuracy - Act.9.25—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.8.16—Unverified
5EDTop 1 Accuracy - Act.2.65—Unverified
6ATSNTop 1 Accuracy - Act.2.39—Unverified
72SCNNTop 1 Accuracy - Act.2.29—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy68.4—Unverified
2InAViTTop-1 Accuracy67.8—Unverified
3Abstract GoalTop-1 Accuracy49.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Goal ConsistencyVerbs Recall@560.04—Unverified
2TempAggVerbs Recall@559.11—Unverified
#ModelMetricClaimedVerifiedStatus
1Action anticipation baseline (co-training, with gaze)Accuracy45.45—Unverified
2Action anticipation baseline (co-training, no gaze)Accuracy38.7—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy62.7—Unverified