SOTAVerified

Action Anticipation

Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 110 papers

TitleStatusHype
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningCode7
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real WorldCode2
EgoVideo: Exploring Egocentric Foundation Model and Downstream AdaptationCode2
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video RecognitionCode1
Gated Temporal Diffusion for Stochastic Long-Term Dense AnticipationCode1
Multimodal Large Models Are Effective Action AnticipatorsCode1
Action Scene Graphs for Long-Form Understanding of Egocentric VideosCode1
Rethinking Learning Approaches for Long-Term Action AnticipationCode1
Technical Report: Temporal Aggregate RepresentationsCode1
What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality AttentionCode1
Temporal Aggregate Representations for Long-Range Video UnderstandingCode1
Anticipative Video TransformerCode1
AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?Code1
Anticipative Feature Fusion Transformer for Multi-Modal Action AnticipationCode1
Pedestrian 3D Bounding Box PredictionCode1
Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023Code1
Real-time Online Video Detection with Temporal Smoothing TransformersCode1
Rescaling Egocentric VisionCode1
Higher Order Recurrent Space-Time Transformer for Video Action PredictionCode1
Video Representation Learning with Visual Tempo ConsistencyCode1
A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic AccidentsCode1
Intention-Conditioned Long-Term Human Egocentric Action ForecastingCode1
Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNsCode1
Semantically Guided Representation Learning For Action AnticipationCode1
Learning State-Aware Visual Representations from Audible InteractionsCode1
Action Anticipation with Goal ConsistencyCode1
Rolling-Unrolling LSTMs for Action Anticipation from First-Person VideoCode1
Video + CLIP Baseline for Ego4D Long-term Action AnticipationCode1
MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Action AnticipationCode1
Future Transformer for Long-term Action AnticipationCode1
Action Anticipation for Collaborative Environments: The Impact of Contextual Information and Uncertainty-Based Prediction—0
Anticipating human actions by correlating past with the future with Jaccard similarity measures—0
Leveraging Temporal Context in Low Representational Power Regimes—0
Egocentric Object Manipulation Graphs—0
Analysis over vision-based models for pedestrian action anticipation—0
Action Anticipation By Predicting Future Dynamic Images—0
DiffAnt: Diffusion Models for Action Anticipation—0
Delving into 3D Action Anticipation from Streaming Videos—0
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance—0
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos—0
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain—0
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism—0
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic—0
Inductive Attention for Video Action Anticipation—0
ICPR 2024 Competition on Rider Intention Prediction—0
Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models—0
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought—0
JOADAA: joint online action detection and action anticipation—0
Knowledge Distillation for Action Anticipation via Label Smoothing—0
Human Action Anticipation: A Survey—0
Show:102550
← PrevPage 1 of 3Next →
All datasetsEPIC-KITCHENS-100EPIC-KITCHENS-100 (test)EPIC-KITCHENS-55 (Seen test set (S1))EPIC-KITCHENS-55 (Unseen test set (S2)EGTEAAssembly101EgoExoLearn50 Salads

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PlausiVLRecall@527.6—Unverified
2InAViTRecall@525.89—Unverified
3UADTRecall@523—Unverified
4S-GEARRecall@519.9—Unverified
5AFFTRecall@518.5—Unverified
6MeMViT-24Recall@517.7—Unverified
7AVT+Recall@515.9—Unverified
8TempAggRecall@514.73—Unverified
9RU-LSTMRecall@513.94—Unverified
#ModelMetricClaimedVerifiedStatus
1InAViTrecall@523.75—Unverified
2AVT++recall@516.7—Unverified
3AFFTrecall@514.9—Unverified
4Abstract Goalrecall@514.29—Unverified
5AVT+recall@512.6—Unverified
6TempAggrecall@512.6—Unverified
7RULSTMrecall@511.2—Unverified
8TBNrecall@511—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.22.03—Unverified
2AVT+Top 1 Accuracy - Act.16.84—Unverified
3ImagineRNNTop 1 Accuracy - Act.14.66—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.14.39—Unverified
5EDTop 1 Accuracy - Act.8.08—Unverified
6ATSNTop 1 Accuracy - Act.6—Unverified
72SCNNTop 1 Accuracy - Act.4.32—Unverified
#ModelMetricClaimedVerifiedStatus
1Abstract GoalTop 1 Accuracy - Act.13.28—Unverified
2AVT+Top 1 Accuracy - Act.10.41—Unverified
3ImagineRNNTop 1 Accuracy - Act.9.25—Unverified
4RULSTM [24, 23]Top 1 Accuracy - Act.8.16—Unverified
5EDTop 1 Accuracy - Act.2.65—Unverified
6ATSNTop 1 Accuracy - Act.2.39—Unverified
72SCNNTop 1 Accuracy - Act.2.29—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy68.4—Unverified
2InAViTTop-1 Accuracy67.8—Unverified
3Abstract GoalTop-1 Accuracy49.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Goal ConsistencyVerbs Recall@560.04—Unverified
2TempAggVerbs Recall@559.11—Unverified
#ModelMetricClaimedVerifiedStatus
1Action anticipation baseline (co-training, with gaze)Accuracy45.45—Unverified
2Action anticipation baseline (co-training, no gaze)Accuracy38.7—Unverified
#ModelMetricClaimedVerifiedStatus
1UADTTop-1 Accuracy62.7—Unverified