SOTAVerified

TransAction: ICL-SJTU Submission to EPIC-Kitchens Action Anticipation Challenge 2021

2021-07-28Code Available0· sign in to hype

Xiao Gu, Jianing Qiu, Yao Guo, Benny Lo, Guang-Zhong Yang

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In this report, the technical details of our submission to the EPIC-Kitchens Action Anticipation Challenge 2021 are given. We developed a hierarchical attention model for action anticipation, which leverages Transformer-based attention mechanism to aggregate features across temporal dimension, modalities, symbiotic branches respectively. In terms of Mean Top-5 Recall of action, our submission with team name ICL-SJTU achieved 13.39% for overall testing set, 10.05% for unseen subsets and 11.88% for tailed subsets. Additionally, it is noteworthy that our submission ranked 1st in terms of verb class in all three (sub)sets.

Tasks

Reproductions