SOTAVerified

Temporal Action Localization

Temporal Action Localization aims to detect activities in the video stream and output beginning and end timestamps. It is closely related to Temporal Action Proposal Generation.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 1477 papers

TitleStatusHype
Relational Self-Attention: What's Missing in Attention for Video UnderstandingCode1
MetaVD: A Meta Video Dataset for enhancing human action recognition datasetsCode0
Gradient Frequency Modulation for Visually Explaining Video Understanding Models—0
Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition—0
Logsig-RNN: a novel network for robust and efficient skeleton-based action recognitionCode1
GTM: Gray Temporal Model for Video Recognition—0
Few-Shot Temporal Action Localization with Query Adaptive TransformerCode1
TEAM-Net: Multi-modal Learning for Video Action Recognition with Partial DecodingCode0
Joint Learning On The Hierarchy Representation for Fine-Grained Human Action Recognition—0
TAda! Temporally-Adaptive Convolutions for Video UnderstandingCode0
Video Is Graph: Structured Graph Module for Video Action Recognition—0
A Multi-viewpoint Outdoor Dataset for Human Action RecognitionCode0
SAIC_Cambridge-HuPBA-FBK Submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021—0
Cross-Stage Transformer for Video Learning—0
Temporal Action Localization with Global Segmentation Mask Transformers—0
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding—0
ActionCLIP: A New Paradigm for Video Action RecognitionCode1
A Survey on Temporal Sentence Grounding in Videos—0
Conditional Extreme Value Theory for Open Set Video Domain AdaptationCode0
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment—0
MM-ViT: Multi-Modal Video Transformer for Compressed Video Action Recognition—0
Self-Supervised Video Representation Learning with Meta-Contrastive Network—0
Foreground-Action Consistency Network for Weakly Supervised Temporal Action LocalizationCode1
Spatio-Temporal Human Action Recognition Modelwith Flexible-interval Sampling and Normalization—0
Deep Motion Prior for Weakly-Supervised Temporal Action Localization—0
Learning Action Completeness from Points for Weakly-supervised Temporal Action LocalizationCode1
AutoVideo: An Automated Video Action Recognition SystemCode1
Temporal Action Localization Using Gated Recurrent UnitsCode0
Skeleton Cloud Colorization for Unsupervised 3D Action Representation Learning—0
Cross-modal Consensus Network forWeakly Supervised Temporal Action LocalizationCode1
Enriching Local and Global Contexts for Temporal Action LocalizationCode1
Cross-modal Consensus Network for Weakly Supervised Temporal Action LocalizationCode1
Transferable Knowledge-Based Multi-Granularity Aggregation Network for Temporal Action Localization: Submission to ActivityNet Challenge 2021—0
STAR: Sparse Transformer-based Action RecognitionCode1
Training for temporal sparsity in deep neural networks, application in video processing—0
RGB Stream Is Enough for Temporal Action DetectionCode1
Action Transformer: A Self-Attention Model for Short-Time Pose-Based Human Action RecognitionCode1
VideoLightFormer: Lightweight Action Recognition using Transformers—0
Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action LocalizationCode1
Exploring Temporal Context and Human Movement Dynamics for Online Action Detection in Videos—0
Exploring Stronger Feature for Temporal Action Localization—0
Transfer Learning of Deep Spatiotemporal Networks to Model Arbitrarily Long Videos of SeizuresCode0
Two-Stream Consensus Network: Submission to HACS Challenge 2021 Weakly-Supervised Learning Track—0
Proposal Relation Network for Temporal Action DetectionCode1
Weakly-Supervised Temporal Action Localization Through Local-Global Background Modeling—0
Three Birds with One Stone: Multi-Task Temporal Action Detection via Recycling Temporal Annotations—0
Spatio-temporal Contrastive Domain Adaptation for Action Recognition—0
End-to-end Temporal Action Detection with TransformerCode1
BABEL: Bodies, Action and Behavior with English LabelsCode1
Relation Modeling in Spatio-Temporal Action Localization—0
Show:102550
← PrevPage 10 of 30Next →
All datasetsTHUMOS14ActivityNet-1.3HACSFineActionMultiTHUMOSCrossTaskEPIC-KITCHENS-100MUSESActivityNet-1.2Ego4D MQ testEgo4D MQ valMEXaction2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaTAD (VideoMAEv2-giant)Avg mAP (0.3:0.7)76.9—Unverified
2RDFA-S6 (InternVideo2-6B)Avg mAP (0.3:0.7)74.2—Unverified
3ActionMamba(InternVideo2-6B)Avg mAP (0.3:0.7)72.72—Unverified
4GCMmAP IOU@0.172.5—Unverified
5AGT (Ours)mAP IOU@0.172.1—Unverified
6InternVideo2-6BAvg mAP (0.3:0.7)72—Unverified
7ActionFormer (InternVideo features)Avg mAP (0.3:0.7)71.58—Unverified
8TriDet (VideoMAE v2-g feature)Avg mAP (0.3:0.7)70.1—Unverified
9InternVideo2-1BAvg mAP (0.3:0.7)69.8—Unverified
10ActionFormer (VideoMAE V2-g features)Avg mAP (0.3:0.7)69.6—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LmAP IOU@0.559.3—Unverified
2RDFA-S6 (InternVideo2-6B)mAP42.9—Unverified
3ActionMamba (InternVideo2-6B)mAP42.02—Unverified
4PRN+BMN (ensemble)mAP42—Unverified
5AdaTAD (VideoMAEv2-giant)mAP41.93—Unverified
6InternVideo2-6BmAP41.2—Unverified
7InternVideo2-1BmAP40.4—Unverified
8UniMD+Sync.mAP39.83—Unverified
9PRN (CSN)mAP39.4—Unverified
10InternVideomAP39—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)Average-mAP45.8—Unverified
2ActionMamba(InternVideo2-6B)Average-mAP44.56—Unverified
3DyFADet(VideoMAEv2)Average-mAP44.3—Unverified
4InternVideo2-6BAverage-mAP43.3—Unverified
5TriDet (VideoMAEv2)Average-mAP43.1—Unverified
6InternVideo2-1BAverage-mAP42.4—Unverified
7InternVideoAverage-mAP41.55—Unverified
8TriDet (SlowFast)Average-mAP38.6—Unverified
9TriDet (I3D RGB)Average-mAP36.8—Unverified
10TadTr (I3D RGB)Average-mAP32.09—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)mAP29.6—Unverified
2ActionMamba(InternVideo2-6B)mAP29.04—Unverified
3InternVideo2-6BmAP27.7—Unverified
4DyFADet (VideoMAE v2-g)mAP23.8—Unverified
5VideoMAE V2-gmAP18.24—Unverified
6InternVideomAP17.57—Unverified
7BMN (i3d feaure)mAP9.25—Unverified
8G-TAD (i3d feature)mAP9.06—Unverified
9DBG (i3d feature)mAP6.75—Unverified
#ModelMetricClaimedVerifiedStatus
1TriDet (VideoMAEv2)Average mAP37.5—Unverified
2DualDETR (I3D-rgb)Average mAP32.64—Unverified
3TriDet (I3D-rgb)Average mAP30.7—Unverified
4TemporalMaxerAverage mAP29.9—Unverified
5PointTADAverage mAP23.5—Unverified
6PDANAverage mAP17.3—Unverified
7MS-TCTAverage mAP16.2—Unverified
8MLADAverage mAP14.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCLIPRecall47.3—Unverified
2VLMRecall46.5—Unverified
3TACoRecall42.5—Unverified
4Text-Video EmbeddingRecall33.6—Unverified
5Fully-supervised upper-boundRecall31.6—Unverified
6ZhukovRecall22.4—Unverified
7AlayracRecall13.3—Unverified
#ModelMetricClaimedVerifiedStatus
1AdaTAD (verb, VideoMAE-L)Avg mAP (0.1-0.5)29.3—Unverified
2TriDet (verb)Avg mAP (0.1-0.5)25.4—Unverified
3TemporalMaxer (verb)Avg mAP (0.1-0.5)24.5—Unverified
4ActionFormer (verb)Avg mAP (0.1-0.5)23.5—Unverified
5G-TAD (verb)Avg mAP (0.1-0.5)9.4—Unverified
6BMN (verb)Avg mAP (0.1-0.5)8.4—Unverified
#ModelMetricClaimedVerifiedStatus
1TemporalMaxermAP27.2—Unverified
2MUSESmAP18.6—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepMetricLearnermAP IOU@0.535.2—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.76—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.4—Unverified
#ModelMetricClaimedVerifiedStatus
1S-CNNmAP7.4—Unverified