SOTAVerified

Temporal Action Localization

Temporal Action Localization aims to detect activities in the video stream and output beginning and end timestamps. It is closely related to Temporal Action Proposal Generation.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 1477 papers

TitleStatusHype
InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingCode7
InternVideo: General Video Foundation Models via Generative and Discriminative LearningCode4
Video Mamba Suite: State Space Model as a Versatile Alternative for Video UnderstandingCode3
A Survey on Video Action Recognition in Sports: Datasets, Methods and ApplicationsCode3
AWT: Transferring Vision-Language Models via Augmentation, Weighting, and TransportationCode2
The Surprising Effectiveness of Multimodal Large Language Models for Video Moment RetrievalCode2
Leveraging Temporal Contextualization for Video Action RecognitionCode2
Test-Time Zero-Shot Temporal Action LocalizationCode2
UniMD: Towards Unifying Moment Retrieval and Temporal Action DetectionCode2
End-to-End Temporal Action Detection with 1B Parameters Across 1000 FramesCode2
Temporal Action Localization with Enhanced Instant DiscriminabilityCode2
NMS Threshold matters for Ego4D Moment Queries -- 2nd place solution to the Ego4D Moment Queries Challenge 2023Code2
Perception Test: A Diagnostic Benchmark for Multimodal Video ModelsCode2
On the Benefits of 3D Pose and Tracking for Human Action RecognitionCode2
VideoMAE V2: Scaling Video Masked Autoencoders with Dual MaskingCode2
TriDet: Temporal Action Detection with Relative Boundary ModelingCode2
AIM: Adapting Image Models for Efficient Video Action RecognitionCode2
Where a Strong Backbone Meets Strong Features -- ActionFormer for Ego4D Moment Queries ChallengeCode2
Structured Attention Composition for Temporal Action LocalizationCode2
ActionFormer: Localizing Moments of Actions with TransformersCode2
Temporal Segment Networks for Action Recognition in VideosCode2
Temporal Segment Networks: Towards Good Practices for Deep Action RecognitionCode2
Zero-Shot Temporal Interaction Localization for Egocentric VideosCode1
TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long VideosCode1
XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and GlassesCode1
Temporal Action Localization with Cross Layer Task Decoupling and RefinementCode1
SpikMamba: When SNN meets Mamba in Event-based Human Action RecognitionCode1
Saliency-Guided DETR for Moment Retrieval and Highlight DetectionCode1
Fisher Information guided Purification against Backdoor AttacksCode1
Open-Vocabulary Action Localization with Iterative Visual PromptingCode1
Towards Completeness: A Generalizable Action Proposal Generator for Zero-Shot Temporal Action LocalizationCode1
TDS-CLIP: Temporal Difference Side Network for Image-to-Video Transfer LearningCode1
Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and AlgorithmsCode1
Probabilistic Vision-Language Representation for Weakly Supervised Temporal Action LocalizationCode1
HAT: History-Augmented Anchor Transformer for Online Temporal Action LocalizationCode1
EPAM-Net: An Efficient Pose-driven Attention-guided Multimodal Network for Video Action RecognitionCode1
Enhancing Temporal Action Localization: Advanced S6 Modeling with Recurrent MechanismCode1
ActionSwitch: Class-agnostic Detection of Simultaneous Actions in Streaming VideosCode1
Augmented Neural Fine-Tuning for Efficient Backdoor PurificationCode1
Exploring Scalability of Self-Training for Open-Vocabulary Temporal Action LocalizationCode1
DyFADet: Dynamic Feature Aggregation for Temporal Action DetectionCode1
Referring Atomic Video Action RecognitionCode1
Snakes and Ladders: Two Steps Up for VideoMambaCode1
UniAV: Unified Audio-Visual Perception for Multi-Task Video Event LocalizationCode1
A Lie Group Approach to Riemannian Batch NormalizationCode1
Realigning Confidence with Temporal Saliency Information for Point-Level Weakly-Supervised Temporal Action LocalizationCode1
A Dense-Sparse Complementary Network for Human Action Recognition based on RGB and Skeleton ModalitiesCode1
Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based ApproachCode1
Generative Model-based Feature Knowledge Distillation for Action RecognitionCode1
EZ-CLIP: Efficient Zeroshot Video Action RecognitionCode1
Show:102550
← PrevPage 1 of 30Next →
All datasetsTHUMOS14ActivityNet-1.3HACSFineActionMultiTHUMOSCrossTaskEPIC-KITCHENS-100MUSESActivityNet-1.2Ego4D MQ testEgo4D MQ valMEXaction2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaTAD (VideoMAEv2-giant)Avg mAP (0.3:0.7)76.9—Unverified
2RDFA-S6 (InternVideo2-6B)Avg mAP (0.3:0.7)74.2—Unverified
3ActionMamba(InternVideo2-6B)Avg mAP (0.3:0.7)72.72—Unverified
4GCMmAP IOU@0.172.5—Unverified
5AGT (Ours)mAP IOU@0.172.1—Unverified
6InternVideo2-6BAvg mAP (0.3:0.7)72—Unverified
7ActionFormer (InternVideo features)Avg mAP (0.3:0.7)71.58—Unverified
8TriDet (VideoMAE v2-g feature)Avg mAP (0.3:0.7)70.1—Unverified
9InternVideo2-1BAvg mAP (0.3:0.7)69.8—Unverified
10ActionFormer (VideoMAE V2-g features)Avg mAP (0.3:0.7)69.6—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LmAP IOU@0.559.3—Unverified
2RDFA-S6 (InternVideo2-6B)mAP42.9—Unverified
3ActionMamba (InternVideo2-6B)mAP42.02—Unverified
4PRN+BMN (ensemble)mAP42—Unverified
5AdaTAD (VideoMAEv2-giant)mAP41.93—Unverified
6InternVideo2-6BmAP41.2—Unverified
7InternVideo2-1BmAP40.4—Unverified
8UniMD+Sync.mAP39.83—Unverified
9PRN (CSN)mAP39.4—Unverified
10InternVideomAP39—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)Average-mAP45.8—Unverified
2ActionMamba(InternVideo2-6B)Average-mAP44.56—Unverified
3DyFADet(VideoMAEv2)Average-mAP44.3—Unverified
4InternVideo2-6BAverage-mAP43.3—Unverified
5TriDet (VideoMAEv2)Average-mAP43.1—Unverified
6InternVideo2-1BAverage-mAP42.4—Unverified
7InternVideoAverage-mAP41.55—Unverified
8TriDet (SlowFast)Average-mAP38.6—Unverified
9TriDet (I3D RGB)Average-mAP36.8—Unverified
10TadTr (I3D RGB)Average-mAP32.09—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)mAP29.6—Unverified
2ActionMamba(InternVideo2-6B)mAP29.04—Unverified
3InternVideo2-6BmAP27.7—Unverified
4DyFADet (VideoMAE v2-g)mAP23.8—Unverified
5VideoMAE V2-gmAP18.24—Unverified
6InternVideomAP17.57—Unverified
7BMN (i3d feaure)mAP9.25—Unverified
8G-TAD (i3d feature)mAP9.06—Unverified
9DBG (i3d feature)mAP6.75—Unverified
#ModelMetricClaimedVerifiedStatus
1TriDet (VideoMAEv2)Average mAP37.5—Unverified
2DualDETR (I3D-rgb)Average mAP32.64—Unverified
3TriDet (I3D-rgb)Average mAP30.7—Unverified
4TemporalMaxerAverage mAP29.9—Unverified
5PointTADAverage mAP23.5—Unverified
6PDANAverage mAP17.3—Unverified
7MS-TCTAverage mAP16.2—Unverified
8MLADAverage mAP14.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCLIPRecall47.3—Unverified
2VLMRecall46.5—Unverified
3TACoRecall42.5—Unverified
4Text-Video EmbeddingRecall33.6—Unverified
5Fully-supervised upper-boundRecall31.6—Unverified
6ZhukovRecall22.4—Unverified
7AlayracRecall13.3—Unverified
#ModelMetricClaimedVerifiedStatus
1AdaTAD (verb, VideoMAE-L)Avg mAP (0.1-0.5)29.3—Unverified
2TriDet (verb)Avg mAP (0.1-0.5)25.4—Unverified
3TemporalMaxer (verb)Avg mAP (0.1-0.5)24.5—Unverified
4ActionFormer (verb)Avg mAP (0.1-0.5)23.5—Unverified
5G-TAD (verb)Avg mAP (0.1-0.5)9.4—Unverified
6BMN (verb)Avg mAP (0.1-0.5)8.4—Unverified
#ModelMetricClaimedVerifiedStatus
1TemporalMaxermAP27.2—Unverified
2MUSESmAP18.6—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepMetricLearnermAP IOU@0.535.2—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.76—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.4—Unverified
#ModelMetricClaimedVerifiedStatus
1S-CNNmAP7.4—Unverified