SOTAVerified

Temporal Action Localization

Temporal Action Localization aims to detect activities in the video stream and output beginning and end timestamps. It is closely related to Temporal Action Proposal Generation.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 1477 papers

TitleStatusHype
Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation LearningCode0
Skeleton-OOD: An End-to-End Skeleton-Based Model for Robust Out-of-Distribution Human Action DetectionCode0
Matrix Manifold Neural Networks++—0
Enhanced Spatiotemporal Prediction Using Physical-guided And Frequency-enhanced Recurrent Neural Networks—0
MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models—0
From CNNs to Transformers in Multimodal Human Action Recognition: A Survey—0
Counterfactual Gradients-based Quantification of Prediction Trust in Neural NetworksCode0
A Survey on Backbones for Deep Video Action Recognition—0
STAT: Towards Generalizable Temporal Action Localization—0
DeepLocalization: Using change point detection for Temporal Action Localization—0
Learning to Score Sign Language with Two-stage Method—0
Weakly supervised temporal action localization with actionness-guided false positive suppressionCode0
Leveraging Temporal Contextualization for Video Action RecognitionCode2
A Survey on Multimodal Wearable Sensor-based Human Action Recognition—0
Multimodal Attack Detection for Action Recognition ModelsCode0
Exploring Explainability in Video Action Recognition—0
MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition—0
Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder—0
Test-Time Zero-Shot Temporal Action LocalizationCode2
UniMD: Towards Unifying Moment Retrieval and Temporal Action DetectionCode2
PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos—0
UniAV: Unified Audio-Visual Perception for Multi-Task Video Event LocalizationCode1
Language Model Guided Interpretable Video Action ReasoningCode0
LoSA: Long-Short-range Adapter for Scaling End-to-End Temporal Action Localization—0
Dual DETRs for Multi-Label Temporal Action Detection—0
PLOT-TAL -- Prompt Learning with Optimal Transport for Few-Shot Temporal Action Localization—0
InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingCode7
Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes—0
A Lie Group Approach to Riemannian Batch NormalizationCode1
Skeleton-Based Human Action Recognition with Noisy LabelsCode0
Leveraging Foundation Model Automatic Data Augmentation Strategies and Skeletal Points for Hands Action Recognition in Industrial Assembly Lines—0
Video Mamba Suite: State Space Model as a Versatile Alternative for Video UnderstandingCode3
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin—0
Deep Learning Approaches for Human Action Recognition in Video Data—0
Transformer-based Fusion of 2D-pose and Spatio-temporal Embeddings for Distracted Driver Action Recognition—0
Density-Guided Label Smoothing for Temporal Localization of Driving Actions—0
Advancing Human Action Recognition with Foundation Models trained on Unlabeled Public Videos—0
Boosting Adversarial Transferability across Model Genus by Deformation-Constrained WarpingCode0
Active Generation Network of Human Skeleton for Action Recognition—0
Cutup and Detect: Human Fall Detection on Cutup Untrimmed Videos Using a Large Foundational Video Understanding Model—0
M2-CLIP: A Multimodal, Multi-task Adapting Framework for Video Action Recognition—0
Adversarial Augmentation Training Makes Action Recognition Models More Robust to Realistic Video Distribution ShiftsCode0
Just Add ?! Pose Induced Video Transformers for Understanding Activities of Daily Living—0
PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition—0
Realigning Confidence with Temporal Saliency Information for Point-Level Weakly-Supervised Temporal Action LocalizationCode1
A Large-Scale Re-identification Analysis in Sporting Scenarios: the Betrayal of Reaching a Critical Point—0
A Dense-Sparse Complementary Network for Human Action Recognition based on RGB and Skeleton ModalitiesCode1
Spatial-Temporal Decoupling Contrastive Learning for Skeleton-based Human Action RecognitionCode0
Classifying Soccer Ball-on-Goal Position Through Kicker Shooting Action—0
Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based ApproachCode1
Show:102550
← PrevPage 3 of 30Next →
All datasetsTHUMOS14ActivityNet-1.3HACSFineActionMultiTHUMOSCrossTaskEPIC-KITCHENS-100MUSESActivityNet-1.2Ego4D MQ testEgo4D MQ valMEXaction2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaTAD (VideoMAEv2-giant)Avg mAP (0.3:0.7)76.9—Unverified
2RDFA-S6 (InternVideo2-6B)Avg mAP (0.3:0.7)74.2—Unverified
3ActionMamba(InternVideo2-6B)Avg mAP (0.3:0.7)72.72—Unverified
4GCMmAP IOU@0.172.5—Unverified
5AGT (Ours)mAP IOU@0.172.1—Unverified
6InternVideo2-6BAvg mAP (0.3:0.7)72—Unverified
7ActionFormer (InternVideo features)Avg mAP (0.3:0.7)71.58—Unverified
8TriDet (VideoMAE v2-g feature)Avg mAP (0.3:0.7)70.1—Unverified
9InternVideo2-1BAvg mAP (0.3:0.7)69.8—Unverified
10ActionFormer (VideoMAE V2-g features)Avg mAP (0.3:0.7)69.6—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LmAP IOU@0.559.3—Unverified
2RDFA-S6 (InternVideo2-6B)mAP42.9—Unverified
3ActionMamba (InternVideo2-6B)mAP42.02—Unverified
4PRN+BMN (ensemble)mAP42—Unverified
5AdaTAD (VideoMAEv2-giant)mAP41.93—Unverified
6InternVideo2-6BmAP41.2—Unverified
7InternVideo2-1BmAP40.4—Unverified
8UniMD+Sync.mAP39.83—Unverified
9PRN (CSN)mAP39.4—Unverified
10InternVideomAP39—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)Average-mAP45.8—Unverified
2ActionMamba(InternVideo2-6B)Average-mAP44.56—Unverified
3DyFADet(VideoMAEv2)Average-mAP44.3—Unverified
4InternVideo2-6BAverage-mAP43.3—Unverified
5TriDet (VideoMAEv2)Average-mAP43.1—Unverified
6InternVideo2-1BAverage-mAP42.4—Unverified
7InternVideoAverage-mAP41.55—Unverified
8TriDet (SlowFast)Average-mAP38.6—Unverified
9TriDet (I3D RGB)Average-mAP36.8—Unverified
10TadTr (I3D RGB)Average-mAP32.09—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)mAP29.6—Unverified
2ActionMamba(InternVideo2-6B)mAP29.04—Unverified
3InternVideo2-6BmAP27.7—Unverified
4DyFADet (VideoMAE v2-g)mAP23.8—Unverified
5VideoMAE V2-gmAP18.24—Unverified
6InternVideomAP17.57—Unverified
7BMN (i3d feaure)mAP9.25—Unverified
8G-TAD (i3d feature)mAP9.06—Unverified
9DBG (i3d feature)mAP6.75—Unverified
#ModelMetricClaimedVerifiedStatus
1TriDet (VideoMAEv2)Average mAP37.5—Unverified
2DualDETR (I3D-rgb)Average mAP32.64—Unverified
3TriDet (I3D-rgb)Average mAP30.7—Unverified
4TemporalMaxerAverage mAP29.9—Unverified
5PointTADAverage mAP23.5—Unverified
6PDANAverage mAP17.3—Unverified
7MS-TCTAverage mAP16.2—Unverified
8MLADAverage mAP14.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCLIPRecall47.3—Unverified
2VLMRecall46.5—Unverified
3TACoRecall42.5—Unverified
4Text-Video EmbeddingRecall33.6—Unverified
5Fully-supervised upper-boundRecall31.6—Unverified
6ZhukovRecall22.4—Unverified
7AlayracRecall13.3—Unverified
#ModelMetricClaimedVerifiedStatus
1AdaTAD (verb, VideoMAE-L)Avg mAP (0.1-0.5)29.3—Unverified
2TriDet (verb)Avg mAP (0.1-0.5)25.4—Unverified
3TemporalMaxer (verb)Avg mAP (0.1-0.5)24.5—Unverified
4ActionFormer (verb)Avg mAP (0.1-0.5)23.5—Unverified
5G-TAD (verb)Avg mAP (0.1-0.5)9.4—Unverified
6BMN (verb)Avg mAP (0.1-0.5)8.4—Unverified
#ModelMetricClaimedVerifiedStatus
1TemporalMaxermAP27.2—Unverified
2MUSESmAP18.6—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepMetricLearnermAP IOU@0.535.2—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.76—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.4—Unverified
#ModelMetricClaimedVerifiedStatus
1S-CNNmAP7.4—Unverified