SOTAVerified

Temporal Action Localization

Temporal Action Localization aims to detect activities in the video stream and output beginning and end timestamps. It is closely related to Temporal Action Proposal Generation.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 1477 papers

TitleStatusHype
Video BagNet: short temporal receptive fields increase robustness in long-term action recognitionCode0
Temporal-Distributed Backdoor Attack Against Video Based Action Recognition—0
UnLoc: A Unified Framework for Video Localization TasksCode0
Action Class Relation Detection and Classification Across Multiple Video Datasets—0
Masked Motion Predictors are Strong 3D Action Representation LearnersCode1
Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed GradientCode1
JEDI: Joint Expert Distillation in a Semi-Supervised Multi-Dataset Student-Teacher Scenario for Video Action Recognition—0
ViLP: Knowledge Exploration using Vision, Language, and Pose Embeddings for Video Action RecognitionCode0
SkateboardAI: The Coolest Video Action Recognition for SkateboardingCode0
TS-RGBD Dataset: a Novel Dataset for Theatre Scenes Description for People with Visual ImpairmentsCode0
MAiVAR-T: Multimodal Audio-image and Video Action Recognizer using Transformers—0
DDG-Net: Discriminability-Driven Graph Network for Weakly-supervised Temporal Action LocalizationCode1
Sample Less, Learn More: Efficient Action Recognition via Frame Feature RestorationCode0
Spatiotemporal Modeling Encounters 3D Medical Image Analysis: Slice-Shift UNet with Multi-View Fusion—0
Two-stream Multi-level Dynamic Point Transformer for Two-person Interaction Recognition—0
Human Action Recognition in Still Images Using ConViT—0
Fusing Hand and Body Skeletons for Human Action Recognition in Assembly—0
Similarity Min-Max: Zero-Shot Day-Night Domain Adaptation—0
Cross-Model Cross-Stream Learning for Self-Supervised Human Action RecognitionCode0
Video-FocalNets: Spatio-Temporal Focal Modulation for Video Action RecognitionCode1
Free-Form Composition Networks for Egocentric Action Recognition—0
NMS Threshold matters for Ego4D Moment Queries -- 2nd place solution to the Ego4D Moment Queries Challenge 2023Code2
SpATr: MoCap 3D Human Action Recognition based on Spiral Auto-encoder and Transformer NetworkCode0
Theater Aid System for the Visually Impaired Through Transfer Learning of Spatio-Temporal Graph Convolution Networks—0
Actionness Inconsistency-guided Contrastive Learning for Weakly-supervised Temporal Action LocalizationCode1
Bullying10K: A Large-Scale Neuromorphic Dataset towards Privacy-Preserving Bullying Recognition—0
Seeing the Pose in the Pixels: Learning Pose-Aware Representations in Vision TransformersCode1
A Survey on Video Moment Localization—0
How Object Information Improves Skeleton-based Human Action Recognition in Assembly Tasks—0
Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Pose—0
Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie StimuliCode0
fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs—0
High-Performance Inference Graph Convolutional Networks for Skeleton-Based Action RecognitionCode0
FMM-X3D: FPGA-based modeling and mapping of X3D for Human Action Recognition—0
Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action LocalizationCode1
Deep Neural Networks in Video Human Action Recognition: A Review—0
Action Sensitivity Learning for Temporal Action Localization—0
High Speed Human Action Recognition using a Photonic Reservoir Computer—0
Perception Test: A Diagnostic Benchmark for Multimodal Video ModelsCode2
Spatiotemporal Attention-based Semantic Compression for Real-time Video Recognition—0
SCP: Soft Conditional Prompt Learning for Aerial Video Action Recognition—0
Riemannian Multinomial Logistics Regression for SPD Neural NetworksCode1
Motion-Scenario Decoupling for Rat-Aware Video Position Prediction: Strategy and Benchmark—0
Few-shot Action Recognition via Intra- and Inter-Video Information Maximization—0
Learning Video-Conditioned Policies for Unseen Manipulation Tasks—0
Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach—0
Video-Specific Query-Key Attention Modeling for Weakly-Supervised Temporal Action Localization—0
Boosting Weakly-Supervised Temporal Action Localization with Text InformationCode1
Weakly-Supervised Temporal Action Localization with Bidirectional Semantic Consistency ConstraintCode0
RHM: Robot House Multi-view Human Activity Recognition DatasetCode0
Show:102550
← PrevPage 5 of 30Next →
All datasetsTHUMOS14ActivityNet-1.3HACSFineActionMultiTHUMOSCrossTaskEPIC-KITCHENS-100MUSESActivityNet-1.2Ego4D MQ testEgo4D MQ valMEXaction2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaTAD (VideoMAEv2-giant)Avg mAP (0.3:0.7)76.9—Unverified
2RDFA-S6 (InternVideo2-6B)Avg mAP (0.3:0.7)74.2—Unverified
3ActionMamba(InternVideo2-6B)Avg mAP (0.3:0.7)72.72—Unverified
4GCMmAP IOU@0.172.5—Unverified
5AGT (Ours)mAP IOU@0.172.1—Unverified
6InternVideo2-6BAvg mAP (0.3:0.7)72—Unverified
7ActionFormer (InternVideo features)Avg mAP (0.3:0.7)71.58—Unverified
8TriDet (VideoMAE v2-g feature)Avg mAP (0.3:0.7)70.1—Unverified
9InternVideo2-1BAvg mAP (0.3:0.7)69.8—Unverified
10ActionFormer (VideoMAE V2-g features)Avg mAP (0.3:0.7)69.6—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LmAP IOU@0.559.3—Unverified
2RDFA-S6 (InternVideo2-6B)mAP42.9—Unverified
3ActionMamba (InternVideo2-6B)mAP42.02—Unverified
4PRN+BMN (ensemble)mAP42—Unverified
5AdaTAD (VideoMAEv2-giant)mAP41.93—Unverified
6InternVideo2-6BmAP41.2—Unverified
7InternVideo2-1BmAP40.4—Unverified
8UniMD+Sync.mAP39.83—Unverified
9PRN (CSN)mAP39.4—Unverified
10InternVideomAP39—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)Average-mAP45.8—Unverified
2ActionMamba(InternVideo2-6B)Average-mAP44.56—Unverified
3DyFADet(VideoMAEv2)Average-mAP44.3—Unverified
4InternVideo2-6BAverage-mAP43.3—Unverified
5TriDet (VideoMAEv2)Average-mAP43.1—Unverified
6InternVideo2-1BAverage-mAP42.4—Unverified
7InternVideoAverage-mAP41.55—Unverified
8TriDet (SlowFast)Average-mAP38.6—Unverified
9TriDet (I3D RGB)Average-mAP36.8—Unverified
10TadTr (I3D RGB)Average-mAP32.09—Unverified
#ModelMetricClaimedVerifiedStatus
1RDFA-S6 (InternVideo2-6B)mAP29.6—Unverified
2ActionMamba(InternVideo2-6B)mAP29.04—Unverified
3InternVideo2-6BmAP27.7—Unverified
4DyFADet (VideoMAE v2-g)mAP23.8—Unverified
5VideoMAE V2-gmAP18.24—Unverified
6InternVideomAP17.57—Unverified
7BMN (i3d feaure)mAP9.25—Unverified
8G-TAD (i3d feature)mAP9.06—Unverified
9DBG (i3d feature)mAP6.75—Unverified
#ModelMetricClaimedVerifiedStatus
1TriDet (VideoMAEv2)Average mAP37.5—Unverified
2DualDETR (I3D-rgb)Average mAP32.64—Unverified
3TriDet (I3D-rgb)Average mAP30.7—Unverified
4TemporalMaxerAverage mAP29.9—Unverified
5PointTADAverage mAP23.5—Unverified
6PDANAverage mAP17.3—Unverified
7MS-TCTAverage mAP16.2—Unverified
8MLADAverage mAP14.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCLIPRecall47.3—Unverified
2VLMRecall46.5—Unverified
3TACoRecall42.5—Unverified
4Text-Video EmbeddingRecall33.6—Unverified
5Fully-supervised upper-boundRecall31.6—Unverified
6ZhukovRecall22.4—Unverified
7AlayracRecall13.3—Unverified
#ModelMetricClaimedVerifiedStatus
1AdaTAD (verb, VideoMAE-L)Avg mAP (0.1-0.5)29.3—Unverified
2TriDet (verb)Avg mAP (0.1-0.5)25.4—Unverified
3TemporalMaxer (verb)Avg mAP (0.1-0.5)24.5—Unverified
4ActionFormer (verb)Avg mAP (0.1-0.5)23.5—Unverified
5G-TAD (verb)Avg mAP (0.1-0.5)9.4—Unverified
6BMN (verb)Avg mAP (0.1-0.5)8.4—Unverified
#ModelMetricClaimedVerifiedStatus
1TemporalMaxermAP27.2—Unverified
2MUSESmAP18.6—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepMetricLearnermAP IOU@0.535.2—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.76—Unverified
#ModelMetricClaimedVerifiedStatus
1ActionFormer (SlowFast+Omnivore+EgoVLP)Average mAP21.4—Unverified
#ModelMetricClaimedVerifiedStatus
1S-CNNmAP7.4—Unverified