SOTAVerified

Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 817 papers

TitleStatusHype
Multi-Input Multi-Output Target-Speaker Voice Activity Detection For Unified, Flexible, and Robust Audio-Visual Speaker Diarization—0
Single-Microphone Speaker Separation and Voice Activity Detection in Noisy and Reverberant Environments—0
Glance and Focus: Memory Prompting for Multi-Event Video Question AnsweringCode1
Low-power Continuous Remote Behavioral Localization with Event Cameras—0
Self-supervised Pretraining for Robust Personalized Voice Activity Detection in Adverse Conditions—0
SADA: Semantic adversarial unsupervised domain adaptation for Temporal Action LocalizationCode0
Generative Model-based Feature Knowledge Distillation for Action RecognitionCode1
Advanced Image Segmentation Techniques for Neural Activity Detection via C-fos Immediate Early Gene Expression—0
Semi-supervised Active Learning for Video Action DetectionCode0
Spatiotemporal Event Graphs for Dynamic Scene Understanding—0
Low-power, Continuous Remote Behavioral Localization with Event Cameras—0
Towards More Practical Group Activity Detection: A New Benchmark and Model—0
Adapting Short-Term Transformers for Action Detection in Untrimmed VideosCode1
SPIRE-SIES: A Spontaneous Indian English Speech Corpus—0
End-to-End Temporal Action Detection with 1B Parameters Across 1000 FramesCode2
Centre Stage: Centricity-based Audio-Visual Temporal Action DetectionCode0
ADM-Loc: Actionness Distribution Modeling for Point-supervised Temporal Action Localization—0
Introducing SSBD+ Dataset with a Convolutional Pipeline for detecting Self-Stimulatory Behaviours in Children using raw videos—0
Combatting Human Trafficking in the Cyberspace: A Natural Language Processing-Based Methodology to Analyze the Language in Online Advertisements—0
ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection—0
A Hybrid Graph Network for Complex Activity Detection in Video—0
ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee BehaviorsCode1
Prompt-driven Target Speech Diarization—0
Device Detection and Channel Estimation in MTC with Correlated Activity Pattern—0
POTLoc: Pseudo-Label Oriented Transformer for Point-Supervised Temporal Action Localization—0
Enhancing Illicit Activity Detection using XAI: A Multimodal Graph-LLM Framework—0
Property-Aware Multi-Speaker Data Simulation: A Probabilistic Modelling Technique for Synthetic Data Generation—0
Hierarchical MTC User Activity Detection and Channel Estimation with Unknown Spatial Covariance—0
End-to-end Online Speaker Diarization with Target Speaker Tracking—0
VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention—0
Boundary Discretization and Reliable Classification Network for Temporal Action DetectionCode0
ACT-Net: Anchor-context Action Detection in Surgery Videos—0
A Grammatical Compositional Model for Video Action Detection—0
PP-MeT: a Real-world Personalized Prompt based Meeting Transcription System—0
M^33D: Learning 3D priors using Multi-Modal Masked Autoencoders for 2D image and video understanding—0
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial ScenariosCode0
The Impact of Silence on Speech Anti-Spoofing—0
SkeleTR: Towrads Skeleton-based Action Recognition in the Wild—0
JOADAA: joint online action detection and action anticipation—0
Effective Abnormal Activity Detection on Multivariate Time Series Healthcare Data—0
Temporal Action Localization with Enhanced Instant DiscriminabilityCode2
In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms—0
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using TransformersCode1
Self-Feedback DETR for Temporal Action Detection—0
Progression-Guided Temporal Action Detection in VideosCode0
The DKU-MSXF Diarization System for the VoxCeleb Speaker Recognition Challenge 2023—0
Memory-and-Anticipation Transformer for Online Action UnderstandingCode1
Integrating Emotion Recognition with Speech Recognition and Speaker Diarisation for ConversationsCode0
PAT: Position-Aware Transformer for Dense Multi-Label Action Detection—0
A Survey on Deep Learning-based Spatio-temporal Action Detection—0
Show:102550
← PrevPage 4 of 17Next →
All datasetsUCF101-24J-HMDBCharadesMulti-THUMOSUCF SportsTHUMOS' 14MultiSportsTSUTTStroke-21 ME21TTStroke-21 ME22MultiTHUMOS

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1STAR/LFrame-mAP 0.590.3—Unverified
2SiAFrame-mAP 0.588.5—Unverified
3YOWO + LFBFrame-mAP 0.587.3—Unverified
4HITFrame-mAP 0.584.8—Unverified
5HISAN (ResNet-101 + FPN)Video-mAP 0.282.3—Unverified
6YOWOFrame-mAP 0.580.4—Unverified
7Two-in-one Two StreamVideo-mAP 0.278.48—Unverified
8MOCFrame-mAP 0.577.8—Unverified
9Faster-RCNN + two-stream I3D convFrame-mAP 0.576.3—Unverified
10Two-in-oneVideo-mAP 0.275.48—Unverified
#ModelMetricClaimedVerifiedStatus
1SiAFrame-mAP 0.588.5—Unverified
2HISAN (ResNet-101 + FPN)Video-mAP 0.287.59—Unverified
3HITFrame-mAP 0.583.8—Unverified
4HISAN (VGG-16)Frame-mAP 0.576.72—Unverified
5DTSVideo-mAP 0.276.1—Unverified
6YOWO + LFBFrame-mAP 0.575.7—Unverified
7Two-in-one Two StreamVideo-mAP 0.574.74—Unverified
8YOWOFrame-mAP 0.574.4—Unverified
9MOCFrame-mAP 0.574—Unverified
10Faster-RCNN + two-stream I3D convFrame-mAP 0.573.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TTMmAP28.79—Unverified
2CTRNmAP27.8—Unverified
3Coarse-Fine Networks (w/ self-supervised detection pretraining)mAP26.95—Unverified
4UniMD+Sync. (RGB+Flow)mAP26.53—Unverified
5PDAN (RGB+Flow)mAP26.5—Unverified
6PATmAP26.5—Unverified
7MS-TCT (RGB only)mAP25.4—Unverified
83D ResNet-50 + super-events pretrained on AViDmAP25.2—Unverified
9Coarse-Fine NetworksmAP25.1—Unverified
10MLAD (RGB + Flow)mAP23.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MLADmAP51.5—Unverified
2CTRNmAP51.2—Unverified
3PDANmAP47.6—Unverified
4TGMmAP46.4—Unverified
5MS-TCT (RGB only)mAP43.1—Unverified
6I3D + our super-eventmAP36.4—Unverified
7Two-stream + LSTMmAP28.1—Unverified
8Two-streammAP27.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Two-in-one Two StreamVideo-mAP 0.596.52—Unverified
2DTSVideo-mAP 0.294.3—Unverified
3Two-in-oneVideo-mAP 0.592.74—Unverified
4T-CNNFrame-mAP 0.586.7—Unverified
5MR-TS R-CNNFrame-mAP 0.584.52—Unverified
6TS R-CNNFrame-mAP 0.582.3—Unverified
7Action TubesFrame-mAP 0.568.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MAT (Ours) TransmAP71.6—Unverified
2TadML-two streammAP59.7—Unverified
3MAT (ours)mAP58.2—Unverified
4TadML-rgbmAP53.46—Unverified
#ModelMetricClaimedVerifiedStatus
1HITFrame-mAP 0.533.3—Unverified
2SiAFrame-mAP 0.528.8—Unverified
#ModelMetricClaimedVerifiedStatus
1MS-TCTFrame-mAP33.7—Unverified
2PDANFrame-mAP32.7—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNNIoU0.14—Unverified
2Two Stream NetworkIoU0.07—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNN-V2 (Vote decision)IoU0.52—Unverified
2RGB and PRGBIoU0.35—Unverified
#ModelMetricClaimedVerifiedStatus
1PATmAP44.6—Unverified