SOTAVerified

Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 817 papers

TitleStatusHype
End-to-end Temporal Action Detection with TransformerCode1
ETAD: Training Action Detection End to End on a LaptopCode1
MS-Temba : Multi-Scale Temporal Mamba for Efficient Temporal Action DetectionCode1
AEI: Actors-Environment Interaction with Adaptive Attention for Temporal Action Proposals GenerationCode1
Interaction-Aware Prompting for Zero-Shot Spatio-Temporal Action DetectionCode1
Exploiting Temporal Side Information in Massive IoT ConnectivityCode1
Actions as Moving PointsCode1
Exploiting Instance-based Mixed Sampling via Auxiliary Source Domain Supervision for Domain-adaptive Action DetectionCode1
FineAction: A Fine-Grained Video Dataset for Temporal Action LocalizationCode1
Exploiting VLM Localizability and Semantics for Open Vocabulary Action DetectionCode1
A Hybrid CNN-BiLSTM Voice Activity DetectorCode1
Multi-Granularity Hand Action DetectionCode1
InaGVAD : a Challenging French TV and Radio Corpus Annotated for Speech Activity Detection and Speaker Gender SegmentationCode1
ivrit.ai: A Comprehensive Dataset of Hebrew Speech for AI Research and DevelopmentCode1
Hierarchically Self-Supervised Transformer for Human Skeleton Representation LearningCode1
Harvesting Ambient RF for Presence Detection Through Deep LearningCode1
Holistic Interaction Transformer Network for Action DetectionCode1
From Recognition to Prediction: Analysis of Human Action and Trajectory Prediction in VideoCode1
Generic Event Boundary Detection: A Benchmark for Event SegmentationCode1
Generative Model-based Feature Knowledge Distillation for Action RecognitionCode1
AV Taris: Online Audio-Visual Speech RecognitionCode1
AViD Dataset: Anonymized Videos from Diverse CountriesCode1
BasicTAD: an Astounding RGB-Only Baseline for Temporal Action DetectionCode1
HGCN: Harmonic gated compensation network for speech enhancementCode1
BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control CommunicationsCode1
Benchmarking the Robustness of Temporal Action Detection Models Against Temporal CorruptionsCode1
BMN: Boundary-Matching Network for Temporal Action Proposal GenerationCode1
An Empirical Study of End-to-End Temporal Action DetectionCode1
Glance and Focus: Memory Prompting for Multi-Event Video Question AnsweringCode1
An End-to-End Architecture for Keyword Spotting and Voice Activity DetectionCode1
Classification of Abnormal Hand Movement for Aiding in Autism Detection: Machine Learning StudyCode1
CBR-Net: Cascade Boundary Refinement Network for Action Detection: Submission to ActivityNet Challenge 2020 (Task 1)Code1
CholecTriplet2021: A benchmark challenge for surgical action triplet recognitionCode1
ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee BehaviorsCode1
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using TransformersCode1
A Multi-Person Video Dataset Annotation Method of Spatio-Temporally ActionsCode1
Coupling Intent and Action for Pedestrian Crossing Behavior PredictionCode1
Context-Enhanced Memory-Refined Transformer for Online Action DetectionCode1
Actor-Context-Actor Relation Network for Spatio-Temporal Action LocalizationCode1
Continual Transformers: Redundancy-Free Attention for Online InferenceCode1
AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual ActionsCode1
MMAD: Multi-label Micro-Action Detection in VideosCode1
AOE-Net: Entities Interactions Modeling with Adaptive Attention Mechanism for Temporal Action Proposals GenerationCode1
DCAN: Improving Temporal Action Detection via Dual Context AggregationCode1
HAKE: Human Activity Knowledge EngineCode1
DyFADet: Dynamic Feature Aggregation for Temporal Action DetectionCode1
A Multigrid Method for Efficiently Training Video ModelsCode1
E^2TAD: An Energy-Efficient Tracking-based Action DetectorCode1
End-to-End Semi-Supervised Learning for Video Action DetectionCode1
ActionSwitch: Class-agnostic Detection of Simultaneous Actions in Streaming VideosCode1
Show:102550
← PrevPage 2 of 17Next →
All datasetsUCF101-24J-HMDBCharadesMulti-THUMOSUCF SportsTHUMOS' 14MultiSportsTSUTTStroke-21 ME21TTStroke-21 ME22MultiTHUMOS

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1STAR/LFrame-mAP 0.590.3—Unverified
2SiAFrame-mAP 0.588.5—Unverified
3YOWO + LFBFrame-mAP 0.587.3—Unverified
4HITFrame-mAP 0.584.8—Unverified
5HISAN (ResNet-101 + FPN)Video-mAP 0.282.3—Unverified
6YOWOFrame-mAP 0.580.4—Unverified
7Two-in-one Two StreamVideo-mAP 0.278.48—Unverified
8MOCFrame-mAP 0.577.8—Unverified
9Faster-RCNN + two-stream I3D convFrame-mAP 0.576.3—Unverified
10Two-in-oneVideo-mAP 0.275.48—Unverified
#ModelMetricClaimedVerifiedStatus
1SiAFrame-mAP 0.588.5—Unverified
2HISAN (ResNet-101 + FPN)Video-mAP 0.287.59—Unverified
3HITFrame-mAP 0.583.8—Unverified
4HISAN (VGG-16)Frame-mAP 0.576.72—Unverified
5DTSVideo-mAP 0.276.1—Unverified
6YOWO + LFBFrame-mAP 0.575.7—Unverified
7Two-in-one Two StreamVideo-mAP 0.574.74—Unverified
8YOWOFrame-mAP 0.574.4—Unverified
9MOCFrame-mAP 0.574—Unverified
10Faster-RCNN + two-stream I3D convFrame-mAP 0.573.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TTMmAP28.79—Unverified
2CTRNmAP27.8—Unverified
3Coarse-Fine Networks (w/ self-supervised detection pretraining)mAP26.95—Unverified
4UniMD+Sync. (RGB+Flow)mAP26.53—Unverified
5PDAN (RGB+Flow)mAP26.5—Unverified
6PATmAP26.5—Unverified
7MS-TCT (RGB only)mAP25.4—Unverified
83D ResNet-50 + super-events pretrained on AViDmAP25.2—Unverified
9Coarse-Fine NetworksmAP25.1—Unverified
10MLAD (RGB + Flow)mAP23.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MLADmAP51.5—Unverified
2CTRNmAP51.2—Unverified
3PDANmAP47.6—Unverified
4TGMmAP46.4—Unverified
5MS-TCT (RGB only)mAP43.1—Unverified
6I3D + our super-eventmAP36.4—Unverified
7Two-stream + LSTMmAP28.1—Unverified
8Two-streammAP27.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Two-in-one Two StreamVideo-mAP 0.596.52—Unverified
2DTSVideo-mAP 0.294.3—Unverified
3Two-in-oneVideo-mAP 0.592.74—Unverified
4T-CNNFrame-mAP 0.586.7—Unverified
5MR-TS R-CNNFrame-mAP 0.584.52—Unverified
6TS R-CNNFrame-mAP 0.582.3—Unverified
7Action TubesFrame-mAP 0.568.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MAT (Ours) TransmAP71.6—Unverified
2TadML-two streammAP59.7—Unverified
3MAT (ours)mAP58.2—Unverified
4TadML-rgbmAP53.46—Unverified
#ModelMetricClaimedVerifiedStatus
1HITFrame-mAP 0.533.3—Unverified
2SiAFrame-mAP 0.528.8—Unverified
#ModelMetricClaimedVerifiedStatus
1MS-TCTFrame-mAP33.7—Unverified
2PDANFrame-mAP32.7—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNNIoU0.14—Unverified
2Two Stream NetworkIoU0.07—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNN-V2 (Vote decision)IoU0.52—Unverified
2RGB and PRGBIoU0.35—Unverified
#ModelMetricClaimedVerifiedStatus
1PATmAP44.6—Unverified