SOTAVerified

Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 817 papers

TitleStatusHype
An enhanced system for the detection and active cancellation of snoring signals—0
ivrit.ai: A Comprehensive Dataset of Hebrew Speech for AI Research and DevelopmentCode1
Human-to-Human Interaction Detection—0
Act3D: 3D Feature Field Transformers for Multi-Task Robotic ManipulationCode2
Long-term Conversation Analysis: Exploring Utility and PrivacyCode0
Multi-Granularity Hand Action DetectionCode1
E2E-LOAD: End-to-End Long-form Online Action DetectionCode1
ShuttleSet: A Human-Annotated Stroke-Level Singles Dataset for Badminton Tactical AnalysisCode0
Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features—0
Parallel Neurosymbolic Integration with Concordia—0
SVVAD: Personal Voice Activity Detection for Speaker Verification—0
A Multi-Modal Transformer Network for Action Detection—0
Building Accurate Low Latency ASR for Streaming Voice Search—0
Joint Activity-Delay Detection and Channel Estimation for Asynchronous Massive Random Access—0
Semantic VAD: Low-Latency Voice Activity Detection for Speech Interaction—0
FunASR: A Fundamental End-to-End Speech Recognition Toolkit—0
Deep Learning for Asynchronous Massive Access with Data Frame Length Diversity—0
Joint Activity Detection and Channel Estimation for Clustered Massive Machine Type Communications—0
MRSN: Multi-Relation Support Network for Video Action Detection—0
End-to-End Spatio-Temporal Action Localisation with Video Transformers—0
Cooperative Multi-Cell Massive Access with Temporally Correlated Activity—0
Array Configuration-Agnostic Personal Voice Activity Detection Based on Spatial Coherence—0
Efficient Video Action Detection with Token Dropout and Context RefinementCode3
ATTACH Dataset: Annotated Two-Handed Assembly Actions for Human Action Understanding—0
Grant-free Massive Random Access with Retransmission: Receiver Optimization and Performance Analysis—0
WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity RecognitionCode1
Interaction-Aware Prompting for Zero-Shot Spatio-Temporal Action DetectionCode1
Boundary-Denoising for Video Activity LocalizationCode0
Improve Temporal Action Proposals using Hierarchical Context—0
DOAD: Decoupled One Stage Action Detection Network—0
Evaluation of Noise Reduction Methods for Sentence Recognition by Sinhala Speaking ListenersCode0
Decomposed Cross-modal Distillation for RGB-based Temporal Action Detection—0
CycleACR: Cycle Modeling of Actor-Context Relations for Video Action DetectionCode0
DiffTAD: Temporal Action Detection with Proposal Denoising DiffusionCode1
Better Together: Dialogue Separation and Voice Activity Detection for Audio Personalization in TV—0
End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversations—0
A processing framework to access large quantities of whispered speech found in ASMR—0
TriDet: Temporal Action Detection with Relative Boundary ModelingCode2
Multi-Task Sub-Band Network For Deep Residual Echo Suppression—0
TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker EmbeddingsCode1
Improving Transformer-based End-to-End Speaker Diarization by Assigning Auxiliary Losses to Attention Heads—0
Open Set Action Recognition via Multi-Label Evidential Learning—0
Learnable Frontends that do not Learn: Quantifying Sensitivity to Filterbank Initialisation—0
MINOTAUR: Multi-task Video Grounding From Multimodal QueriesCode0
YOWOv2: A Stronger yet Efficient Multi-level Detection Framework for Real-time Spatio-temporal Action DetectionCode2
Context Understanding in Computer Vision: A Survey—0
Understanding Policy and Technical Aspects of AI-Enabled Smart Video Surveillance to Address Public Safety—0
Fine-Grained Action Detection with RGB and Pose Information using Two Stream Convolutional NetworksCode0
Baseline Method for the Sport Task of MediaEval 2022 with 3D CNNs using Attention MechanismsCode0
Sport Task: Fine Grained Action Detection and Classification of Table Tennis Strokes from Videos for MediaEval 2022Code0
Show:102550
← PrevPage 5 of 17Next →
All datasetsUCF101-24J-HMDBCharadesMulti-THUMOSUCF SportsTHUMOS' 14MultiSportsTSUTTStroke-21 ME21TTStroke-21 ME22MultiTHUMOS

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1STAR/LFrame-mAP 0.590.3—Unverified
2SiAFrame-mAP 0.588.5—Unverified
3YOWO + LFBFrame-mAP 0.587.3—Unverified
4HITFrame-mAP 0.584.8—Unverified
5HISAN (ResNet-101 + FPN)Video-mAP 0.282.3—Unverified
6YOWOFrame-mAP 0.580.4—Unverified
7Two-in-one Two StreamVideo-mAP 0.278.48—Unverified
8MOCFrame-mAP 0.577.8—Unverified
9Faster-RCNN + two-stream I3D convFrame-mAP 0.576.3—Unverified
10Two-in-oneVideo-mAP 0.275.48—Unverified
#ModelMetricClaimedVerifiedStatus
1SiAFrame-mAP 0.588.5—Unverified
2HISAN (ResNet-101 + FPN)Video-mAP 0.287.59—Unverified
3HITFrame-mAP 0.583.8—Unverified
4HISAN (VGG-16)Frame-mAP 0.576.72—Unverified
5DTSVideo-mAP 0.276.1—Unverified
6YOWO + LFBFrame-mAP 0.575.7—Unverified
7Two-in-one Two StreamVideo-mAP 0.574.74—Unverified
8YOWOFrame-mAP 0.574.4—Unverified
9MOCFrame-mAP 0.574—Unverified
10Faster-RCNN + two-stream I3D convFrame-mAP 0.573.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TTMmAP28.79—Unverified
2CTRNmAP27.8—Unverified
3Coarse-Fine Networks (w/ self-supervised detection pretraining)mAP26.95—Unverified
4UniMD+Sync. (RGB+Flow)mAP26.53—Unverified
5PDAN (RGB+Flow)mAP26.5—Unverified
6PATmAP26.5—Unverified
7MS-TCT (RGB only)mAP25.4—Unverified
83D ResNet-50 + super-events pretrained on AViDmAP25.2—Unverified
9Coarse-Fine NetworksmAP25.1—Unverified
10I3D + biGRU + VS-ST-MPNNmAP23.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MLADmAP51.5—Unverified
2CTRNmAP51.2—Unverified
3PDANmAP47.6—Unverified
4TGMmAP46.4—Unverified
5MS-TCT (RGB only)mAP43.1—Unverified
6I3D + our super-eventmAP36.4—Unverified
7Two-stream + LSTMmAP28.1—Unverified
8Two-streammAP27.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Two-in-one Two StreamVideo-mAP 0.596.52—Unverified
2DTSVideo-mAP 0.294.3—Unverified
3Two-in-oneVideo-mAP 0.592.74—Unverified
4T-CNNFrame-mAP 0.586.7—Unverified
5MR-TS R-CNNFrame-mAP 0.584.52—Unverified
6TS R-CNNFrame-mAP 0.582.3—Unverified
7Action TubesFrame-mAP 0.568.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MAT (Ours) TransmAP71.6—Unverified
2TadML-two streammAP59.7—Unverified
3MAT (ours)mAP58.2—Unverified
4TadML-rgbmAP53.46—Unverified
#ModelMetricClaimedVerifiedStatus
1HITFrame-mAP 0.533.3—Unverified
2SiAFrame-mAP 0.528.8—Unverified
#ModelMetricClaimedVerifiedStatus
1MS-TCTFrame-mAP33.7—Unverified
2PDANFrame-mAP32.7—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNNIoU0.14—Unverified
2Two Stream NetworkIoU0.07—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNN-V2 (Vote decision)IoU0.52—Unverified
2RGB and PRGBIoU0.35—Unverified
#ModelMetricClaimedVerifiedStatus
1PATmAP44.6—Unverified