SOTAVerified

Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 817 papers

TitleStatusHype
Intelligent Video Recording Optimization using Activity Detection for Surveillance Systems—0
On Occlusions in Video Action Detection: Benchmark Datasets And Training RecipesCode0
ContextDet: Temporal Action Detection with Adaptive Context Aggregation—0
CLIP-VAD: Exploiting Vision-Language Models for Voice Activity Detection—0
A Framework for Adapting Human-Robot Interaction to Diverse User GroupsCode0
Investigation of Speaker Representation for Target-Speaker Speech Processing—0
Cefdet: Cognitive Effectiveness Network Based on Fuzzy Inference for Action DetectionCode0
EgoOops: A Dataset for Mistake Action Detection from Egocentric Videos with Procedural Texts—0
Query matching for spatio-temporal action detection with query-based object detector—0
Temporal2Seq: A Unified Framework for Temporal Video Understanding Tasks—0
Raising the Bar(ometer): Identifying a User's Stair and Lift Usage Through Wearable Sensor Data Analysis—0
M-BEST-RQ: A Multi-Channel Speech Foundation Model for Smart Glasses—0
Uncertainty-Guided Appearance-Motion Association Network for Out-of-Distribution Action DetectionCode0
TCG CREST System Description for the Second DISPLACE Challenge—0
A Comprehensive Methodological Survey of Human Activity Recognition Across Divers Data Modalities—0
Evaluation of real-time transcriptions using end-to-end ASR models—0
NTT Multi-Speaker ASR System for the DASR Task of CHiME-8 Challenge—0
Introducing Gating and Context into Temporal Action Detection—0
Unfolding Videos Dynamics via Taylor Expansion—0
Prediction-Feedback DETR for Temporal Action Detection—0
Spatio-Temporal Context Prompting for Zero-Shot Action Detection—0
Temporal Divide-and-Conquer Anomaly Actions Localization in Semi-Supervised Videos with Hierarchical Transformer—0
Long-term Pre-training for Temporal Action Detection with Transformers—0
Boundary-Recovering Network for Temporal Action Detection—0
JARViS: Detecting Actions in Video Using Unified Actor-Scene Context Relation Modeling—0
Blind User Activity Detection for Grant-Free Random Access in Cell-Free mMIMO Networks—0
Long-Term Conversation Analysis: Privacy-Utility Trade-off under Noise and Reverberation—0
Classification Matters: Improving Video Action Detection with Class-Specific Attention—0
MARINE: A Computer Vision Model for Detecting Rare Predator-Prey Interactions in Animal VideosCode0
Preemptive Detection and Correction of Misaligned Actions in LLM Agents—0
TokenVerse: Towards Unifying Speech and NLP Tasks via Transducer-based ASRCode0
Micro-gesture Online Recognition using Learnable Query Points—0
Automatic Speech Recognition for Hindi—0
Using joint angles based on the international biomechanical standards for human action recognition and related tasks—0
Benchmarking Deep Learning Models on NVIDIA Jetson Nano for Real-Time Systems: An Empirical InvestigationCode0
Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024—0
AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming—0
Comparative Analysis of Personalized Voice Activity Detection Systems: Assessing Real-World Effectiveness—0
Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillance—0
Deep Learning-Based Approach for User Activity Detection with Grant-Free Random Access in Cell-Free Massive MIMO—0
An Effective-Efficient Approach for Dense Multi-Label Action Detection—0
Object Aware Egocentric Online Action Detection—0
Precise Analysis of Covariance Identifiability for Activity Detection in Grant-Free Random Access—0
Skeleton-OOD: An End-to-End Skeleton-Based Model for Robust Out-of-Distribution Human Action DetectionCode0
MALT: Multi-scale Action Learning Transformer for Online Action Detection—0
A Real-Time Voice Activity Detection Based On Lightweight Neural—0
Open-Vocabulary Spatio-Temporal Action Detection—0
Speaker Embeddings With Weakly Supervised Voice Activity Detection For Efficient Speaker Diarization—0
A Semantic and Motion-Aware Spatiotemporal Transformer Network for Action Detection—0
Whispy: Adapting STT Whisper Models to Real-Time Environments—0
Show:102550
← PrevPage 5 of 17Next →
All datasetsUCF101-24J-HMDBCharadesMulti-THUMOSUCF SportsTHUMOS' 14MultiSportsTSUTTStroke-21 ME21TTStroke-21 ME22MultiTHUMOS

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1STAR/LFrame-mAP 0.590.3—Unverified
2SiAFrame-mAP 0.588.5—Unverified
3YOWO + LFBFrame-mAP 0.587.3—Unverified
4HITFrame-mAP 0.584.8—Unverified
5HISAN (ResNet-101 + FPN)Video-mAP 0.282.3—Unverified
6YOWOFrame-mAP 0.580.4—Unverified
7Two-in-one Two StreamVideo-mAP 0.278.48—Unverified
8MOCFrame-mAP 0.577.8—Unverified
9Faster-RCNN + two-stream I3D convFrame-mAP 0.576.3—Unverified
10Two-in-oneVideo-mAP 0.275.48—Unverified
#ModelMetricClaimedVerifiedStatus
1SiAFrame-mAP 0.588.5—Unverified
2HISAN (ResNet-101 + FPN)Video-mAP 0.287.59—Unverified
3HITFrame-mAP 0.583.8—Unverified
4HISAN (VGG-16)Frame-mAP 0.576.72—Unverified
5DTSVideo-mAP 0.276.1—Unverified
6YOWO + LFBFrame-mAP 0.575.7—Unverified
7Two-in-one Two StreamVideo-mAP 0.574.74—Unverified
8YOWOFrame-mAP 0.574.4—Unverified
9MOCFrame-mAP 0.574—Unverified
10Faster-RCNN + two-stream I3D convFrame-mAP 0.573.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TTMmAP28.79—Unverified
2CTRNmAP27.8—Unverified
3Coarse-Fine Networks (w/ self-supervised detection pretraining)mAP26.95—Unverified
4UniMD+Sync. (RGB+Flow)mAP26.53—Unverified
5PDAN (RGB+Flow)mAP26.5—Unverified
6PATmAP26.5—Unverified
7MS-TCT (RGB only)mAP25.4—Unverified
83D ResNet-50 + super-events pretrained on AViDmAP25.2—Unverified
9Coarse-Fine NetworksmAP25.1—Unverified
10MLAD (RGB + Flow)mAP23.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MLADmAP51.5—Unverified
2CTRNmAP51.2—Unverified
3PDANmAP47.6—Unverified
4TGMmAP46.4—Unverified
5MS-TCT (RGB only)mAP43.1—Unverified
6I3D + our super-eventmAP36.4—Unverified
7Two-stream + LSTMmAP28.1—Unverified
8Two-streammAP27.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Two-in-one Two StreamVideo-mAP 0.596.52—Unverified
2DTSVideo-mAP 0.294.3—Unverified
3Two-in-oneVideo-mAP 0.592.74—Unverified
4T-CNNFrame-mAP 0.586.7—Unverified
5MR-TS R-CNNFrame-mAP 0.584.52—Unverified
6TS R-CNNFrame-mAP 0.582.3—Unverified
7Action TubesFrame-mAP 0.568.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MAT (Ours) TransmAP71.6—Unverified
2TadML-two streammAP59.7—Unverified
3MAT (ours)mAP58.2—Unverified
4TadML-rgbmAP53.46—Unverified
#ModelMetricClaimedVerifiedStatus
1HITFrame-mAP 0.533.3—Unverified
2SiAFrame-mAP 0.528.8—Unverified
#ModelMetricClaimedVerifiedStatus
1MS-TCTFrame-mAP33.7—Unverified
2PDANFrame-mAP32.7—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNNIoU0.14—Unverified
2Two Stream NetworkIoU0.07—Unverified
#ModelMetricClaimedVerifiedStatus
1STCNN-V2 (Vote decision)IoU0.52—Unverified
2RGB and PRGBIoU0.35—Unverified
#ModelMetricClaimedVerifiedStatus
1PATmAP44.6—Unverified