SOTAVerified

Action Detection

Action Detection aims to find both where and when an action occurs within a video clip and classify what the action is taking place. Typically results are given in the form of action tublets, which are action bounding boxes linked across time in the video. This is related to temporal localization, which seeks to identify the start and end frame of an action, and action recognition, which seeks only to classify which action is taking place and typically assumes a trimmed video.

Papers

Showing 201250 of 817 papers

TitleStatusHype
Argus: Efficient Activity Detection System for Extended Video AnalysisCode0
Online Spatiotemporal Action Detection and Prediction via Causal RepresentationsCode0
Pyramid Region-based Slot Attention Network for Temporal Action Proposal GenerationCode0
RALACs: Action Recognition in Autonomous Vehicles using Interaction Encoding and Optical FlowCode0
Actor-identified Spatiotemporal Action Detection --- Detecting Who Is Doing What in VideosCode0
SoccerDB: A Large-Scale Database for Comprehensive Video UnderstandingCode0
MaCLR: Motion-aware Contrastive Learning of Representations for VideosCode0
Dance with Flow: Two-in-One Stream Action DetectionCode0
ACDnet: An action detection network for real-time edge computing based on flow-guided feature approximation and memory aggregationCode0
RespVAD: Voice Activity Detection via Video-Extracted Respiration PatternsCode0
Multi-Moments in Time: Learning and Interpreting Models for Multi-Action Video UnderstandingCode0
Modality Distillation with Multiple Stream Networks for Action RecognitionCode0
Actor Conditioned Attention Maps for Video Action DetectionCode0
On Occlusions in Video Action Detection: Benchmark Datasets And Training RecipesCode0
MARINE: A Computer Vision Model for Detecting Rare Predator-Prey Interactions in Animal VideosCode0
S3D: Single Shot multi-Span Detector via Fully 3D Convolutional NetworksCode0
A Stronger Baseline for Ego-Centric Action DetectionCode0
Scaling Open-Vocabulary Action DetectionCode0
Coarse-Fine Networks for Temporal Activity Detection in VideosCode0
Long-term Conversation Analysis: Exploring Utility and PrivacyCode0
Actor-Centric Relation NetworkCode0
Simple yet efficient real-time pose-based action recognitionCode0
Learning to Discriminate Information for Online Action DetectionCode0
Learning Motion in Feature Space: Locally-Consistent Deformable Convolution Networks for Fine-Grained Action DetectionCode0
Skeleton-OOD: An End-to-End Skeleton-Based Model for Robust Out-of-Distribution Human Action DetectionCode0
Speaker Embedding-aware Neural Diarization for Flexible Number of Speakers with Textual InformationCode0
Action-Agnostic Point-Level Supervision for Temporal Action DetectionCode0
Learning Latent Super-Events to Detect Multiple Activities in VideosCode0
JoVALE: Detecting Human Actions in Video Using Audiovisual and Language ContextsCode0
Learning Spatio-Temporal Representation with Local and Global DiffusionCode0
Centre Stage: Centricity-based Audio-Visual Temporal Action DetectionCode0
Cefdet: Cognitive Effectiveness Network Based on Fuzzy Inference for Action DetectionCode0
Video action detection by learning graph-based spatio-temporal interactionsCode0
Integrating Emotion Recognition with Speech Recognition and Speaker Diarisation for ConversationsCode0
Learning to Anonymize Faces for Privacy Preserving Action DetectionCode0
MINOTAUR: Multi-task Video Grounding From Multimodal QueriesCode0
ActivityNet: A Large-Scale Video Benchmark for Human Activity UnderstandingCode0
Dual Attention in Time and Frequency Domain for Voice Activity DetectionCode0
Human Activity Recognition: A Spatio-temporal Image Encoding of 3D Skeleton Data for Online Action DetectionCode0
Handwashing Action Detection System for an Autonomous Social RobotCode0
Graph Distillation for Action Detection with Privileged ModalitiesCode0
ABN: Agent-Aware Boundary Networks for Temporal Action Proposal GenerationCode0
Identifying Visible Actions in Lifestyle VlogsCode0
Boundary Discretization and Reliable Classification Network for Temporal Action DetectionCode0
Temporal Gaussian Mixture Layer for VideosCode0
Temporally smooth online action detection using cycle-consistent future anticipationCode0
Boundary-Denoising for Video Activity LocalizationCode0
FunASR: A Fundamental End-to-End Speech Recognition ToolkitCode0
Automatic detection and prediction of nAMD activity change in retinal OCT using Siamese networks and Wasserstein Distance for ordinalityCode0
Fine-Grained Classroom Activity Detection from Audio with Neural NetworksCode0
Show:102550
← PrevPage 5 of 17Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1STAR/LFrame-mAP 0.590.3Unverified
2SiAFrame-mAP 0.588.5Unverified
3YOWO + LFBFrame-mAP 0.587.3Unverified
4HITFrame-mAP 0.584.8Unverified
5HISAN (ResNet-101 + FPN)Video-mAP 0.282.3Unverified
6YOWOFrame-mAP 0.580.4Unverified
7Two-in-one Two StreamVideo-mAP 0.278.48Unverified
8MOCFrame-mAP 0.577.8Unverified
9Faster-RCNN + two-stream I3D convFrame-mAP 0.576.3Unverified
10Two-in-oneVideo-mAP 0.275.48Unverified
#ModelMetricClaimedVerifiedStatus
1SiAFrame-mAP 0.588.5Unverified
2HISAN (ResNet-101 + FPN)Video-mAP 0.287.59Unverified
3HITFrame-mAP 0.583.8Unverified
4HISAN (VGG-16)Frame-mAP 0.576.72Unverified
5DTSVideo-mAP 0.276.1Unverified
6YOWO + LFBFrame-mAP 0.575.7Unverified
7Two-in-one Two StreamVideo-mAP 0.574.74Unverified
8YOWOFrame-mAP 0.574.4Unverified
9MOCFrame-mAP 0.574Unverified
10Faster-RCNN + two-stream I3D convFrame-mAP 0.573.3Unverified
#ModelMetricClaimedVerifiedStatus
1TTMmAP28.79Unverified
2CTRNmAP27.8Unverified
3Coarse-Fine Networks (w/ self-supervised detection pretraining)mAP26.95Unverified
4UniMD+Sync. (RGB+Flow)mAP26.53Unverified
5PDAN (RGB+Flow)mAP26.5Unverified
6PATmAP26.5Unverified
7MS-TCT (RGB only)mAP25.4Unverified
83D ResNet-50 + super-events pretrained on AViDmAP25.2Unverified
9Coarse-Fine NetworksmAP25.1Unverified
10MLAD (RGB + Flow)mAP23.7Unverified
#ModelMetricClaimedVerifiedStatus
1MLADmAP51.5Unverified
2CTRNmAP51.2Unverified
3PDANmAP47.6Unverified
4TGMmAP46.4Unverified
5MS-TCT (RGB only)mAP43.1Unverified
6I3D + our super-eventmAP36.4Unverified
7Two-stream + LSTMmAP28.1Unverified
8Two-streammAP27.6Unverified
#ModelMetricClaimedVerifiedStatus
1Two-in-one Two StreamVideo-mAP 0.596.52Unverified
2DTSVideo-mAP 0.294.3Unverified
3Two-in-oneVideo-mAP 0.592.74Unverified
4T-CNNFrame-mAP 0.586.7Unverified
5MR-TS R-CNNFrame-mAP 0.584.52Unverified
6TS R-CNNFrame-mAP 0.582.3Unverified
7Action TubesFrame-mAP 0.568.1Unverified
#ModelMetricClaimedVerifiedStatus
1MAT (Ours) TransmAP71.6Unverified
2TadML-two streammAP59.7Unverified
3MAT (ours)mAP58.2Unverified
4TadML-rgbmAP53.46Unverified
#ModelMetricClaimedVerifiedStatus
1HITFrame-mAP 0.533.3Unverified
2SiAFrame-mAP 0.528.8Unverified
#ModelMetricClaimedVerifiedStatus
1MS-TCTFrame-mAP33.7Unverified
2PDANFrame-mAP32.7Unverified
#ModelMetricClaimedVerifiedStatus
1STCNNIoU0.14Unverified
2Two Stream NetworkIoU0.07Unverified
#ModelMetricClaimedVerifiedStatus
1STCNN-V2 (Vote decision)IoU0.52Unverified
2RGB and PRGBIoU0.35Unverified
#ModelMetricClaimedVerifiedStatus
1PATmAP44.6Unverified