SOTAVerified

Moment Retrieval

Moment retrieval can de defined as the task of "localizing moments in a video given a user query".

Description from: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries

Image credit: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–125 of 132 papers

TitleStatusHype
Towards Diverse Temporal Grounding under Single Positive LabelsCode0
Towards Generalisable Video Moment Retrieval: Visual-Dynamic Injection to Image-Text Pre-Training—0
Interactive Video Corpus Moment Retrieval using Reinforcement Learning—0
Multi-video Moment Ranking with Multimodal Clue—0
Temporal Perceiving Video-Language Pre-training—0
Exploring Temporal Concurrency for Video-Language Representation LearningCode0
SimVTP: Simple Video Text Pre-training with Masked AutoencodersCode0
Going for GOAL: A Resource for Grounded Football CommentariesCode0
Zero-shot Video Moment Retrieval With Off-the-Shelf Models—0
FedVMR: A New Federated Learning method for Video Moment Retrieval—0
Modal-specific Pseudo Query Generation for Video Corpus Moment RetrievalCode0
Multi-Modal Cross-Domain Alignment Network for Video Moment Retrieval—0
Cross-Lingual Cross-Modal Consolidation for Effective Multilingual Video Corpus Moment Retrieval—0
AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval—0
Temporal Sentence Grounding in Videos: A Survey and Future Directions—0
Multi-scale 2D Representation Learning for weakly-supervised moment retrieval—0
Coarse to Fine: Video Retrieval before Moment Localization—0
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation—0
Video Moment Retrieval with Text Query Considering Many-to-Many Correspondence Using Potentially Relevant Pair—0
Multi-Modal Relational Graph for Cross-Modal Video Moment Retrieval—0
Fast Video Moment Retrieval—0
Video Moment Retrieval via Natural Language Queries—0
Text-based Localization of Moments in a Video Corpus—0
Generating Adjacency Matrix for Video Relocalization—0
Graph Neural Network for Video Relocalization—0
Show:102550
← PrevPage 5 of 6Next →
All datasetsQVHighlightsCharades-STA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnLoc-LR@1 IoU=0.566.1—Unverified
2UnLoc-BR@1 IoU=0.564.5—Unverified
3DenoiseLocR@1 IoU=0.559.27—Unverified
4SG-DETR (w/ PT)mAP58.8—Unverified
5SG-DETRmAP54.1—Unverified
6LLaVA-MRmAP52.73—Unverified
7FlashVTGmAP52—Unverified
8InternVideo2-6BmAP49.24—Unverified
9CG-DETR (w/ PT)mAP47.97—Unverified
10VideoLights-B-ptmAP47.94—Unverified
#ModelMetricClaimedVerifiedStatus
1SG-DETR (w/ PT)R@1 IoU=0.571.1—Unverified
2LLaVA-MRR@1 IoU=0.570.65—Unverified
3FlashVTGR@1 IoU=0.570.32—Unverified
4SG-DETRR@1 IoU=0.570.2—Unverified
5InternVideo2-6BR@1 IoU=0.570.03—Unverified
6InternVideo2-1BR@1 IoU=0.568.36—Unverified
7VideoChat-T (FT)R@1 IoU=0.567.1—Unverified
8UniMD+Sync.R@1 IoU=0.563.98—Unverified
9LD-DETRR@1 IoU=0.562.58—Unverified
10VideoLights-B-ptR@1 IoU=0.561.96—Unverified