SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 486 papers

TitleStatusHype
NAVERO: Unlocking Fine-Grained Semantics for Video-Language Compositionality—0
Bridging Information Asymmetry in Text-video Retrieval: A Data-centric Approach—0
Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semantics—0
Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce—0
ExpertAF: Expert Actionable Feedback from Video—0
SEDS: Semantically Enhanced Dual-Stream Encoder for Sign Language RetrievalCode0
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video RetrievalCode1
Not All Pairs are Equal: Hierarchical Learning for Average-Precision-Oriented Video Retrieval—0
MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipeline—0
EA-VTR: Event-Aware Video-Text Retrieval—0
MAMA: Meta-optimized Angular Margin Contrastive Framework for Video-Language Representation LearningCode0
Referring Atomic Video Action RecognitionCode1
ACE: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modeling—0
Multi-Granularity and Multi-modal Feature Interaction Approach for Text Video Retrieval—0
Towards Holistic Language-video Representation: the language model-enhanced MSR-Video to Text Dataset—0
Explore the Limits of Omni-modal Pretraining at ScaleCode2
RNNs, CNNs and Transformers in Human Action Recognition: A Survey and a Hybrid Model—0
Uncertainty-aware sign language video retrieval with probability distribution modeling—0
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter—0
GMMFormer v2: An Uncertainty-aware Framework for Partially Relevant Video RetrievalCode1
Text-Video Retrieval with Global-Local Semantic Consistent LearningCode1
Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Models—0
Learning text-to-video retrieval from image captioning—0
SHE-Net: Syntax-Hierarchy-Enhanced Text-Video Retrieval—0
ProTA: Probabilistic Token Aggregation for Text-Video Retrieval—0
Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval—0
Composed Video Retrieval via Enriched Context and Discriminative EmbeddingsCode2
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real WorldCode2
InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingCode7
vid-TLDR: Training Free Token merging for Light-weight Video TransformerCode2
Improving Video Corpus Moment Retrieval with Partial Relevance EnhancementCode0
Event-aware Video Corpus Moment Retrieval—0
Video Editing for Video Retrieval—0
Multi-granularity Correspondence Learning from Long-term Noisy VideosCode2
CoAVT: A Cognition-Inspired Unified Audio-Visual-Text Pre-Training Model for Multimodal Processing—0
DGL: Dynamic Global-Local Prompt Tuning for Text-Video RetrievalCode1
Distilling Vision-Language Models on Millions of Videos—0
Text-Video Retrieval via Variational Multi-Modal Hypergraph Networks—0
Detours for Navigating Instructional Videos—0
Holistic Features are almost Sufficient for Text-to-Video RetrievalCode1
Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation LearningCode1
No More Shortcuts: Realizing the Potential of Temporal Self-Supervision—0
Shot2Story20K: A New Benchmark for Comprehensive Understanding of Multi-shot VideosCode1
Let All be Whitened: Multi-teacher Distillation for Efficient Visual RetrievalCode1
WAVER: Writing-style Agnostic Text-Video Retrieval via Distilling Vision-Language Models Through Open-Vocabulary KnowledgeCode0
Leveraging Generative Language Models for Weakly Supervised Sentence Component Analysis in Video-Language Joint Learning—0
Vision-Language Models Learn Super Images for Efficient Partially Relevant Video Retrieval—0
RTQ: Rethinking Video-language Understanding Based on Image-text ModelCode1
A Video is Worth 10,000 Words: Training and Benchmarking with Diverse Captions for Better Long Video Retrieval—0
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding—0
Show:102550
← PrevPage 2 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10EERCFtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified