SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 486 papers

TitleStatusHype
E-ViLM: Efficient Video-Language Model via Masked Video Modeling with Semantic Vector-Quantized Tokenizer—0
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningCode1
VideoCon: Robust Video-Language Alignment via Contrast CaptionsCode1
Sinkhorn Transformations for Single-Query Postprocessing in Text-Video Retrieval—0
Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrieval—0
An Empirical Study of Frame Selection for Text-to-Video Retrieval—0
CHAIN: Exploring Global-Local Spatio-Temporal Information for Improved Self-Supervised Video Hashing—0
TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language UnderstandingCode1
Joint Searching and Grounding: Multi-Granularity Video Content RetrievalCode0
Videoprompter: an ensemble of foundational models for zero-shot video understanding—0
Dual-Stream Knowledge-Preserving Hashing for Unsupervised Video Retrieval—0
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video RetrievalCode1
Analyzing Zero-Shot Abilities of Vision-Language Models on Video Understanding TasksCode0
HowToCaption: Prompting LLMs to Transform Video Annotations at ScaleCode1
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal RetrievalCode1
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive LearningCode1
Learning Segment Similarity and Alignment in Large-Scale Content Based Video Retrieval—0
Unified Coarse-to-Fine Alignment for Video-Text RetrievalCode1
Towards Debiasing Frame Length Bias in Text-Video Retrieval via Causal Intervention—0
In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video RetrievalCode1
Differentiable Resolution Compression and Alignment for Efficient Video Classification and RetrievalCode0
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics DomainsCode0
CoVR-2: Automatic Data Construction for Composed Video RetrievalCode1
Simple Baselines for Interactive Video Retrieval with Questions and AnswersCode1
Prompt Switch: Efficient CLIP Adaptation for Text-Video RetrievalCode1
TeachCLIP: Multi-Grained Teaching for Efficient Text-to-Video Retrieval—0
Learning Multi-modal Representations by Watching Hundreds of Surgical Video LecturesCode1
Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignment—0
Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and ModelCode1
Fine-grained Text-Video Retrieval with Frozen Image Encoders—0
Animate-A-Story: Storytelling with Retrieval-Augmented Video GenerationCode2
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and GenerationCode0
MultiVENT: Multilingual Videos of Events with Aligned Natural Text—0
ICSVR: Investigating Compositional and Syntactic Understanding in Video Retrieval ModelsCode0
An overview on the evaluated video retrieval tasks at TRECVID 2022Code1
Key Frame Extraction with Attention Based Deep Neural Networks—0
MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in IndonesianCode0
COSA: Concatenated Sample Pretrained Vision-Language Foundation ModelCode1
Enhanced Multimodal Representation Learning with Cross-modal KD—0
MarineVRS: Marine Video Retrieval System with Explainability via Semantic Understanding—0
An Overview of Challenges in Egocentric Text-Video Retrieval—0
fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs—0
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and DatasetCode2
FMM-X3D: FPGA-based modeling and mapping of X3D for Human Action Recognition—0
VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending—0
Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set AlignmentCode1
Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrieval—0
A Large Cross-Modal Video Retrieval Dataset with Reading ComprehensionCode1
A Review of Deep Learning for Video Captioning—0
Show:102550
← PrevPage 3 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10STANtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified