SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 486 papers

TitleStatusHype
An overview on the evaluated video retrieval tasks at TRECVID 2022Code1
MDMMT: Multidomain Multimodal Transformer for Video RetrievalCode1
CLIP2Video: Mastering Video-Text Retrieval via Image CLIPCode1
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip RetrievalCode1
HowToCaption: Prompting LLMs to Transform Video Annotations at ScaleCode1
Dual Encoding for Video Retrieval by TextCode1
Clover: Towards A Unified Video-Language Alignment and Fusion ModelCode1
Multimedia Retrieval Through Unsupervised Hypergraph-Based Manifold RankingCode1
Align and Prompt: Video-and-Language Pre-training with Entity PromptsCode1
Multi-Query Video RetrievalCode1
AssistSR: Task-oriented Video Segment Retrieval for Personal AI AssistantCode1
CoCa: Contrastive Captioners are Image-Text Foundation ModelsCode1
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax LossCode1
Learning Multi-modal Representations by Watching Hundreds of Surgical Video LecturesCode1
GMMFormer v2: An Uncertainty-aware Framework for Partially Relevant Video RetrievalCode1
COOT: Cooperative Hierarchical Transformer for Video-Text Representation LearningCode1
GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video RetrievalCode1
Frozen in Time: A Joint Video and Image Encoder for End-to-End RetrievalCode1
Contrastive Masked Autoencoders for Self-Supervised Video HashingCode1
Advancing High-Resolution Video-Language Representation with Large-Scale Video TranscriptionsCode1
DnS: Distill-and-Select for Efficient and Accurate Video Indexing and RetrievalCode1
Generalized Few-Shot Video Classification with Video Retrieval and Feature GenerationCode1
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingCode1
Florence: A New Foundation Model for Computer VisionCode1
Disentangled Representation Learning for Text-Video RetrievalCode1
COSA: Concatenated Sample Pretrained Vision-Language Foundation ModelCode1
AVLnet: Learning Audio-Visual Language Representations from Instructional VideosCode1
CoVR-2: Automatic Data Construction for Composed Video RetrievalCode1
Holistic Features are almost Sufficient for Text-to-Video RetrievalCode1
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video ClipsCode1
Cross-Architecture Self-supervised Video Representation LearningCode1
Cross-Modal Adapter for Text-Video RetrievalCode1
Cross Modal Retrieval with Querybank NormalisationCode1
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual ModelingCode1
DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy MinimizationCode1
Text Proxy: Decomposing Retrieval from a 1-to-N Relationship into N 1-to-1 Relationships for Text-Video RetrievalCode1
Audio-based Near-Duplicate Video Retrieval with Audio Similarity LearningCode1
A Feature-space Multimodal Data Augmentation Technique for Text-video RetrievalCode1
Everything at Once -- Multi-modal Fusion Transformer for Video RetrievalCode1
In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video RetrievalCode1
Temporal Context Aggregation for Video Retrieval with Contrastive LearningCode1
Dense-Captioning Events in VideosCode1
CONQUER: Contextual Query-aware Ranking for Video Corpus Moment RetrievalCode1
DGL: Dynamic Global-Local Prompt Tuning for Text-Video RetrievalCode1
Everything at Once - Multi-Modal Fusion Transformer for Video RetrievalCode1
ECLIPSE: Efficient Long-range Video Retrieval using Sight and SoundCode1
DiffusionRet: Generative Text-Video Retrieval with Diffusion ModelCode1
Condensed Movies: Story Based Retrieval with Contextual EmbeddingsCode1
Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video RetrievalCode1
3D-CSL: self-supervised 3D context similarity learning for Near-Duplicate Video RetrievalCode1
Show:102550
← PrevPage 2 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10EERCFtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified