SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 486 papers

TitleStatusHype
An overview on the evaluated video retrieval tasks at TRECVID 2022Code1
Learning Multi-modal Representations by Watching Hundreds of Surgical Video LecturesCode1
CLIP2Video: Mastering Video-Text Retrieval via Image CLIPCode1
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip RetrievalCode1
Florence: A New Foundation Model for Computer VisionCode1
A Large Cross-Modal Video Retrieval Dataset with Reading ComprehensionCode1
Clover: Towards A Unified Video-Language Alignment and Fusion ModelCode1
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingCode1
Align and Prompt: Video-and-Language Pre-training with Entity PromptsCode1
Hierarchical Video-Moment Retrieval and Step-CaptioningCode1
AssistSR: Task-oriented Video Segment Retrieval for Personal AI AssistantCode1
CoCa: Contrastive Captioners are Image-Text Foundation ModelsCode1
Learning video retrieval models with relevance-aware online miningCode1
Less is More: ClipBERT for Video-and-Language Learning via Sparse SamplingCode1
Marine Video Kit: A New Marine Video Dataset for Content-based Analysis and RetrievalCode1
AVLnet: Learning Audio-Visual Language Representations from Instructional VideosCode1
COOT: Cooperative Hierarchical Transformer for Video-Text Representation LearningCode1
In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video RetrievalCode1
Dual Learning with Dynamic Knowledge Distillation for Partially Relevant Video RetrievalCode1
ECLIPSE: Efficient Long-range Video Retrieval using Sight and SoundCode1
Contrastive Masked Autoencoders for Self-Supervised Video HashingCode1
Advancing High-Resolution Video-Language Representation with Large-Scale Video TranscriptionsCode1
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video RetrievalCode1
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive LearningCode1
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax LossCode1
COSA: Concatenated Sample Pretrained Vision-Language Foundation ModelCode1
LAVENDER: Unifying Video-Language Understanding as Masked Language ModelingCode1
CoVR-2: Automatic Data Construction for Composed Video RetrievalCode1
Everything at Once -- Multi-modal Fusion Transformer for Video RetrievalCode1
End-to-End Learning of Visual Representations from Uncurated Instructional VideosCode1
Cross-Architecture Self-supervised Video Representation LearningCode1
Cross-Modal Adapter for Text-Video RetrievalCode1
Cross Modal Retrieval with Querybank NormalisationCode1
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual ModelingCode1
DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy MinimizationCode1
Text Proxy: Decomposing Retrieval from a 1-to-N Relationship into N 1-to-1 Relationships for Text-Video RetrievalCode1
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and DataCode1
A Feature-space Multimodal Data Augmentation Technique for Text-video RetrievalCode1
C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video RetrievalCode1
DnS: Distill-and-Select for Efficient and Accurate Video Indexing and RetrievalCode1
Audio-based Near-Duplicate Video Retrieval with Audio Similarity LearningCode1
Dual Encoding for Video Retrieval by TextCode1
Temporal Context Aggregation for Video Retrieval with Contrastive LearningCode1
DGL: Dynamic Global-Local Prompt Tuning for Text-Video RetrievalCode1
CONQUER: Contextual Query-aware Ranking for Video Corpus Moment RetrievalCode1
Generalized Few-Shot Video Classification with Video Retrieval and Feature GenerationCode1
DiffusionRet: Generative Text-Video Retrieval with Diffusion ModelCode1
Frozen in Time: A Joint Video and Image Encoder for End-to-End RetrievalCode1
Hysia: Serving DNN-Based Video-to-Retail Applications in CloudCode1
Condensed Movies: Story Based Retrieval with Contextual EmbeddingsCode1
Show:102550
← PrevPage 2 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10EERCFtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified