SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 486 papers

TitleStatusHype
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training—0
You were saying? - Spoken Language in the V3C DatasetCode0
Contextual Explainable Video Representation: Human Perception-based UnderstandingCode0
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners—0
Masked Contrastive Pre-Training for Efficient Video-Text Retrieval—0
Renmin University of China at TRECVID 2022: Improving Video Search by Feature Fusion and Negation Understanding—0
Are All Combinations Equal? Combining Textual and Visual Features with Multiple Space Learning for Text-Based Video RetrievalCode0
SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-training—0
A Unified Model for Video Understanding and Knowledge Embedding with Heterogeneous Knowledge Graph Dataset—0
CLOP: Video-and-Language Pre-Training with Knowledge Regularizations—0
LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling—0
Efficient Cross-Modal Video Retrieval with Meta-Optimized FramesCode0
Semantic Video Moments Retrieval at Scale: A New Task and a Baseline—0
RaP: Redundancy-aware Video-language Pre-training for Text-Video RetrievalCode0
Learning to Locate Visual Answer in Video Corpus Using QuestionCode0
Contrastive Video-Language Learning with Fine-grained Frame Sampling—0
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks—0
ConTra: (Con)text (Tra)nsformer for Cross-Modal Video RetrievalCode0
Event Extraction in Video Transcripts—0
Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval—0
Multi-Granularity Graph Pooling for Video-based Person Re-Identification—0
Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network—0
Semi-automatic Data Annotation System for Multi-Target Multi-Camera Vehicle Tracking—0
Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising—0
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks—0
Temporal Contrastive Learning with Curriculum—0
MuMUR : Multilingual Multimodal Universal Retrieval—0
STAR-GNN: Spatial-Temporal Video Representation for Content-based Retrieval—0
Motion Sensitive Contrastive Learning for Self-supervised Video Representation—0
QSAM-Net: Rain streak removal by quaternion neural network with self-attention module—0
GOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation LearningCode0
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval—0
Robustness Analysis of Video-Language Models Against Visual and Language PerturbationsCode0
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022Code0
RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video RetrievalCode0
Semantic Role Aware Correlation Transformer for Text to Video RetrievalCode0
VRAG: Region Attention Graphs for Content-Based Video Retrieval—0
Learning to Retrieve Videos by Asking QuestionsCode0
Learn to Understand Negation in Video RetrievalCode0
Relevance-based Margin for Contrastively-trained Video Retrieval ModelsCode0
A Survey of Video-based Action Quality Assessment—0
Modality-Balanced Embedding for Video Retrieval—0
COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval—0
Exploring the Temporal Cues to Enhance Video Retrieval on Standardized CDVACode0
Probabilistic Representations for Video Contrastive Learning—0
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations—0
Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguageCode0
Learning Audio-Video Modalities from Image Captions—0
CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation—0
Controllable Augmentations for Video Representation Learning—0
Show:102550
← PrevPage 7 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10EERCFtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified