SOTAVerified

Video Retrieval

The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 486 papers

TitleStatusHype
FitCLIP: Refining Large-Scale Pretrained Image-Text Models for Zero-Shot Video Understanding TasksCode0
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization—0
Live Laparoscopic Video Retrieval with Compressed Uncertainty—0
VScript: Controllable Script Generation with Visual Presentation—0
NEWSKVQA: Knowledge-Aware News Video Question Answering—0
End-to-end Generative Pretraining for Multimodal Video Captioning—0
Self-supervised Video Representation Learning with Cascade Positive RetrievalCode0
Watch Less and Uncover More: Could Navigation Tools Help Users Search and Explore Videos?—0
Sign Language Video Retrieval with Free-Form Textual Queries—0
Sound and Visual Representation Learning with Multiple Pretraining Tasks—0
Vision Transformer Based Video Hashing Retrieval for Tracing the Source of Fake VideosCode0
Self-supervised Spatiotemporal Representation Learning by Exploiting Video Continuity—0
Time-Equivariant Contrastive Video Representation Learning—0
Cross-modal Manifold Cutmix for Self-supervised Video Representation Learning—0
Generalizable Multi-linear Attention Network—0
Induce, Edit, Retrieve:Language Grounded Multimodal Schema for Instructional Video Retrieval—0
CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation—0
SwAMP: Swapped Assignment of Multi-Modal Pairs for Cross-Modal Retrieval—0
CLIP2TV: Align, Match and Distill for Video-Text Retrieval—0
Masking Modalities for Cross-modal Video Retrieval—0
Domain Adaptation in Multi-View Embedding for Cross-Modal Video Retrieval—0
Coarse to Fine: Video Retrieval before Moment Localization—0
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation—0
Spatio-Temporal Video Representation Learning for AI Based Video Playback Style Prediction—0
Vi-MIX FOR SELF-SUPERVISED VIDEO REPRESENTATION—0
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text UnderstandingCode0
Self-Supervised Video Representation Learning by Video Incoherence Detection—0
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment—0
Self-Supervised Video Representation Learning with Meta-Contrastive Network—0
Boosting Video Captioning with Dynamic Loss Network—0
Video 3D Sampling for Self-supervised Representation Learning—0
Use of Affective Visual Information for Summarization of Human-Centric Videos—0
Inter-intra Variant Dual Representations forSelf-supervised Video RecognitionCode0
Universal Adversarial Head: Practical Protection against Video Data Leakage—0
ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency—0
CNN Retrieval based Unsupervised Metric Learning for Near-Duplicated Video Retrieval—0
SSAN: Separable Self-Attention Network for Video Representation Learning—0
VLM: Task-agnostic Video-Language Model Pre-training for Video UnderstandingCode0
Action in Mind: A Neural Network Approach to Action Recognition and Segmentation—0
T2VLAD: Global-Local Sequence Alignment for Text-Video RetrievalCode0
Self-supervised Video Retrieval Transformer Network—0
Object Priors for Classifying and Localizing Unseen ActionsCode0
Self-supervised Video Representation Learning by Context and Motion DecouplingCode0
CUPID: Adaptive Curation of Pre-training Data for Video-and-Language Representation Learning—0
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning—0
Rudder: A Cross Lingual Video and Text Retrieval DatasetCode0
Clarification of Video Retrieval Query Results by the Automated Insertion of Supporting Shots—0
Win-Fail Action RecognitionCode0
Temporal Contrastive Graph Learning for Video Action Recognition and Retrieval—0
Grounding Physical Object and Event Concepts Through Dynamic Visual Reasoning—0
Show:102550
← PrevPage 8 of 10Next →
All datasetsMSR-VTT-1kADiDeMoMSR-VTTLSMDCActivityNetMSVDYouCook2FIVR-200KVATEXQuerYDSSv2-label retrievalSSv2-template retrieval

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVectext-to-video R@1089.4—Unverified
2CLIP4Cliptext-to-video R@1081.6—Unverified
3OmniVec (pretrained)text-to-video R@1078.6—Unverified
4HunYuan_tvr (huge)text-to-video R@162.9—Unverified
5CLIP-ViPtext-to-video R@157.7—Unverified
6PIDRotext-to-video R@155.9—Unverified
7DMAE (ViT-B/16)text-to-video R@155.5—Unverified
8HunYuan_tvrtext-to-video R@155—Unverified
9MuLTItext-to-video R@154.7—Unverified
10EERCFtext-to-video R@154.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Aurora (ours, r=64)text-to-video R@577.4—Unverified
2InternVideo2-6Btext-to-video R@174.2—Unverified
3vid-TLDR (UMT-L)text-to-video R@172.3—Unverified
4VASTtext-to-video R@172—Unverified
5COSAtext-to-video R@170.5—Unverified
6UMT-L (ViT-L/16)text-to-video R@170.4—Unverified
7GRAMtext-to-video R@167.3—Unverified
8VALORtext-to-video R@161.5—Unverified
9TESTA (ViT-B/16)text-to-video R@161.2—Unverified
10VindLUtext-to-video R@161.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GRAMtext-to-video R@164—Unverified
2VASTtext-to-video R@163.9—Unverified
3InternVideo2-6Btext-to-video R@162.8—Unverified
4VALORtext-to-video R@159.9—Unverified
5UMT-L (ViT-L/16)text-to-video R@158.8—Unverified
6vid-TLDR (UMT-L)text-to-video R@158.1—Unverified
7COSAtext-to-video R@157.9—Unverified
8InternVideo2-6Btext-to-video R@155.9—Unverified
9InternVideotext-to-video R@155.2—Unverified
10VLABtext-to-video R@155.1—Unverified
#ModelMetricClaimedVerifiedStatus
1EMCL-Net (Ours)++ LSMDC Rohrbach et al. (2015)text-to-video R@1053.7—Unverified
2InternVideo2-6Btext-to-video R@146.4—Unverified
3vid-TLDR (UMT-L)text-to-video R@143.1—Unverified
4UMT-L (ViT-L/16)text-to-video R@143—Unverified
5HunYuan_tvr (huge)text-to-video R@140.4—Unverified
6COSAtext-to-video R@139.4—Unverified
7mPLUG-2text-to-video R@134.4—Unverified
8VALORtext-to-video R@134.2—Unverified
9InternVideotext-to-video R@134—Unverified
10InternVideo2-6Btext-to-video R@133.8—Unverified