SOTAVerified

Visual Dialog

Visual Dialog requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a follow-up question about the image, the task is to answer the question.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 118 papers

TitleStatusHype
ENRICH4ALL: A First Luxembourgish BERT Model for a Multilingual Chatbot—0
Enriching Language Models with Visually-grounded Word Vectors and the Lancaster Sensorimotor Norms—0
Ensemble based discriminative models for Visual Dialog Challenge 2018—0
FlexCap: Describe Anything in Images in Controllable Detail—0
FlipDial: A Generative Model for Two-Way Visual Dialogue—0
Generative Visual Dialogue System via Adaptive Reasoning and Weighted Likelihood Estimation—0
GoG: Relation-aware Graph-over-Graph Network for Visual Dialog—0
Granular Multimodal Attention Networks for Visual Dialog—0
Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settings—0
How to Fool Systems and Humans in Visually Grounded Interaction: A Case Study on Adversarial Attacks on Visual Dialog—0
ICCV23 Visual-Dialog Emotion Explanation Challenge: SEU_309 Team Technical Report—0
Image-Question-Answer Synergistic Network for Visual Dialog—0
Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning—0
Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation—0
Learning Goal-Oriented Visual Dialog Agents: Imitating and Surpassing Analytic Experts—0
Learning to Ground Visual Objects for Visual Dialog—0
Making History Matter: History-Advantage Sequence Training for Visual Dialog—0
VD-GR: Boosting Visual Dialog with Cascaded Spatial-Temporal Multi-Modal GRaphs—0
Modality-Balanced Models for Visual Dialogue—0
Modeling Coreference Relations in Visual Dialog—0
Multimodal Hierarchical Reinforcement Learning Policy for Task-Oriented Visual Dialog—0
Multi-Modal Open-Domain Dialogue—0
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog—0
ORD: Object Relationship Discovery for Visual Dialogue Generation—0
PIRC Net : Using Proposal Indexing, Relationships and Context for Phrase Grounding—0
Show:102550
← PrevPage 4 of 5Next →
All datasetsVisual Dialog v1.0 test-stdVisDial v0.9 valVisDial v1.0 test-stdBlendedSkillTalkConvAI2EmpatheticDialoguesImage-ChatWizard of Wikipedia

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SingleNDCG (x 100)78.7—Unverified
2P1P2+Distill+EnsembleNDCG (x 100)77.92—Unverified
3Ensemble + Fine-tuningNDCG (x 100)76.43—Unverified
4ensemble, finetuneNDCG (x 100)76.17—Unverified
5VD-PCRNDCG (x 100)76.14—Unverified
6EnsembleNDCG (x 100)75.35—Unverified
7Ensemble + FinetuneNDCG (x 100)74.88—Unverified
8bert-double-stream-finetuningNDCG (x 100)74.62—Unverified
9CE-finetuned, single modelNDCG (x 100)74.47—Unverified
102NDCG (x 100)73.36—Unverified
#ModelMetricClaimedVerifiedStatus
19xFGA (VGG)MRR68.92—Unverified
2DANMRR66.38—Unverified
3CorefNMN (ResNet-152)MRR64.1—Unverified
4CoAttMRR63.98—Unverified
5CorefNMNMRR63.6—Unverified
6DualVDMRR62.94—Unverified
7SF-QIH-se-2MRR62.42—Unverified
8HCIAE-NP-ATTMRR62.22—Unverified
9HieCoAtt-QIMRR57.88—Unverified
10AMEMR@148.53—Unverified
#ModelMetricClaimedVerifiedStatus
15xFGA + LSNDCG64.04—Unverified
25xFGA + LS*+MRR0.71—Unverified
3Two-StepMRR0.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-440—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-42.2—Unverified