SOTAVerified

Visual Dialog

Visual Dialog requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a follow-up question about the image, the task is to answer the question.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 118 papers

TitleStatusHype
The Impact of Answers in Referential Visual Dialog—0
Variational Disentangled Attention for Regularized Visual Dialog—0
GoG: Relation-aware Graph-over-Graph Network for Visual Dialog—0
Learning to Ground Visual Objects for Visual Dialog—0
Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented GuesserCode0
SeqDialN: Sequential Visual Dialog Network in Joint Visual-Linguistic Representation SpaceCode0
Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic RepresentationCode0
Visual-Textual Alignment for Graph Inference in Visual Dialog—0
Reasoning Over History: Context Aware Visual Dialog—0
Multi-Modal Open-Domain Dialogue—0
Answer-Driven Visual State Estimator for Goal-Oriented Visual DialogueCode0
SeqDialN: Sequential Visual Dialog Networks in Joint Visual-Linguistic Representation SpaceCode0
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA DataCode0
Effective questions in referential visual dialogue—0
Towards Visual Dialog for Radiology—0
ORD: Object Relationship Discovery for Visual Dialogue Generation—0
Modality-Balanced Models for Visual Dialogue—0
Ensemble based discriminative models for Visual Dialog Challenge 2018—0
Vision and Language: from Visual Perception to Content Creation—0
DMRM: A Dual-channel Multi-hop Reasoning Model for Visual DialogCode0
TAB-VCR: Tags and Attributes based VCR BaselinesCode0
Efficient Attention Mechanism for Visual Dialog that can Handle All the Interactions between Multiple InputsCode0
Two Causal Principles for Improving Visual DialogCode0
DualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual DialogueCode0
Video Dialog via Progressive Inference and Cross-Transformer—0
TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning BaselinesCode0
Granular Multimodal Attention Networks for Visual Dialog—0
Improving Generative Visual Dialog by Answering Diverse QuestionsCode0
On Controlled DeEntanglement for Natural Language Processing—0
Probabilistic framework for solving Visual Dialog—0
Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation—0
Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settings—0
Reactive Multi-Stage Feature Fusion for Multimodal Dialogue Modeling—0
What Should I Ask? Using Conversationally Informative Rewards for Goal-Oriented Visual Dialog—0
Learning Goal-Oriented Visual Dialog Agents: Imitating and Surpassing Analytic Experts—0
What Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog.—0
A Generative Adversarial Density Estimator—0
The World in My Mind: Visual Dialog with Adversarial Multi-modal Feature Encoding—0
Factor Graph AttentionCode0
Reasoning Visual Dialogs with Structural and Partial ObservationsCode0
CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual DialogCode0
Discourse Parsing in Videos: A Multi-modal AppraochCode0
Image-Question-Answer Synergistic Network for Visual Dialog—0
Generative Visual Dialogue System via Adaptive Reasoning and Weighted Likelihood Estimation—0
Making History Matter: History-Advantage Sequence Training for Visual Dialog—0
Dual Attention Networks for Visual Reference Resolution in Visual DialogCode0
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog—0
Response to "Visual Dialogue without Vision or Dialogue" (Massiceti et al., 2018)—0
Visual Dialogue without Vision or DialogueCode0
What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions—0
Show:102550
← PrevPage 2 of 3Next →
All datasetsVisual Dialog v1.0 test-stdVisDial v0.9 valVisDial v1.0 test-stdBlendedSkillTalkConvAI2EmpatheticDialoguesImage-ChatWizard of Wikipedia

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SingleNDCG (x 100)78.7—Unverified
2P1P2+Distill+EnsembleNDCG (x 100)77.92—Unverified
3Ensemble + Fine-tuningNDCG (x 100)76.43—Unverified
4ensemble, finetuneNDCG (x 100)76.17—Unverified
5VD-PCRNDCG (x 100)76.14—Unverified
6EnsembleNDCG (x 100)75.35—Unverified
7Ensemble + FinetuneNDCG (x 100)74.88—Unverified
8bert-double-stream-finetuningNDCG (x 100)74.62—Unverified
9CE-finetuned, single modelNDCG (x 100)74.47—Unverified
102NDCG (x 100)73.36—Unverified
#ModelMetricClaimedVerifiedStatus
19xFGA (VGG)MRR68.92—Unverified
2DANMRR66.38—Unverified
3CorefNMN (ResNet-152)MRR64.1—Unverified
4CoAttMRR63.98—Unverified
5CorefNMNMRR63.6—Unverified
6DualVDMRR62.94—Unverified
7SF-QIH-se-2MRR62.42—Unverified
8HCIAE-NP-ATTMRR62.22—Unverified
9HieCoAtt-QIMRR57.88—Unverified
10AMEMR@148.53—Unverified
#ModelMetricClaimedVerifiedStatus
15xFGA + LSNDCG64.04—Unverified
25xFGA + LS*+MRR0.71—Unverified
3Two-StepMRR0.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-41.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-440—Unverified
#ModelMetricClaimedVerifiedStatus
1Multi-Modal BlenderBotBLEU-42.2—Unverified