Loss re-scaling VQA: Revisiting the LanguagePrior Problem from a Class-imbalance View Oct 30, 2020 Face Recognition image-classification
Code Code Available Leveraging Visual Question Answering to Improve Text-to-Image Synthesis Oct 28, 2020 Auxiliary Learning Image Generation
— Unverified MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering Oct 27, 2020 Diagnostic Question Answering
Code Code Available ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Prediction Oct 26, 2020 Video Quality Assessment Visual Question Answering (VQA)
Code Code Available Beyond VQA: Generating Multi-word Answer and Rationale to Visual Questions Oct 24, 2020 General Classification Multiple-choice
— Unverified RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering Oct 24, 2020 Optical Character Recognition Optical Character Recognition (OCR)
Code Code Available Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies Oct 21, 2020 Question Answering Visual Question Answering
Code Code Available Bayesian Attention Modules Oct 20, 2020 Image Captioning Machine Translation
Code Code Available SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency Oct 20, 2020 Question Answering Visual Grounding
Code Code Available Answer-checking in Context: A Multi-modal FullyAttention Network for Visual Question Answering Oct 17, 2020 Question Answering Visual Question Answering
— Unverified New Ideas and Trends in Deep Multimodal Content Understanding: A Review Oct 16, 2020 Cross-Modal Retrieval Deep Learning
— Unverified Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs Oct 15, 2020 Language Modeling Language Modelling
Code Code Available Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think! Oct 13, 2020 Diagnostic Image-text Classification
— Unverified Contrast and Classify: Training Robust VQA Models Oct 13, 2020 Contrastive Learning Data Augmentation
Code Code Available Interpretable Neural Computation for Real-World Compositional Visual Question Answering Oct 10, 2020 Question Answering Visual Question Answering
— Unverified Characterizing Datasets for Social Visual Question Answering, and the New TinySocial Dataset Oct 8, 2020 Question Answering Visual Question Answering
— Unverified Pathological Visual Question Answering Oct 6, 2020 AI Agent Question Answering
— Unverified Finding the Evidence: Localization-aware Answer Prediction for Text Visual Question Answering Oct 6, 2020 Optical Character Recognition Optical Character Recognition (OCR)
— Unverified Attention Guided Semantic Relationship Parsing for Visual Question Answering Oct 5, 2020 Object Question Answering
— Unverified CAPTION: Correction by Analyses, POS-Tagging and Interpretation of Objects using only Nouns Oct 2, 2020 Image Captioning object-detection
— Unverified ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention Oct 1, 2020 Multiple-choice Question Answering
— Unverified Graph-based Heuristic Search for Module Selection Procedure in Neural Module Network Sep 30, 2020 Heuristic Search Question Answering
— Unverified Spatial Attention as an Interface for Image Captioning Models Sep 29, 2020 Image Captioning Question Answering
— Unverified Hierarchical Deep Multi-modal Network for Medical Visual Question Answering Sep 27, 2020 Descriptive Medical Visual Question Answering
Code Code Available Multiple interaction learning with question-type prior knowledge for constraining answer search space in visual question answering Sep 23, 2020 Question Answering Visual Question Answering
Code Code Available X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers Sep 23, 2020 Image Captioning Image Generation
Code Code Available Regularizing Attention Networks for Anomaly Detection in Visual Question Answering Sep 21, 2020 Anomaly Detection Question Answering
— Unverified MUTANT: A Training Paradigm for Out-of-Distribution Generalization in Visual Question Answering Sep 18, 2020 Out-of-Distribution Generalization Question Answering
Code Code Available A Multimodal Memes Classification: A Survey and Open Research Issues Sep 17, 2020 Classification General Classification
— Unverified A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports Sep 3, 2020 Image-text Retrieval Medical Visual Question Answering
Code Code Available Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering Aug 31, 2020 Knowledge Graphs Question Answering
— Unverified A Dataset and Baselines for Visual Question Answering on Art Aug 28, 2020 Question Answering Question Generation
Code Code Available Visual Question Answering on Image Sets Aug 27, 2020 Question Answering Visual Question Answering
— Unverified No-Reference Video Quality Assessment Using Space-Time Chips Aug 23, 2020 Video Quality Assessment Visual Question Answering (VQA)
Code Code Available Document Visual Question Answering Challenge 2020 Aug 20, 2020 Question Answering Retrieval
— Unverified Linguistically-aware Attention for Reducing the Semantic-Gap in Vision-Language Tasks Aug 18, 2020 Image Captioning Visual Question Answering (VQA)
— Unverified DeVLBert: Learning Deconfounded Visio-Linguistic Representations Aug 16, 2020 Image Retrieval Question Answering
Code Code Available Graph Edit Distance Reward: Learning to Edit Scene Graph Aug 15, 2020 Graph Matching Image Retrieval
— Unverified Assisting Scene Graph Generation with Self-Supervision Aug 8, 2020 Graph Generation Image Captioning
— Unverified TRRNet: Tiered Relation Reasoning for Compositional Visual Question Answering Aug 1, 2020 Object Question Answering
— Unverified Interpretable Visual Reasoning via Probabilistic Formulation under Natural Supervision Aug 1, 2020 Question Answering Visual Question Answering
— Unverified Noise-Induced Barren Plateaus in Variational Quantum Algorithms Jul 28, 2020 Visual Question Answering (VQA)
Code Code Available REXUP: I REason, I EXtract, I UPdate with Structured Compositional Reasoning for Visual Question Answering Jul 27, 2020 Question Answering Visual Question Answering
Code Code Available Contrastive Visual-Linguistic Pretraining Jul 26, 2020 Contrastive Learning regression
Code Code Available Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data Jul 24, 2020 Visual Dialog Visual Question Answering (VQA)
Code Code Available Spatially Aware Multimodal Transformers for TextVQA Jul 23, 2020 Optical Character Recognition (OCR) Spatial Reasoning
Code Code Available Semantic Equivalent Adversarial Data Augmentation for Visual Question Answering Jul 19, 2020 Adversarial Attack Data Augmentation
Code Code Available Knowledge-Based Video Question Answering with Unsupervised Scene Descriptions Jul 17, 2020 Question Answering Video Question Answering
Code Code Available Learning to Discretely Compose Reasoning Module Networks for Video Captioning Jul 17, 2020 Decoder Question Answering
Code Code Available Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder Jul 13, 2020 Question Answering Visual Grounding
— Unverified 