LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding Dec 29, 2020 Document Image Classification Document Layout Analysis
Code Code Available Object-Centric Diagnosis of Visual Reasoning Dec 21, 2020 Diagnostic Object
— Unverified Learning content and context with language bias for Visual Question Answering Dec 21, 2020 Question Answering Visual Question Answering
Code Code Available KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA Dec 20, 2020 Visual Question Answering (VQA)
— Unverified On Modality Bias in the TVQA Dataset Dec 18, 2020 Question Answering Video Question Answering
Code Code Available Trying Bilinear Pooling in Video-QA Dec 18, 2020 Question Answering Video Question Answering
— Unverified KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning Dec 13, 2020 Sentence Visual Commonsense Reasoning
— Unverified Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps Dec 9, 2020 Decoder Image Captioning
— Unverified Study on the Assessment of the Quality of Experience of Streaming Video Dec 8, 2020 regression Video Quality Assessment
Code Code Available Understanding Guided Image Captioning Performance across Domains Dec 4, 2020 Descriptive Image Captioning
Code Code Available WeaQA: Weak Supervision via Captions for Visual Question Answering Dec 4, 2020 Question Answering Visual Question Answering
— Unverified Multimodal Graph Networks for Compositional Generalization in Visual Question Answering Dec 1, 2020 Graph Neural Network Question Answering
— Unverified Open-Ended Multi-Modal Relational Reasoning for Video Question Answering Dec 1, 2020 Question Answering Relational Reasoning
Code Code Available A Unified Framework for Multilingual and Code-Mixed Visual Question Answering Dec 1, 2020 Question Answering Visual Question Answering
— Unverified Towards Knowledge-Augmented Visual Question Answering Dec 1, 2020 General Knowledge Graph Attention
Code Code Available Learning from Lexical Perturbations for Consistent Visual Question Answering Nov 26, 2020 Question Answering Visual Question Answering
Code Code Available Siamese Tracking with Lingual Object Constraints Nov 23, 2020 Object Object Tracking
Code Code Available Interpretable Visual Reasoning via Induced Symbolic Space Nov 23, 2020 Visual Question Answering (VQA) Visual Reasoning
Code Code Available Modular Graph Attention Network for Complex Visual Relational Reasoning Nov 22, 2020 Graph Attention Question Answering
— Unverified Logically Consistent Loss for Visual Question Answering Nov 19, 2020 Multi-Task Learning Question Answering
— Unverified Generating Natural Questions from Images for Multimodal Assistants Nov 17, 2020 Common Sense Reasoning Natural Questions
— Unverified CapWAP: Captioning with a Purpose Nov 9, 2020 Image Captioning Question Answering
— Unverified Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles Nov 7, 2020 Natural Language Inference Question Answering
Code Code Available An Improved Attention for Visual Question Answering Nov 4, 2020 Decoder Question Answering
Code Code Available Reasoning Over History: Context Aware Visual Dialog Nov 2, 2020 coreference-resolution Coreference Resolution
— Unverified Can Pre-training help VQA with Lexical Variations? Nov 1, 2020 Question Answering Visual Question Answering
— Unverified Representation, Learning and Reasoning on Spatial Language for Downstream NLP Tasks Nov 1, 2020 Common Sense Reasoning Question Answering
— Unverified STL-CQA: Structure-based Transformers with Localization and Encoding for Chart Question Answering Nov 1, 2020 Chart Question Answering Question Answering
— Unverified CapWAP: Image Captioning with a Purpose Nov 1, 2020 Image Captioning Question Answering
— Unverified ISAAQ - Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention Nov 1, 2020 Multiple-choice Question Answering
— Unverified Loss re-scaling VQA: Revisiting the LanguagePrior Problem from a Class-imbalance View Oct 30, 2020 Face Recognition image-classification
Code Code Available Leveraging Visual Question Answering to Improve Text-to-Image Synthesis Oct 28, 2020 Auxiliary Learning Image Generation
— Unverified Beyond VQA: Generating Multi-word Answer and Rationale to Visual Questions Oct 24, 2020 General Classification Multiple-choice
— Unverified SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency Oct 20, 2020 Question Answering Visual Grounding
Code Code Available Answer-checking in Context: A Multi-modal FullyAttention Network for Visual Question Answering Oct 17, 2020 Question Answering Visual Question Answering
— Unverified New Ideas and Trends in Deep Multimodal Content Understanding: A Review Oct 16, 2020 Cross-Modal Retrieval Deep Learning
— Unverified Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think! Oct 13, 2020 Diagnostic Image-text Classification
— Unverified Interpretable Neural Computation for Real-World Compositional Visual Question Answering Oct 10, 2020 Question Answering Visual Question Answering
— Unverified Characterizing Datasets for Social Visual Question Answering, and the New TinySocial Dataset Oct 8, 2020 Question Answering Visual Question Answering
— Unverified Finding the Evidence: Localization-aware Answer Prediction for Text Visual Question Answering Oct 6, 2020 Optical Character Recognition Optical Character Recognition (OCR)
— Unverified Pathological Visual Question Answering Oct 6, 2020 AI Agent Question Answering
— Unverified Attention Guided Semantic Relationship Parsing for Visual Question Answering Oct 5, 2020 Object Question Answering
— Unverified CAPTION: Correction by Analyses, POS-Tagging and Interpretation of Objects using only Nouns Oct 2, 2020 Image Captioning object-detection
— Unverified ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention Oct 1, 2020 Multiple-choice Question Answering
— Unverified Graph-based Heuristic Search for Module Selection Procedure in Neural Module Network Sep 30, 2020 Heuristic Search Question Answering
— Unverified Spatial Attention as an Interface for Image Captioning Models Sep 29, 2020 Image Captioning Question Answering
— Unverified Hierarchical Deep Multi-modal Network for Medical Visual Question Answering Sep 27, 2020 Descriptive Medical Visual Question Answering
Code Code Available Multiple interaction learning with question-type prior knowledge for constraining answer search space in visual question answering Sep 23, 2020 Question Answering Visual Question Answering
Code Code Available Regularizing Attention Networks for Anomaly Detection in Visual Question Answering Sep 21, 2020 Anomaly Detection Question Answering
— Unverified A Multimodal Memes Classification: A Survey and Open Research Issues Sep 17, 2020 Classification General Classification
— Unverified 