A survey on knowledge-enhanced multimodal learning Nov 19, 2022 Conditional Image Generation Factual Visual Question Answering
— Unverified CL-CrossVQA: A Continual Learning Benchmark for Cross-Domain Visual Question Answering Nov 19, 2022 Continual Learning Question Answering
— Unverified Visual Programming: Compositional visual reasoning without training Nov 18, 2022 In-Context Learning Question Answering
Code Code Available Text-Aware Dual Routing Network for Visual Question Answering Nov 17, 2022 Optical Character Recognition Optical Character Recognition (OCR)
— Unverified I Can't Believe There's No Images! Learning Visual Tasks Using only Language Supervision Nov 17, 2022 Image Captioning Question Answering
Code Code Available AlignVE: Visual Entailment Recognition Based on Alignment Relations Nov 16, 2022 Question Answering Relation
— Unverified PromptCap: Prompt-Guided Task-Aware Image Captioning Nov 15, 2022 Image Captioning Language Modelling
Code Code Available MapQA: A Dataset for Question Answering on Choropleth Maps Nov 15, 2022 Articles Question Answering
Code Code Available Visually Grounded VQA by Lattice-based Retrieval Nov 15, 2022 Information Retrieval Question Answering
Code Code Available Learning to Answer Multilingual and Code-Mixed Questions Nov 14, 2022 AI Agent Question Answering
— Unverified Why Did the Chicken Cross the Road? Rephrasing and Analyzing Ambiguous Questions in VQA Nov 14, 2022 Question Generation Question-Generation
Code Code Available MF2-MVQA: A Multi-stage Feature Fusion method for Medical Visual Question Answering Nov 11, 2022 Medical Visual Question Answering Question Answering
— Unverified Watching the News: Towards VideoQA Models that can Read Nov 10, 2022 Question Answering Video Question Answering
— Unverified Towards Reasoning-Aware Explainable VQA Nov 9, 2022 Decoder Explanation Generation
— Unverified ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation Nov 9, 2022 Contrastive Learning Decoder
— Unverified Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives Nov 9, 2022 Disentanglement Video Generation
Code Code Available Visual Named Entity Linking: A New Dataset and A Baseline Nov 9, 2022 Entity Linking Image Retrieval
Code Code Available CRIPP-VQA: Counterfactual Reasoning about Implicit Physical Properties via Video Question Answering Nov 7, 2022 Add - PO Add - PQ
Code Code Available Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems Oct 26, 2022 Question Answering Visual Question Answering
— Unverified What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility? Oct 26, 2022 Benchmarking Question Answering
Code Code Available Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering Oct 26, 2022 Question Answering Visual Question Answering
Code Code Available VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge Oct 24, 2022 Question Answering Visual Question Answering
Code Code Available Learning by Hallucinating: Vision-Language Pre-training with Weak Supervision Oct 24, 2022 cross-modal alignment Cross-Modal Retrieval
— Unverified RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Data Oct 23, 2022 Image Captioning Image-text Retrieval
— Unverified PoseScript: Linking 3D Human Poses and Natural Language Oct 21, 2022 Cross-Modal Retrieval Image Captioning
Code Code Available Image Semantic Relation Generation Oct 19, 2022 Image Retrieval Image Segmentation
— Unverified Aligning MAGMA by Few-Shot Learning and Finetuning Oct 18, 2022 Few-Shot Learning Image Captioning
— Unverified Entity-Focused Dense Passage Retrieval for Outside-Knowledge Visual Question Answering Oct 18, 2022 Passage Retrieval Question Answering
— Unverified Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training Oct 17, 2022 Image Captioning Network Interpretation
Code Code Available Meta-Learning via Classifier(-free) Diffusion Guidance Oct 17, 2022 Few-Shot Learning Image Generation
Code Code Available Vision-Language Pre-training: Basics, Recent Advances, and Future Trends Oct 17, 2022 Few-Shot Learning Image Captioning
Code Code Available MAPL: Parameter-Efficient Adaptation of Unimodal Pre-Trained Models for Vision-Language Few-Shot Prompting Oct 13, 2022 Image Captioning Question Answering
Code Code Available ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding Oct 12, 2022 document-image-classification Document Image Classification
Code Code Available SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Models Oct 12, 2022 Object Question Answering
Code Code Available Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessment Oct 11, 2022 Video Quality Assessment Visual Question Answering (VQA)
Code Code Available MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model Oct 11, 2022 Contrastive Learning Image-text matching
Code Code Available Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA Oct 10, 2022 Question Answering Visual Question Answering
Code Code Available DCVQE: A Hierarchical Transformer for Video Quality Assessment Oct 10, 2022 Video Quality Assessment Visual Question Answering (VQA)
— Unverified Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning Oct 10, 2022 Contrastive Learning Question Answering
Code Code Available Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing Oct 10, 2022 Question Answering Representation Learning
— Unverified MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning Oct 9, 2022 Image-text Retrieval multimodal interaction
— Unverified HVS Revisited: A Comprehensive Video Quality Assessment Framework Oct 9, 2022 Video Quality Assessment Visual Question Answering (VQA)
— Unverified Retrieval Augmented Visual Question Answering with Outside Knowledge Oct 7, 2022 Answer Generation Diagnostic
Code Code Available Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding Oct 7, 2022 Chart Question Answering Diversity
Code Code Available Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning Oct 4, 2022 Image Captioning Sentence
Code Code Available Enhancing Interpretability and Interactivity in Robot Manipulation: A Neurosymbolic Approach Oct 3, 2022 Referring Expression Robot Manipulation
Code Code Available On the Effects of Video Grounding on Language Models Oct 1, 2022 Image Captioning Question Answering
— Unverified Dual Capsule Attention Mask Network with Mutual Learning for Visual Question Answering Oct 1, 2022 Question Answering Visual Question Answering
— Unverified A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answering Oct 1, 2022 Medical Visual Question Answering Question Answering
Code Code Available Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering Sep 30, 2022 Continual Learning Question Answering
Code Code Available 