Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering Sep 9, 2021 Question Answering Retrieval
Code Code Available GeneAnnotator: A Semi-automatic Annotation Tool for Visual Scene Graph Sep 6, 2021 Graph Generation Graph Learning
Code Code Available WebQA: Multihop and Multimodal QA Sep 1, 2021 Image Retrieval Multimodal Reasoning
Code Code Available SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Aug 24, 2021 Image Captioning Language Modeling
Code Code Available Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception Aug 19, 2021 Action Recognition Image Quality Assessment
Code Code Available X-modaler: A Versatile and High-performance Codebase for Cross-modal Analytics Aug 18, 2021 Cross-Modal Retrieval Decoder
Code Code Available Task-Oriented Multi-User Semantic Communications for VQA Task Aug 16, 2021 Question Answering Semantic Communication
Code Code Available Sparse Continuous Distributions and Fenchel-Young Losses Aug 4, 2021 Audio Classification Question Answering
Code Code Available Check It Again:Progressive Visual Question Answering via Visual Entailment Aug 1, 2021 Question Answering Visual Entailment
Code Code Available Greedy Gradient Ensemble for Robust Visual Question Answering Jul 27, 2021 Question Answering Visual Question Answering
Code Code Available Separating Skills and Concepts for Novel Visual Question Answering Jul 19, 2021 Attribute Contrastive Learning
Code Code Available Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Jul 16, 2021 Cross-Modal Retrieval Grounded language learning
Code Code Available Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question Answering Jul 13, 2021 Navigate Question Answering
Code Code Available How Much Can CLIP Benefit Vision-and-Language Tasks? Jul 13, 2021 Question Answering Vision and Language Navigation
Code Code Available Zero-shot Visual Question Answering using Knowledge Graph Jul 12, 2021 Knowledge Graphs Question Answering
Code Code Available DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question Answering Jul 10, 2021 Graph Attention Question Answering
Code Code Available Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering Jul 6, 2021 Active Learning Object Recognition
Code Code Available NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions Jun 19, 2021 Question Answering Video Question Answering
Code Code Available Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing Jun 19, 2021 Benchmarking DNN Testing
Code Code Available Predicting Human Scanpaths in Visual Question Answering Jun 19, 2021 Deep Reinforcement Learning Question Answering
Code Code Available RSTNet: Captioning With Adaptive Attention on Visual and Non-Visual Words Jun 19, 2021 Decoder Image Captioning
Code Code Available Probing Image-Language Transformers for Verb Understanding Jun 16, 2021 Image Retrieval Question Answering
Code Code Available Check It Again: Progressive Visual Question Answering via Visual Entailment Jun 8, 2021 Question Answering Visual Entailment
Code Code Available Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training May 24, 2021 Image Captioning Medical Visual Question Answering
Code Code Available Multiple Meta-model Quantifying for Medical Visual Question Answering May 19, 2021 Medical Visual Question Answering Meta-Learning
Code Code Available NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actions May 18, 2021 Question Answering Video Question Answering
Code Code Available Found a Reason for me? Weakly-supervised Grounded Visual Question Answering using Capsules May 11, 2021 Question Answering Visual Question Answering
Code Code Available Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning May 10, 2021 Arithmetic Reasoning Geometry Problem Solving
Code Code Available Passage Retrieval for Outside-Knowledge Visual Question Answering May 9, 2021 Image Captioning Object
Code Code Available MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Apr 26, 2021 Generalized Referring Expression Comprehension Phrase Grounding
Code Code Available RelTransformer: A Transformer-Based Long-Tail Visual Relationship Recognition Apr 24, 2021 Image Captioning Object Recognition
Code Code Available GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question Answering Apr 20, 2021 Graph Neural Network Graph Question Answering
Code Code Available Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Apr 7, 2021 Question Answering Visual Question Answering
Code Code Available MMBERT: Multimodal BERT Pretraining for Improved Medical VQA Apr 3, 2021 Language Modeling Language Modelling
Code Code Available VisQA: X-raying Vision and Language Reasoning in Transformers Apr 2, 2021 Question Answering Visual Question Answering
Code Code Available Towards General Purpose Vision Systems Apr 1, 2021 Question Answering Visual Question Answering
Code Code Available Are Bias Mitigation Techniques for Deep Learning Effective? Apr 1, 2021 Deep Learning Question Answering
Code Code Available Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers Mar 29, 2021 Decoder Image Segmentation
Code Code Available SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events Mar 29, 2021 Autonomous Vehicles Benchmarking
Code Code Available On the hidden treasure of dialog in video question answering Mar 26, 2021 Question Answering Video Question Answering
Code Code Available Multi-Modal Answer Validation for Knowledge-Based VQA Mar 23, 2021 Question Answering Retrieval
Code Code Available Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer Feb 18, 2021 Decoder Document Image Classification
Code Code Available SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering Feb 18, 2021 Medical Visual Question Answering Question Answering
Code Code Available Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Feb 17, 2021 Caption Generation Diversity
Code Code Available Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling Feb 11, 2021 Question Answering Retrieval
Code Code Available ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Feb 5, 2021 Cross-Modal Retrieval Image Retrieval
Code Code Available Unifying Vision-and-Language Tasks via Text Generation Feb 4, 2021 Conditional Text Generation Decoder
Code Code Available VisualMRC: Machine Reading Comprehension on Document Images Jan 27, 2021 Machine Reading Comprehension Natural Language Understanding
Code Code Available Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images Jan 1, 2021 Attribute Multiple Instance Learning
Code Code Available TRAR: Routing the Attention Spans in Transformer for Visual Question Answering Jan 1, 2021 Question Answering Referring Expression
Code Code Available 