| Dual Capsule Attention Mask Network with Mutual Learning for Visual Question Answering | Oct 1, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answering | Oct 1, 2022 | Medical Visual Question AnsweringQuestion Answering | CodeCode Available | 0 |
| On the Effects of Video Grounding on Language Models | Oct 1, 2022 | Image CaptioningQuestion Answering | —Unverified | 0 |
| Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering | Sep 30, 2022 | Continual LearningQuestion Answering | CodeCode Available | 0 |
| RepsNet: Combining Vision with Language for Automated Medical Reports | Sep 27, 2022 | Contrastive LearningDecoder | —Unverified | 0 |
| Exploring Modulated Detection Transformer as a Tool for Action Recognition in Videos | Sep 21, 2022 | Action DetectionAction Recognition | CodeCode Available | 0 |
| Continual VQA for Disaster Response Systems | Sep 21, 2022 | Disaster ResponseManagement | CodeCode Available | 0 |
| Toward 3D Spatial Reasoning for Human-like Text-based Visual Question Answering | Sep 21, 2022 | Image CaptioningOptical Character Recognition (OCR) | —Unverified | 0 |
| Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances | Sep 18, 2022 | AttributeQuestion Answering | CodeCode Available | 0 |
| LAVIS: A Library for Language-Vision Intelligence | Sep 15, 2022 | BenchmarkingImage Captioning | —Unverified | 0 |
| Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answering | Sep 14, 2022 | Adversarial RobustnessQuestion Answering | —Unverified | 0 |
| MUST-VQA: MUltilingual Scene-text VQA | Sep 14, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| PaLI: A Jointly-Scaled Multilingual Language-Image Model | Sep 14, 2022 | DecoderFew-Shot Image Classification | —Unverified | 0 |
| PreSTU: Pre-Training for Scene-Text Understanding | Sep 12, 2022 | DecoderImage Captioning | —Unverified | 0 |
| Pre-training image-language transformers for open-vocabulary tasks | Sep 9, 2022 | Question AnsweringVisual Entailment | —Unverified | 0 |
| Improving the Cross-Lingual Generalisation in Visual Question Answering | Sep 7, 2022 | Cross-Lingual TransferQuestion Answering | CodeCode Available | 0 |
| Bidirectional Contrastive Split Learning for Visual Question Answering | Aug 24, 2022 | Adversarial AttackBackdoor Attack | —Unverified | 0 |
| FashionVQA: A Domain-Specific Visual Question Answering System | Aug 24, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| How good are deep models in understanding the generated images? | Aug 23, 2022 | ObjectObject Recognition | —Unverified | 0 |
| Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks | Aug 22, 2022 | AllCross-Modal Retrieval | CodeCode Available | 0 |
| VLMAE: Vision-Language Masked Autoencoder | Aug 19, 2022 | Image-text RetrievalLanguage Modeling | —Unverified | 0 |
| ILLUME: Rationalizing Vision-Language Models through Human Interactions | Aug 17, 2022 | Image CaptioningQuestion Answering | CodeCode Available | 0 |
| Understanding Attention for Vision-and-Language Tasks | Aug 17, 2022 | Image GenerationImage Retrieval | CodeCode Available | 0 |
| Aesthetic Visual Question Answering of Photographs | Aug 10, 2022 | Question AnsweringSentiment Analysis | —Unverified | 0 |
| Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base | Jul 27, 2022 | Question AnsweringSemantic Similarity | —Unverified | 0 |
| Is GPT-3 all you need for Visual Question Answering in Cultural Heritage? | Jul 25, 2022 | AllQuestion Answering | —Unverified | 0 |
| Towards Complex Document Understanding By Discrete Reasoning | Jul 25, 2022 | document understandingQuestion Answering | —Unverified | 0 |
| WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models | Jul 25, 2022 | Common Sense ReasoningGeneral Knowledge | CodeCode Available | 0 |
| Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problem | Jul 24, 2022 | DiagnosticQuestion Answering | —Unverified | 0 |
| Semantic-aware Modular Capsule Routing for Visual Question Answering | Jul 21, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| OVQA: A Clinically Generated Visual Question Answering Dataset | Jul 7, 2022 | BenchmarkingMedical Visual Question Answering | —Unverified | 0 |
| Knowing Earlier what Right Means to You: A Comprehensive VQA Dataset for Grounding Relative Directions via Multi-Task Learning | Jul 6, 2022 | DiagnosticMulti-Task Learning | CodeCode Available | 0 |
| VGNMN: Video-grounded Neural Module Networks for Video-Grounded Dialogue Systems | Jul 1, 2022 | Information RetrievalQuestion Answering | —Unverified | 0 |
| American == White in Multimodal Language-and-Image AI | Jul 1, 2022 | Image CaptioningQuestion Answering | —Unverified | 0 |
| Modern Question Answering Datasets and Benchmarks: A Survey | Jun 30, 2022 | Deep LearningQuestion Answering | —Unverified | 0 |
| EBMs vs. CL: Exploring Self-Supervised Visual Pretraining for Visual Question Answering | Jun 29, 2022 | Contrastive LearningOut of Distribution (OOD) Detection | —Unverified | 0 |
| From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering | Jun 25, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectives | Jun 22, 2022 | Feature ImportanceQuestion Answering | CodeCode Available | 0 |
| Tell Me the Evidence? Dual Visual-Linguistic Interaction for Answer Grounding | Jun 21, 2022 | DecoderQuestion Answering | —Unverified | 0 |
| Grounding Answers for Visual Questions Asked by Visually Impaired People | Jun 20, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| Test-Time Adaptation for Visual Document Understanding | Jun 15, 2022 | document understandingDomain Adaptation | —Unverified | 0 |
| Less Is More: Linear Layers on CLIP Features as Powerful VizWiz Model | Jun 10, 2022 | Question AnsweringTask 2 | —Unverified | 0 |
| cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation | Jun 7, 2022 | Knowledge DistillationQuestion Answering | CodeCode Available | 0 |
| From Pixels to Objects: Cubic Visual Attention for Visual Question Answering | Jun 4, 2022 | ObjectQuestion Answering | —Unverified | 0 |
| VL-BEiT: Generative Vision-Language Pretraining | Jun 2, 2022 | image-classificationImage Classification | —Unverified | 0 |
| Structured Two-stream Attention Network for Video Question Answering | Jun 2, 2022 | Question AnsweringVideo Question Answering | —Unverified | 0 |
| Question Modifiers in Visual Question Answering | Jun 1, 2022 | Natural Language UnderstandingQuestion Answering | —Unverified | 0 |
| Fine-tuning vs From Scratch: Do Vision & Language Models Have Similar Capabilities on Out-of-Distribution Visual Question Answering? | Jun 1, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| Un jeu de données pour répondre à des questions visuelles à propos d’entités nommées en utilisant des bases de connaissances (ViQuAE, a Dataset for Knowledge-based Visual Question Answering about Named Entities) | Jun 1, 2022 | Question AnsweringVisual Question Answering | —Unverified | 0 |
| Visual Superordinate Abstraction for Robust Concept Learning | May 28, 2022 | AttributeQuestion Answering | —Unverified | 0 |