GPT-4V-AD: Exploring Grounding Potential of VQA-oriented GPT-4V for Zero-shot Anomaly Detection Nov 5, 2023 Anomaly Detection Question Answering
Code Code Available From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities Nov 1, 2023 Navigate Question Answering
— Unverified VQA-GEN: A Visual Question Answering Benchmark for Domain Generalization Nov 1, 2023 Domain Generalization Question Answering
— Unverified A Systematic Evaluation of GPT-4V's Multimodal Capability for Medical Image Analysis Oct 31, 2023 Descriptive Medical Image Analysis
— Unverified Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts Oct 31, 2023 Image Captioning Language Modeling
Code Code Available Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V Oct 29, 2023 Diagnostic Language Modeling
Code Code Available Dynamic Task and Weight Prioritization Curriculum Learning for Multimodal Imagery Oct 29, 2023 Deep Learning Multimodal Deep Learning
Code Code Available EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Images Oct 28, 2023 Decision Making Medical Visual Question Answering
Code Code Available 3D-Aware Visual Question Answering about Parts, Poses and Occlusions Oct 27, 2023 Question Answering Visual Question Answering
Code Code Available ViCLEVR: A Visual Reasoning Dataset and Hybrid Multimodal Fusion Model for Visual Question Answering in Vietnamese Oct 27, 2023 Information Retrieval Natural Language Queries
Code Code Available Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation Oct 27, 2023 Image Generation Question Answering
— Unverified Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs Oct 26, 2023 Attribute Machine Translation
Code Code Available Exploring Question Decomposition for Zero-Shot VQA Oct 25, 2023 Question Answering Visual Question Answering
— Unverified Geometry-Aware Video Quality Assessment for Dynamic Digital Human Oct 24, 2023 Attribute Video Quality Assessment
— Unverified Towards Perceiving Small Visual Details in Zero-shot Visual Question Answering with Multimodal LLMs Oct 24, 2023 Question Answering Visual Question Answering
Code Code Available Large Language Models are Temporal and Causal Reasoners for Video Question Answering Oct 24, 2023 Natural Language Understanding Question Answering
Code Code Available LXMERT Model Compression for Visual Question Answering Oct 23, 2023 model Model Compression
Code Code Available HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models Oct 23, 2023 Diagnostic Hallucination
Code Code Available A Simple Baseline for Knowledge-Based Visual Question Answering Oct 20, 2023 In-Context Learning Question Answering
Code Code Available RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answering Oct 19, 2023 Image Captioning Question Answering
Code Code Available UNK-VQA: A Dataset and a Probe into the Abstention Ability of Multi-modal Large Models Oct 17, 2023 Attribute Question Answering
Code Code Available VLIS: Unimodal Language Models Guide Multimodal Language Generation Oct 15, 2023 Caption Generation Explanation Generation
Code Code Available PaLI-3 Vision Language Models: Smaller, Faster, Stronger Oct 13, 2023 Chart Question Answering Cross-Modal Retrieval
Code Code Available Exploring Sparse Spatial Relation in Graph Inference for Text-Based VQA Oct 13, 2023 Graph Learning Object
— Unverified Open-Set Knowledge-Based Visual Question Answering with Inference Paths Oct 12, 2023 Knowledge Graphs Multi-class Classification
Code Code Available Improving mitosis detection on histopathology images using large vision-language models Oct 11, 2023 Domain Generalization Image Captioning
— Unverified Jaeger: A Concatenation-Based Multi-Transformer VQA Model Oct 11, 2023 Dimensionality Reduction model
— Unverified Off-Policy Evaluation for Human Feedback Oct 11, 2023 Off-policy evaluation Reinforcement Learning (RL)
— Unverified How (not) to ensemble LVLMs for VQA Oct 10, 2023 Retrieval Visual Question Answering (VQA)
— Unverified What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models Oct 10, 2023 Benchmarking Code Generation
Code Code Available Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models Oct 9, 2023 Language Modelling Question Answering
Code Code Available Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answering Oct 9, 2023 Answer Generation Question Answering
— Unverified Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models Oct 9, 2023 Hallucination Object
— Unverified Improved Baselines with Visual Instruction Tuning Oct 5, 2023 Factual Inconsistency Detection in Chart Captioning Image Classification
Code Code Available Improving Automatic VQA Evaluation Using Large Language Models Oct 4, 2023 In-Context Learning Question Answering
— Unverified On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study Oct 4, 2023 Question Answering Visual Question Answering
— Unverified HallE-Control: Controlling Object Hallucination in Large Multimodal Models Oct 3, 2023 Attribute Decoder
Code Code Available SelfGraphVQA: A Self-Supervised Graph Neural Network for Scene-based Question Answering Oct 3, 2023 Graph Neural Network Question Answering
— Unverified Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Models Oct 3, 2023 Image Generation Visual Question Answering (VQA)
Code Code Available Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context Learning Oct 1, 2023 In-Context Learning Instruction Following
Code Code Available Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question Answering Sep 29, 2023 Image to text Passage Retrieval
Code Code Available ELIP: Efficient Language-Image Pre-training with Fewer Vision Tokens Sep 28, 2023 Cross-Modal Retrieval GPU
Code Code Available Tackling VQA with Pretrained Foundation Models without Further Training Sep 27, 2023 Question Answering Visual Question Answering
— Unverified InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition Sep 26, 2023 Articles Image Comprehension
Code Code Available Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attacks Sep 24, 2023 Video Quality Assessment Visual Question Answering (VQA)
Code Code Available Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis Sep 21, 2023 Cross-Modal Retrieval Image Captioning
Code Code Available Sentence Attention Blocks for Answer Grounding Sep 20, 2023 Question Answering Sentence
— Unverified Visual Question Answering in the Medical Domain Sep 20, 2023 Contrastive Learning Medical Visual Question Answering
— Unverified Syntax Tree Constrained Graph Network for Visual Question Answering Sep 17, 2023 Question Answering Visual Question Answering
— Unverified D3: Data Diversity Design for Systematic Generalization in Visual Question Answering Sep 15, 2023 Diversity Question Answering
Code Code Available 