SOTAVerified

Visual Question Answering (VQA)

Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.

Image Source: visualqa.org

Papers

Showing 9511000 of 2167 papers

TitleStatusHype
Pyramid Coder: Hierarchical Code Generator for Compositional Visual Question Answering0
Take A Step Back: Rethinking the Two Stages in Visual Reasoning0
Improved Few-Shot Image Classification Through Multiple-Choice Questions0
Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models0
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person ViewCode0
ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Data0
Multimodal Reranking for Knowledge-Intensive Visual Question Answering0
EchoSight: Advancing Visual-Language Models with Wiki Knowledge0
TM-PATHVQA:90000+ Textless Multilingual Questions for Medical Visual Question Answering0
Extracting Training Data from Document-Based VQA Models0
Segmentation-guided Attention for Visual Question Answering from Remote Sensing Images0
VQA-Diff: Exploiting VQA and Diffusion for Zero-Shot Image-to-3D Vehicle Asset Generation in Autonomous Driving0
Large Language Models Understand LayoutCode0
CLIPVQA:Video Quality Assessment via CLIPCode0
Black-box Model Ensembling for Textual and Visual Question Answering via Information FusionCode0
Visual Robustness Benchmark for Visual Question Answering (VQA)Code0
BACON: Improving Clarity of Image Captions via Bag-of-Concept Graphs0
MindBench: A Comprehensive Benchmark for Mind Map Structure Recognition and Analysis0
D-Rax: Domain-specific Radiologic assistant leveraging multi-modal data and eXpert model predictions0
https://arxiv.org/abs/2407.00634Code0
Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness0
μ-Bench: A Vision-Language Benchmark for Microscopy UnderstandingCode0
Hierarchical Memory for Long Video QA0
SK-VQA: Synthetic Knowledge Generation at Scale for Training Context-Augmented Multimodal LLMs0
Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA0
RAVEN: Multitask Retrieval Augmented Vision-Language Learning0
Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature DistillationCode0
On the Role of Visual Grounding in VQA0
MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs0
Priorformer: A UGC-VQA Method with content and distortion priors0
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts0
Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis0
VGA: Vision GUI Assistant -- Minimizing Hallucinations through Image-Centric Fine-TuningCode0
Biomedical Visual Instruction Tuning with Clinician Preference AlignmentCode0
Diversify, Rationalize, and Combine: Ensembling Multiple QA Strategies for Zero-shot Knowledge-based VQACode0
Beyond Raw Videos: Understanding Edited Videos with Large Multimodal ModelCode0
What is the Visual Cognition Gap between Humans and Multimodal LLMs?Code0
Precision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models0
Optimizing Visual Question Answering Models for Driving: Bridging the Gap Between Human and Machine Attention Patterns0
CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark0
Composition Vision-Language Understanding via Segment and Depth Anything ModelCode0
Understanding Information Storage and Transfer in Multi-modal Large Language Models0
Diffusion-Refined VQA Annotations for Semi-Supervised Gaze FollowingCode0
Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering0
Mixture of Rationale: Multi-Modal Reasoning Mixture for Visual Question Answering0
Selectively Answering Visual Questions0
VQA Training Sets are Self-play Environments for Generating Few-shot Pools0
Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarks0
PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wild0
Privacy-Aware Visual Language Models0
Show:102550
← PrevPage 20 of 44Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1humanAccuracy89.3Unverified
2DREAM+Unicoder-VL (MSRA)Accuracy76.04Unverified
3TRRNet (Ensemble)Accuracy74.03Unverified
4MIL-nbgaoAccuracy73.81Unverified
5Kakao BrainAccuracy73.33Unverified
6Coarse-to-Fine Reasoning, Single ModelAccuracy72.14Unverified
7270Accuracy70.23Unverified
8NSM ensemble (updated)Accuracy67.55Unverified
9VinVL-DPTAccuracy64.92Unverified
10VinVL+LAccuracy64.85Unverified
#ModelMetricClaimedVerifiedStatus
1PaLIAccuracy84.3Unverified
2BEiT-3Accuracy84.19Unverified
3VLMoAccuracy82.78Unverified
4ONE-PEACEAccuracy82.6Unverified
5mPLUG (Huge)Accuracy82.43Unverified
6CuMo-7BAccuracy82.2Unverified
7X2-VLM (large)Accuracy81.9Unverified
8MMUAccuracy81.26Unverified
9LyricsAccuracy81.2Unverified
10InternVL-CAccuracy81.2Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3overall84.03Unverified
2mPLUG-Hugeoverall83.62Unverified
3ONE-PEACEoverall82.52Unverified
4X2-VLM (large)overall81.8Unverified
5VLMooverall81.3Unverified
6SimVLMoverall80.34Unverified
7X2-VLM (base)overall80.2Unverified
8VASToverall80.19Unverified
9VALORoverall78.62Unverified
10Prompt Tuningoverall78.53Unverified