SOTAVerified

Visual Question Answering (VQA)

Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.

Image Source: visualqa.org

Papers

Showing 2650 of 2167 papers

TitleStatusHype
CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video ModelsCode2
Outside Knowledge Conversational Video (OKCV) Dataset -- Dialoguing over VideosCode0
Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal EndoscopyCode0
PhyBlock: A Progressive Benchmark for Physical Understanding and Planning via 3D Block Assembly0
From Pixels to Graphs: using Scene and Knowledge Graphs for HD-EPIC VQA Challenge0
Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue ReasoningCode0
HAIBU-ReMUD: Reasoning Multimodal Ultrasound Dataset and Model Bridging to General Specific DomainsCode0
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning0
Ontology-based knowledge representation for bone disease diagnosis: a foundation for safe and sustainable medical artificial intelligence systems0
ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding0
CoRe-MMRAG: Cross-Source Knowledge Reconciliation for Multimodal RAG0
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering0
MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning0
Vision LLMs Are Bad at Hierarchical Visual Understanding, and LLMs Are the Bottleneck0
Proxy-FDA: Proxy-based Feature Distribution Alignment for Fine-tuning Vision Foundation Models without Forgetting0
VideoCAD: A Large-Scale Video Dataset for Learning UI Interactions and 3D Reasoning from CAD SoftwareCode1
A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis0
MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence0
Spoken question answering for visual queries0
Synthetic Document Question Answering in HungarianCode0
Multi-Sourced Compositional Generalization in Visual Question AnsweringCode0
Interpreting Chest X-rays Like a Radiologist: A Benchmark with Clinical ReasoningCode1
NegVQA: Can Vision Language Models Understand Negation?0
VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language ModelsCode0
FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question AnsweringCode0
Show:102550
← PrevPage 2 of 87Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1humanAccuracy89.3Unverified
2DREAM+Unicoder-VL (MSRA)Accuracy76.04Unverified
3TRRNet (Ensemble)Accuracy74.03Unverified
4MIL-nbgaoAccuracy73.81Unverified
5Kakao BrainAccuracy73.33Unverified
6Coarse-to-Fine Reasoning, Single ModelAccuracy72.14Unverified
7270Accuracy70.23Unverified
8NSM ensemble (updated)Accuracy67.55Unverified
9VinVL-DPTAccuracy64.92Unverified
10VinVL+LAccuracy64.85Unverified
#ModelMetricClaimedVerifiedStatus
1PaLIAccuracy84.3Unverified
2BEiT-3Accuracy84.19Unverified
3VLMoAccuracy82.78Unverified
4ONE-PEACEAccuracy82.6Unverified
5mPLUG (Huge)Accuracy82.43Unverified
6CuMo-7BAccuracy82.2Unverified
7X2-VLM (large)Accuracy81.9Unverified
8MMUAccuracy81.26Unverified
9InternVL-CAccuracy81.2Unverified
10LyricsAccuracy81.2Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3overall84.03Unverified
2mPLUG-Hugeoverall83.62Unverified
3ONE-PEACEoverall82.52Unverified
4X2-VLM (large)overall81.8Unverified
5VLMooverall81.3Unverified
6SimVLMoverall80.34Unverified
7X2-VLM (base)overall80.2Unverified
8VASToverall80.19Unverified
9VALORoverall78.62Unverified
10Prompt Tuningoverall78.53Unverified