SOTAVerified

Visual Question Answering (VQA)

Visual Question Answering (VQA) is a task in computer vision that involves answering questions about an image. The goal of VQA is to teach machines to understand the content of an image and answer questions about it in natural language.

Image Source: visualqa.org

Papers

Showing 101–125 of 2167 papers

TitleStatusHype
MTVQA: Benchmarking Multilingual Text-Centric Visual Question AnsweringCode2
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-ExpertsCode2
NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and ResultsCode2
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language ModelsCode2
Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language ModelsCode2
MedPromptX: Grounded Multimodal Prompting for Chest X-ray DiagnosisCode2
vid-TLDR: Training Free Token merging for Light-weight Video TransformerCode2
VL-ICL Bench: The Devil in the Details of Multimodal In-Context LearningCode2
CoLLaVO: Crayon Large Language and Vision mOdelCode2
KVQ: Kwai Video Quality Assessment for Short-form VideosCode2
ScreenAI: A Vision-Language Model for UI and Infographics UnderstandingCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical ImagingCode2
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined LevelsCode2
HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language ModelsCode2
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question AnsweringCode2
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual QuestionsCode2
TeCH: Text-guided Reconstruction of Lifelike Clothed HumansCode2
Med-Flamingo: a Multimodal Medical Few-shot LearnerCode2
GPT4RoI: Instruction Tuning Large Language Model on Region-of-InterestCode2
LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image UnderstandingCode2
Shikra: Unleashing Multimodal LLM's Referential Dialogue MagicCode2
Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningCode2
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and DatasetCode2
NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving ScenarioCode2
Show:102550
← PrevPage 5 of 87Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1humanAccuracy89.3—Unverified
2DREAM+Unicoder-VL (MSRA)Accuracy76.04—Unverified
3TRRNet (Ensemble)Accuracy74.03—Unverified
4MIL-nbgaoAccuracy73.81—Unverified
5Kakao BrainAccuracy73.33—Unverified
6Coarse-to-Fine Reasoning, Single ModelAccuracy72.14—Unverified
7270Accuracy70.23—Unverified
8NSM ensemble (updated)Accuracy67.55—Unverified
9VinVL-DPTAccuracy64.92—Unverified
10VinVL+LAccuracy64.85—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLIAccuracy84.3—Unverified
2BEiT-3Accuracy84.19—Unverified
3VLMoAccuracy82.78—Unverified
4ONE-PEACEAccuracy82.6—Unverified
5mPLUG (Huge)Accuracy82.43—Unverified
6CuMo-7BAccuracy82.2—Unverified
7X2-VLM (large)Accuracy81.9—Unverified
8MMUAccuracy81.26—Unverified
9InternVL-CAccuracy81.2—Unverified
10LyricsAccuracy81.2—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3overall84.03—Unverified
2mPLUG-Hugeoverall83.62—Unverified
3ONE-PEACEoverall82.52—Unverified
4X2-VLM (large)overall81.8—Unverified
5VLMooverall81.3—Unverified
6SimVLMoverall80.34—Unverified
7X2-VLM (base)overall80.2—Unverified
8VASToverall80.19—Unverified
9VALORoverall78.62—Unverified
10Prompt Tuningoverall78.53—Unverified