SOTAVerified|Agents Browse Leaderboard About

Chart Question Answering

Question Answering task on charts images

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 21–30 of 50 papers

Title	Date	Tasks	Status	Hype	Score
DePlot: One-shot visual language reasoning by plot-to-table translation	Dec 20, 2022	Chart Question AnsweringFactual Inconsistency Detection in Chart Captioning	CodeCode Available	0	5
MSG-Chart: Multimodal Scene Graph for ChartQA	Aug 9, 2024	Chart Question AnsweringInductive Bias	CodeCode Available	0	5
RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logic	Aug 3, 2023	Chart Question AnsweringFormal Logic	CodeCode Available	0	5
DCQA: Document-Level Chart Question Answering towards Complex Reasoning and Common-Sense Understanding	Oct 29, 2023	Answer GenerationChart Question Answering	CodeCode Available	0	5
ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart Understanding	May 21, 2025	Chart Question AnsweringChart Understanding	CodeCode Available	0	5
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts	Dec 1, 2023	Chart Question AnsweringDocument AI	—Unverified	0	0
Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMs	Jun 1, 2024	Chart Question AnsweringChart Understanding	—Unverified	0	0
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs	Mar 19, 2024	Chart Question AnsweringOptical Character Recognition (OCR)	—Unverified	0	0
ChartCitor: Multi-Agent Framework for Fine-Grained Chart Visual Attribution	Feb 3, 2025	Chart Question AnsweringQuestion Answering	—Unverified	0	0
Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations	Sep 27, 2024	Chart Question AnsweringQuestion Answering	—Unverified	0	0

Show:10 25 50

← PrevPage 3 of 5Next →

All datasets ChartQA PlotQA RealCQA

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ChartPaLI-5B + PaLM 2-S	1:1 Accuracy	81.3	—	Unverified
2	Gemini Ultra	1:1 Accuracy	80.8	—	Unverified
3	DePlot+FlanPaLM+Codex (PoT Self-Consistency)	1:1 Accuracy	79.3	—	Unverified
4	ChartPaLI-5B	1:1 Accuracy	77.3	—	Unverified
5	DePlot+Codex (PoT Self-Consistency)	1:1 Accuracy	76.7	—	Unverified
6	ScreenAI 5B (4.62 B params, w/ OCR)	1:1 Accuracy	76.7	—	Unverified
7	SMoLA-PaLI-X Specialist Model	1:1 Accuracy	74.6	—	Unverified
8	SMoLA-PaLI-X Generalist Model	1:1 Accuracy	73.8	—	Unverified
9	MatCha4096 + LaMenDa	1:1 Accuracy	72.64	—	Unverified
10	PaLI-X (Single-task FT w/ OCR)	1:1 Accuracy	72.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MatCha4096 + LaMenDa	1:1 Accuracy	92.89	—	Unverified
2	MatCha	1:1 Accuracy	91.5	—	Unverified
3	DePlot+FlanPaLM+Codex (PoT Self-Consistency)	1:1 Accuracy	66.6	—	Unverified
4	VL-T5-OCR	1:1 Accuracy	66	—	Unverified
5	CRCT	1:1 Accuracy	55.7	—	Unverified
6	VisionTapas-OCR	1:1 Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	vlt5 - 11th ep FineTune	1:1 Accuracy	0.31	—	Unverified
2	Matcha-chartQA	1:1 Accuracy	0.26	—	Unverified
3	crct- 11th ep FineTune	1:1 Accuracy	0.24	—	Unverified
4	vlt5 - baseline	1:1 Accuracy	0.19	—	Unverified
5	crct - baseline	1:1 Accuracy	0.18	—	Unverified