SOTAVerified

Chart Question Answering

Question Answering task on charts images

Papers

Showing 2650 of 50 papers

TitleStatusHype
Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations0
GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering0
MSG-Chart: Multimodal Scene Graph for ChartQACode0
Advancing Chart Question Answering with Robust Chart Component Recognition0
Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness0
Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning? An Extensive Investigation into the Capabilities and Limitations of LVLMs0
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering0
mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning0
Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA0
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs0
Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA0
Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization0
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts0
DCQA: Document-Level Chart Question Answering towards Complex Reasoning and Common-Sense UnderstandingCode0
RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order LogicCode0
Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairs0
DePlot: One-shot visual language reasoning by plot-to-table translationCode0
MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart DerenderingCode0
Chart Question Answering: State of the Art and Future Directions0
STL-CQA: Structure-based Transformers with Localization and Encoding for Chart Question Answering0
PlotQA: Reasoning over Scientific Plots0
Answering Questions about Data Visualizations using Efficient Bimodal FusionCode0
LEAF-QA: Locate, Encode & Attend for Figure Question Answering0
DVQA: Understanding Data Visualizations via Question AnsweringCode0
FigureQA: An Annotated Figure Dataset for Visual ReasoningCode0
Show:102550
← PrevPage 2 of 2Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ChartPaLI-5B + PaLM 2-S1:1 Accuracy81.3Unverified
2Gemini Ultra1:1 Accuracy80.8Unverified
3DePlot+FlanPaLM+Codex (PoT Self-Consistency)1:1 Accuracy79.3Unverified
4ChartPaLI-5B1:1 Accuracy77.3Unverified
5DePlot+Codex (PoT Self-Consistency)1:1 Accuracy76.7Unverified
6ScreenAI 5B (4.62 B params, w/ OCR)1:1 Accuracy76.7Unverified
7SMoLA-PaLI-X Specialist Model1:1 Accuracy74.6Unverified
8SMoLA-PaLI-X Generalist Model1:1 Accuracy73.8Unverified
9MatCha4096 + LaMenDa1:1 Accuracy72.64Unverified
10PaLI-X (Single-task FT w/ OCR)1:1 Accuracy72.3Unverified
#ModelMetricClaimedVerifiedStatus
1MatCha4096 + LaMenDa1:1 Accuracy92.89Unverified
2MatCha1:1 Accuracy91.5Unverified
3DePlot+FlanPaLM+Codex (PoT Self-Consistency)1:1 Accuracy66.6Unverified
4VL-T5-OCR1:1 Accuracy66Unverified
5CRCT1:1 Accuracy55.7Unverified
6VisionTapas-OCR1:1 Accuracy53.9Unverified
#ModelMetricClaimedVerifiedStatus
1vlt5 - 11th ep FineTune1:1 Accuracy0.31Unverified
2Matcha-chartQA1:1 Accuracy0.26Unverified
3crct- 11th ep FineTune1:1 Accuracy0.24Unverified
4vlt5 - baseline1:1 Accuracy0.19Unverified
5crct - baseline1:1 Accuracy0.18Unverified