SOTAVerified|Agents Browse Leaderboard About

Factual Inconsistency Detection in Chart Captioning

Detect factual inconsistency between charts and captions.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1–4 of 4 papers

Title	Date	Tasks	Status	Hype
Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning	Dec 15, 2023	Factual Inconsistency Detection in Chart CaptioningImage Captioning	CodeCode Available	1
Improved Baselines with Visual Instruction Tuning	Oct 5, 2023	Factual Inconsistency Detection in Chart CaptioningImage Classification	CodeCode Available	6
GPT-4 Technical Report	Mar 15, 2023	answerability predictionArithmetic Reasoning	CodeCode Available	6
DePlot: One-shot visual language reasoning by plot-to-table translation	Dec 20, 2022	Chart Question AnsweringFactual Inconsistency Detection in Chart Captioning	CodeCode Available	0

Show:10 25 50

All datasets CHOCOLATE-FT CHOCOLATE-LLM CHOCOLATE-LVLM CHOCOLATE

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Bard (before Gemini)	Kendall's Tau-c	0.29	—	Unverified
2	GPT-4V	Kendall's Tau-c	0.22	—	Unverified
3	ChartVE	Kendall's Tau-c	0.22	—	Unverified
4	LLaVA-1.5-13B	Kendall's Tau-c	0.21	—	Unverified
5	DePlot + GPT-4	Kendall's Tau-c	0.11	—	Unverified