SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 302 papers

TitleStatusHype
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal ReasoningCode2
Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM AgentsCode2
The Jumping Reasoning Curve? Tracking the Evolution of Reasoning Performance in GPT-[n] and o-[n] Models on Multimodal PuzzlesCode2
Distill Visual Chart Reasoning Ability from LLMs to MLLMsCode2
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and GenerationCode1
Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical FindingsCode1
LogicOCR: Do Your Large Multimodal Models Excel at Logical Reasoning on Text-Rich Images?Code1
Advancing Multimodal Reasoning via Reinforcement Learning with Cold StartCode1
ARB: A Comprehensive Arabic Multimodal Reasoning BenchmarkCode1
MORSE-500: A Programmatically Controllable Video Benchmark to Stress-Test Multimodal ReasoningCode1
CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language ModelsCode1
DC3DO: Diffusion Classifier for 3D ObjectsCode1
CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal ModelsCode1
Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation CapabilitiesCode1
Learning Compact Vision Tokens for Efficient Large Multimodal ModelsCode1
A Picture Is Worth a Graph: A Blueprint Debate Paradigm for Multimodal ReasoningCode1
3MDBench: Medical Multimodal Multi-agent Dialogue BenchmarkCode1
MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension TasksCode1
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought VerificationCode1
A Multimodal Framework for the Detection of Hateful MemesCode1
How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape GameCode1
HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal ReasoningCode1
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language ModelsCode1
Breaking the Data Barrier -- Building GUI Agents Through Task GeneralizationCode1
Boosting the Power of Small Multimodal Reasoning Models to Match Larger Models with Self-Consistency TrainingCode1
Show:102550
← PrevPage 3 of 13Next →
All datasetsREBUSMATH-VAlgoPuzzleVQA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24—Unverified
2Gemini ProAccuracy13.2—Unverified
3LLaVa-1.5-13BAccuracy1.8—Unverified
4LLaVa-1.5-7BAccuracy1.5—Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9—Unverified
6QWENAccuracy0.9—Unverified
7CogVLMAccuracy0.9—Unverified
8InstructBLIPAccuracy0.6—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76—Unverified
2Gemini ProAccuracy17.66—Unverified
3Qwen-VL-MaxAccuracy15.59—Unverified
4InternLM-XComposer2-VLAccuracy14.54—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3—Unverified