SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 226–250 of 302 papers

TitleStatusHype
On scalable oversight with weak LLMs judging strong LLMs—0
Improving Multi-Agent Debate with Sparse Communication Topology—0
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language ModelsCode1
POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models—0
Multimodal Reasoning with Multimodal Knowledge Graph—0
Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning—0
Don't Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal ModelsCode0
M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal ModelsCode0
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models—0
Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning—0
CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal ModelsCode1
AccidentBlip: Agent of Accident Warning based on MA-former—0
Exploring the Transferability of Visual Prompting for Multimodal Large Language ModelsCode1
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V—0
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained ClassificationCode0
Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval—0
A Picture Is Worth a Graph: A Blueprint Debate Paradigm for Multimodal ReasoningCode1
PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual PatternsCode2
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal ReasoningCode2
VEglue: Testing Visual Entailment Systems via Object-Aligned Joint ErasingCode0
All in an Aggregated Image for In-Image LearningCode1
Measuring Vision-Language STEM Skills of Neural ModelsCode0
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis—0
Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics—0
Stop Reasoning! When Multimodal LLM with Chain-of-Thought Reasoning Meets Adversarial ImageCode1
Show:102550
← PrevPage 10 of 13Next →
All datasetsREBUSMATH-VAlgoPuzzleVQA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24—Unverified
2Gemini ProAccuracy13.2—Unverified
3LLaVa-1.5-13BAccuracy1.8—Unverified
4LLaVa-1.5-7BAccuracy1.5—Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9—Unverified
6QWENAccuracy0.9—Unverified
7CogVLMAccuracy0.9—Unverified
8InstructBLIPAccuracy0.6—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76—Unverified
2Gemini ProAccuracy17.66—Unverified
3Qwen-VL-MaxAccuracy15.59—Unverified
4InternLM-XComposer2-VLAccuracy14.54—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3—Unverified