SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Showing 101125 of 302 papers

TitleStatusHype
MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at ScaleCode1
Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic CognitionCode1
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and GenerationCode1
Exploring the Transferability of Visual Prompting for Multimodal Large Language ModelsCode1
LLMs can be Dangerous Reasoners: Analyzing-based Jailbreak Attack on Large Language ModelsCode1
Fine-Grained Visual EntailmentCode1
Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical ReasoningCode1
Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual GroundingCode1
Improving Multi-Agent Debate with Sparse Communication Topology0
CutPaste&Find: Efficient Multimodal Hallucination Detector with Visual-aid Knowledge Base0
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models0
Critique Before Thinking: Mitigating Hallucination through Rationale-Augmented Instruction Tuning0
Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoning0
Hints of Prompt: Enhancing Visual Representation for Multimodal LLMs in Autonomous Driving0
Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine0
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence0
Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought0
GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning0
GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning0
GeoGuess: Multimodal Reasoning based on Hierarchy of Visual Information in Street View0
COSINT-Agent: A Knowledge-Driven Multimodal Agent for Chinese Open Source Intelligence0
Learning from Inside: Self-driven Siamese Sampling and Reasoning for Video Question Answering0
GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning0
Improving Pre-trained Vision-and-Language Embeddings for Phrase Grounding0
FinLMM-R1: Enhancing Financial Reasoning in LMM through Scalable Data and Reward Design0
Show:102550
← PrevPage 5 of 13Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24Unverified
2Gemini ProAccuracy13.2Unverified
3LLaVa-1.5-13BAccuracy1.8Unverified
4LLaVa-1.5-7BAccuracy1.5Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9Unverified
6QWENAccuracy0.9Unverified
7CogVLMAccuracy0.9Unverified
8InstructBLIPAccuracy0.6Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76Unverified
2Gemini ProAccuracy17.66Unverified
3Qwen-VL-MaxAccuracy15.59Unverified
4InternLM-XComposer2-VLAccuracy14.54Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3Unverified