SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 302 papers

TitleStatusHype
Optimus-3: Towards Generalist Multimodal Minecraft Agents with Scalable Task Experts—0
Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning—0
MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning—0
Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual DrawingCode2
ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering—0
Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency—0
KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinations—0
WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement LearningCode1
Play to Generalize: Learning to Reason Through Game PlayCode2
Decoupling the Image Perception and Multimodal Reasoning for Reasoning Segmentation with Digital Twin Representations—0
Learning Compact Vision Tokens for Efficient Large Multimodal ModelsCode1
MORSE-500: A Programmatically Controllable Video Benchmark to Stress-Test Multimodal ReasoningCode1
Look Before You Leap: A GUI-Critic-R1 Model for Pre-Operative Error Diagnosis in GUI Automation—0
MuSciClaims: Multimodal Scientific Claim Verification—0
MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videos—0
Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning—0
MiMo-VL Technical ReportCode4
RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought—0
SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learning—0
GThinker: Towards General Multimodal Reasoning via Cue-Guided RethinkingCode0
MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM—0
Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM AgentsCode2
Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic TasksCode1
Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model—0
Infi-Med: Low-Resource Medical MLLMs with Robust Reasoning Evaluation—0
Show:102550
← PrevPage 2 of 13Next →
All datasetsREBUSMATH-VAlgoPuzzleVQA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24—Unverified
2Gemini ProAccuracy13.2—Unverified
3LLaVa-1.5-13BAccuracy1.8—Unverified
4LLaVa-1.5-7BAccuracy1.5—Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9—Unverified
6QWENAccuracy0.9—Unverified
7CogVLMAccuracy0.9—Unverified
8InstructBLIPAccuracy0.6—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76—Unverified
2Gemini ProAccuracy17.66—Unverified
3Qwen-VL-MaxAccuracy15.59—Unverified
4InternLM-XComposer2-VLAccuracy14.54—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3—Unverified