SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–275 of 302 papers

TitleStatusHype
Knowledge-Aware Reasoning over Multimodal Semi-structured Tables—0
Towards Holistic Disease Risk Prediction using Small Language Models—0
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance—0
Controllable Contextualized Image Captioning: Directing the Visual Narrative through User-Defined HighlightsCode0
On scalable oversight with weak LLMs judging strong LLMs—0
Improving Multi-Agent Debate with Sparse Communication Topology—0
POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models—0
Multimodal Reasoning with Multimodal Knowledge Graph—0
Don't Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal ModelsCode0
Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning—0
M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal ModelsCode0
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models—0
Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning—0
AccidentBlip: Agent of Accident Warning based on MA-former—0
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V—0
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained ClassificationCode0
Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval—0
VEglue: Testing Visual Entailment Systems via Object-Aligned Joint ErasingCode0
Measuring Vision-Language STEM Skills of Neural ModelsCode0
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis—0
Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics—0
BBA: Bi-Modal Behavioral Alignment for Reasoning with Large Vision-Language Models—0
Question Aware Vision Transformer for Multimodal Reasoning—0
On the generalization capacity of neural networks during generic multimodal reasoningCode0
Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine—0
Show:102550
← PrevPage 11 of 13Next →
All datasetsREBUSMATH-VAlgoPuzzleVQA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24—Unverified
2Gemini ProAccuracy13.2—Unverified
3LLaVa-1.5-13BAccuracy1.8—Unverified
4LLaVa-1.5-7BAccuracy1.5—Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9—Unverified
6QWENAccuracy0.9—Unverified
7CogVLMAccuracy0.9—Unverified
8InstructBLIPAccuracy0.6—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76—Unverified
2Gemini ProAccuracy17.66—Unverified
3Qwen-VL-MaxAccuracy15.59—Unverified
4InternLM-XComposer2-VLAccuracy14.54—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3—Unverified