SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Showing 201225 of 302 papers

TitleStatusHype
Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoning0
Hints of Prompt: Enhancing Visual Representation for Multimodal LLMs in Autonomous Driving0
Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual HallucinationCode1
LLaVA-CoT: Let Vision Language Models Reason Step-by-StepCode7
Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization0
Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level0
Towards Low-Resource Harmful Meme Detection with LMM AgentsCode0
Distill Visual Chart Reasoning Ability from LLMs to MLLMsCode2
Understanding the Role of LLMs in Multimodal Evaluation BenchmarksCode0
Learning to Ground VLMs without Forgetting0
An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generation0
NL-Eye: Abductive NLI for Images0
Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Unveiling AI's Potential Through Tools, Techniques, and Applications0
Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning0
JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated ImagesCode0
NVLM: Open Frontier-Class Multimodal LLMs0
Knowledge-Aware Reasoning over Multimodal Semi-structured Tables0
Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical ReasoningCode1
Towards Holistic Disease Risk Prediction using Small Language Models0
DC3DO: Diffusion Classifier for 3D ObjectsCode1
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance0
MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language ModelsCode3
LLMs can be Dangerous Reasoners: Analyzing-based Jailbreak Attack on Large Language ModelsCode1
HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal ReasoningCode1
Controllable Contextualized Image Captioning: Directing the Visual Narrative through User-Defined HighlightsCode0
Show:102550
← PrevPage 9 of 13Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24Unverified
2Gemini ProAccuracy13.2Unverified
3LLaVa-1.5-13BAccuracy1.8Unverified
4LLaVa-1.5-7BAccuracy1.5Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9Unverified
6QWENAccuracy0.9Unverified
7CogVLMAccuracy0.9Unverified
8InstructBLIPAccuracy0.6Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76Unverified
2Gemini ProAccuracy17.66Unverified
3Qwen-VL-MaxAccuracy15.59Unverified
4InternLM-XComposer2-VLAccuracy14.54Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3Unverified