SOTAVerified

Multimodal Reasoning

Reasoning over multimodal inputs.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 302 papers

TitleStatusHype
Measuring Multimodal Mathematical Reasoning with MATH-Vision DatasetCode2
BBA: Bi-Modal Behavioral Alignment for Reasoning with Large Vision-Language Models—0
Question Aware Vision Transformer for Multimodal Reasoning—0
CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular FusionCode2
On the generalization capacity of neural networks during generic multimodal reasoningCode0
Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine—0
Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning—0
Towards a Unified Multimodal Reasoning FrameworkCode0
Assessing GPT4-V on Structured Reasoning Tasks—0
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language ModelsCode1
Boosting the Power of Small Multimodal Reasoning Models to Match Larger Models with Self-Consistency TrainingCode1
Apollo: Zero-shot MultiModal Reasoning with Multiple ExpertsCode0
DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models—0
MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension TasksCode1
DOMINO: A Dual-System for Multi-step Visual Language ReasoningCode1
Enhancing Human-like Multi-Modal Reasoning: A New Challenging Dataset and Comprehensive FrameworkCode1
Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language ModelsCode3
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and GenerationCode1
Personality-aware Human-centric Multimodal Reasoning: A New Task, Dataset and Baselines—0
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and ActionCode2
AutoFraudNet: A Multimodal Network to Detect Fraud in the Auto Insurance Industry—0
Variational Causal Inference Network for Explanatory Visual Question AnsweringCode1
Modal-specific Pseudo Query Generation for Video Corpus Moment RetrievalCode0
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
Multimodal Analogical Reasoning over Knowledge GraphsCode2
Deep Neural Networks for Visual Reasoning—0
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringCode2
Reducing the Vision and Language Bias for Temporal Sentence Grounding—0
DisinfoMeme: A Multimodal Dataset for Detecting Meme Intentionally Spreading Out Disinformation—0
Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguageCode0
Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?Code0
Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual GroundingCode1
Fine-Grained Visual EntailmentCode1
PACS: A Dataset for Physical Audiovisual CommonSense ReasoningCode1
Learning from Inside: Self-driven Siamese Sampling and Reasoning for Video Question Answering—0
Improving Pre-trained Vision-and-Language Embeddings for Phrase Grounding—0
TxT: Crossmodal End-to-End Learning with Transformers—0
WebQA: Multihop and Multimodal QACode1
Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal VisionCode1
C^3: Compositional Counterfactual Contrastive Learning for Video-grounded Dialogues—0
MERLOT: Multimodal Neural Script Knowledge ModelsCode1
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues—0
Visual Goal-Step Inference using wikiHowCode0
UniT: Multimodal Multitask Learning with a Unified TransformerCode0
DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents—0
A Multimodal Framework for the Detection of Hateful MemesCode1
Sound2Sight: Generating Visual Dynamics from Sound and Context—0
e-SNLI-VE: Corrected Visual-Textual Entailment with Natural Language ExplanationsCode1
DMRM: A Dual-channel Multi-hop Reasoning Model for Visual DialogCode0
Multimodal Transformer with Multi-View Visual Representation for Image Captioning—0
Show:102550
← PrevPage 6 of 7Next →
All datasetsREBUSMATH-VAlgoPuzzleVQA

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4VAccuracy24—Unverified
2Gemini ProAccuracy13.2—Unverified
3LLaVa-1.5-13BAccuracy1.8—Unverified
4LLaVa-1.5-7BAccuracy1.5—Unverified
5BLIP2-FLAN-T5-XXLAccuracy0.9—Unverified
6QWENAccuracy0.9—Unverified
7CogVLMAccuracy0.9—Unverified
8InstructBLIPAccuracy0.6—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT4VAccuracy22.76—Unverified
2Gemini ProAccuracy17.66—Unverified
3Qwen-VL-MaxAccuracy15.59—Unverified
4InternLM-XComposer2-VLAccuracy14.54—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Acc30.3—Unverified