SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 698 papers

TitleStatusHype
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language ModelsCode0
Making History Matter: History-Advantage Sequence Training for Visual Dialog—0
MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning—0
Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection—0
Abductive Symbolic Solver on Abstraction and Reasoning Corpus—0
MAPS: Advancing Multi-Modal Reasoning in Expert-Level Physical Science—0
Visual Commonsense based Heterogeneous Graph Contrastive Learning—0
3D-MoE: A Mixture-of-Experts Multi-modal LLM for 3D Vision and Pose Diffusion via Rectified Flow—0
MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?—0
Visual Entailment: A Novel Task for Fine-Grained Image Understanding—0
Explainable AI And Visual Reasoning: Insights From Radiology—0
Measuring CLEVRness: Black-box Testing of Visual Reasoning Models—0
Measuring CLEVRness: Blackbox testing of Visual Reasoning Models—0
Learning to Assemble Neural Module Tree Networks for Visual Grounding—0
Analysis of Visual Reasoning on One-Stage Object Detection—0
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models—0
MiCo: Multi-image Contrast for Reinforcement Visual Reasoning—0
Visual In-Context Learning for Large Vision-Language Models—0
EXCLAIM: An Explainable Cross-Modal Agentic System for Misinformation Detection with Hierarchical Retrieval—0
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE—0
MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM—0
Leveraging VLM-Based Pipelines to Annotate 3D Objects—0
Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration—0
M-LLM Based Video Frame Selection for Efficient Video Understanding—0
Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark—0
MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning—0
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct—0
EuclidNet: Deep Visual Reasoning for Constructible Problems in Geometry—0
Interactive Visual Reasoning under Uncertainty—0
Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Model—0
MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics?—0
MMSciBench: Benchmarking Language Models on Multimodal Scientific Problems—0
Modeling Gestalt Visual Reasoning on the Raven's Progressive Matrices Intelligence Test Using Generative Image Inpainting Techniques—0
Modelling Working Memory using Deep Recurrent Reinforcement Learning—0
Modularity Matters: Learning Invariant Relational Reasoning Tasks—0
Modulated Self-attention Convolutional Network for VQA—0
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA—0
Enhancing Visual Reasoning with Autonomous Imagination in Multimodal Large Language Models—0
Multi-Granularity Modularized Network for Abstract Visual Reasoning—0
Visual Language Models show widespread visual deficits on neuropsychological tests—0
AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning—0
A Continual Learning Paradigm for Non-differentiable Visual Programming Frameworks on Visual Reasoning Tasks—0
Affordance-Guided Reinforcement Learning via Visual Prompting—0
Enhancing Advanced Visual Reasoning Ability of Large Language Models—0
Multimodal Representations for Teacher-Guided Compositional Visual Reasoning—0
End-to-End Learning of Semantic Grasping—0
Superpixel Semantics Representation and Pre-training for Vision-Language Task—0
End-to-End Chart Summarization via Visual Chain-of-Thought in Vision-Language Models—0
EgoReID: Cross-view Self-Identification and Human Re-identification in Egocentric and Surveillance Videos—0
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues—0
Show:102550
← PrevPage 8 of 14Next →
All datasetsWinogroundNLVR2 DevNLVR2 TestCLEVRERBongard-OpenWorldWinoGAViLVSRPHYRE-1B-CrossPHYRE-1B-WithinVASRIRFL: Image Recognition of Figurative LanguageNLVR

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5—Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25—Unverified
3GPT-4V (pick b/w two options)Text Score69.25—Unverified
4MMICL + CoCoTText Score64.25—Unverified
5GPT-4V + CoCoTText Score58.5—Unverified
6OpenFlamingo + CoCoTText Score58.25—Unverified
7GPT-4VText Score54.5—Unverified
8FIBER (EqSim)Text Score51.5—Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25—Unverified
10MMICL + CCoTText Score51—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51—Unverified
2X2-VLM (large)Accuracy88.7—Unverified
3XFM (base)Accuracy87.6—Unverified
4X2-VLM (base)Accuracy86.2—Unverified
5CoCaAccuracy86.1—Unverified
6VLMoAccuracy85.64—Unverified
7VK-OODAccuracy84.6—Unverified
8SimVLMAccuracy84.53—Unverified
9X-VLM (base)Accuracy84.41—Unverified
10VK-OODAccuracy83.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58—Unverified
2X2-VLM (large)Accuracy89.4—Unverified
3XFM (base)Accuracy88.4—Unverified
4X2-VLM (base)Accuracy87—Unverified
5CoCaAccuracy87—Unverified
6VLMoAccuracy86.86—Unverified
7SimVLMAccuracy85.15—Unverified
8X-VLM (base)Accuracy84.76—Unverified
9BLIP-129MAccuracy83.09—Unverified
10ALBEF (14M)Accuracy82.55—Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24—Unverified
2redherringAverage-per ques.91.14—Unverified
3VRDPAverage-per ques.90.24—Unverified
4FightttttAverage-per ques.88.71—Unverified
5neuralAverage-per ques.88.27—Unverified
6NERVAverage-per ques.88.05—Unverified
7DCLAverage-per ques.75.52—Unverified
8troublesolverAverage-per ques.73.3—Unverified
9v0.1Average-per ques.73.1—Unverified
10First_testAverage-per ques.69.65—Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6—Unverified
2GPT-4o + CA2-Class Accuracy92.8—Unverified
3Human2-Class Accuracy91—Unverified
4SNAIL2-Class Accuracy64—Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8—Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3—Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5—Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3—Unverified
9Otter2-Class Accuracy49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90—Unverified
2ViLT (Zero-Shot)Jaccard Index52—Unverified
3X-VLM (Zero-Shot)Jaccard Index46—Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41—Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40—Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38—Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35—Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15—Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1—Unverified
2ViLTaccuracy69.3—Unverified
3CLIP (finetuned)accuracy65.1—Unverified
4CLIP (frozen)accuracy56—Unverified
5VisualBERTaccuracy55.2—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2—Unverified
2Dec[Joint]1fAUCCESS40.3—Unverified
3Dynamics-Aware DQNAUCCESS39.9—Unverified
4DQNAUCCESS36.8—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS85.2—Unverified
2Dynamics-Aware DQNAUCCESS85.2—Unverified
3Dec[Joint]1fAUCCESS80—Unverified
4DQNAUCCESS77.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9—Unverified
2ConvNeXt1:1 Accuracy51.2—Unverified
3ViT1:1 Accuracy50.3—Unverified
4DEiT1:1 Accuracy47.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100—Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4—Unverified