SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 698 papers

TitleStatusHype
Enhancing Visual Reasoning with Autonomous Imagination in Multimodal Large Language Models—0
Visual Contexts Clarify Ambiguous Expressions: A Benchmark DatasetCode0
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios—0
Beyond Visual Understanding: Introducing PARROT-360V for Vision Language Model Benchmarking—0
Automated 3D Physical Simulation of Open-world Scene with Gaussian Splatting—0
On Erroneous Agreements of CLIP Image EmbeddingsCode0
Bootstrapping Top-down Information for Self-modulating Slot Attention—0
Reasoning Limitations of Multimodal Large Language Models. A case study of Bongard Problems—0
Replace-then-Perturb: Targeted Adversarial Attacks With Visual Reasoning for Vision-Language Models—0
VisAidMath: Benchmarking Visual-Aided Mathematical Reasoning—0
Improving Generalization in Visual Reasoning via Self-Ensemble—0
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?Code0
ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom—0
MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes BenchmarkCode0
ForgeryGPT: Multimodal Large Language Model For Explainable Image Forgery Detection and Localization—0
TVBench: Redesigning Video-Language Evaluation—0
Transformers Utilization in Chart Understanding: A Review of Recent Advances & Future Trends—0
Mind the GAP: Glimpse-based Active Perception improves generalization and sample efficiency of visual reasoningCode0
GSON: A Group-based Social Navigation Framework with Large Multimodal Model—0
Advancing Object Detection in Transportation with Multimodal Large Language Models (MLLMs): A Comprehensive Review and Empirical Testing—0
Enhancing Advanced Visual Reasoning Ability of Large Language Models—0
Impact of ML Optimization Tactics on Greener Pre-Trained ML Models—0
JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated ImagesCode0
What Makes a Maze Look Like a Maze?—0
Critical Features Tracking on Triangulated Irregular Networks by a Scale-Space Method—0
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct—0
How to Determine the Preferred Image Distribution of a Black-Box Vision-Language Model?Code0
Zero-Shot Visual Reasoning by Vision-Language Models: Benchmarking and Analysis—0
Multi-Modal Dialogue State Tracking for Playing GuessWhich GameCode0
ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling—0
Compromising Embodied Agents with Contextual Backdoor Attacks—0
ExoViP: Step-by-step Verification and Exploration with Exoskeleton Modules for Compositional Visual Reasoning—0
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain GapCode0
Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM—0
Pyramid Coder: Hierarchical Code Generator for Compositional Visual Question Answering—0
Take A Step Back: Rethinking the Two Stages in Visual Reasoning—0
Untrained neural networks can demonstrate memorization-independent abstract reasoningCode0
Can VLMs be used on videos for action recognition? LLMs are Visual Reasoning Coordinators—0
I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction—0
Open-World Visual Reasoning by a Neuro-Symbolic Program of Zero-Shot Symbols—0
X-Former: Unifying Contrastive and Reconstruction Learning for MLLMs—0
SwitchCIT: Switching for Continual Instruction Tuning—0
NTSEBENCH: Cognitive Reasoning Benchmark for Vision Language Models—0
Affordance-Guided Reinforcement Learning via Visual Prompting—0
NODE-Adapter: Neural Ordinary Differential Equations for Better Vision-Language Reasoning—0
MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics?—0
Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA—0
Visual Reasoning and Multi-Agent Approach in Multimodal Large Language Models (MLLMs): Solving TSP and mTSP Combinatorial ChallengesCode0
Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration—0
Beyond the Doors of Perception: Vision Transformers Represent Relations Between ObjectsCode0
Show:102550
← PrevPage 8 of 14Next →
All datasetsWinogroundNLVR2 DevNLVR2 TestCLEVRERBongard-OpenWorldWinoGAViLVSRPHYRE-1B-CrossPHYRE-1B-WithinVASRIRFL: Image Recognition of Figurative LanguageNLVR

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5—Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25—Unverified
3GPT-4V (pick b/w two options)Text Score69.25—Unverified
4MMICL + CoCoTText Score64.25—Unverified
5GPT-4V + CoCoTText Score58.5—Unverified
6OpenFlamingo + CoCoTText Score58.25—Unverified
7GPT-4VText Score54.5—Unverified
8FIBER (EqSim)Text Score51.5—Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25—Unverified
10MMICL + CCoTText Score51—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51—Unverified
2X2-VLM (large)Accuracy88.7—Unverified
3XFM (base)Accuracy87.6—Unverified
4X2-VLM (base)Accuracy86.2—Unverified
5CoCaAccuracy86.1—Unverified
6VLMoAccuracy85.64—Unverified
7VK-OODAccuracy84.6—Unverified
8SimVLMAccuracy84.53—Unverified
9X-VLM (base)Accuracy84.41—Unverified
10VK-OODAccuracy83.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58—Unverified
2X2-VLM (large)Accuracy89.4—Unverified
3XFM (base)Accuracy88.4—Unverified
4X2-VLM (base)Accuracy87—Unverified
5CoCaAccuracy87—Unverified
6VLMoAccuracy86.86—Unverified
7SimVLMAccuracy85.15—Unverified
8X-VLM (base)Accuracy84.76—Unverified
9BLIP-129MAccuracy83.09—Unverified
10ALBEF (14M)Accuracy82.55—Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24—Unverified
2redherringAverage-per ques.91.14—Unverified
3VRDPAverage-per ques.90.24—Unverified
4FightttttAverage-per ques.88.71—Unverified
5neuralAverage-per ques.88.27—Unverified
6NERVAverage-per ques.88.05—Unverified
7DCLAverage-per ques.75.52—Unverified
8troublesolverAverage-per ques.73.3—Unverified
9v0.1Average-per ques.73.1—Unverified
10First_testAverage-per ques.69.65—Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6—Unverified
2GPT-4o + CA2-Class Accuracy92.8—Unverified
3Human2-Class Accuracy91—Unverified
4SNAIL2-Class Accuracy64—Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8—Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3—Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5—Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3—Unverified
9Otter2-Class Accuracy49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90—Unverified
2ViLT (Zero-Shot)Jaccard Index52—Unverified
3X-VLM (Zero-Shot)Jaccard Index46—Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41—Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40—Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38—Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35—Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15—Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1—Unverified
2ViLTaccuracy69.3—Unverified
3CLIP (finetuned)accuracy65.1—Unverified
4CLIP (frozen)accuracy56—Unverified
5VisualBERTaccuracy55.2—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2—Unverified
2Dec[Joint]1fAUCCESS40.3—Unverified
3Dynamics-Aware DQNAUCCESS39.9—Unverified
4DQNAUCCESS36.8—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS85.2—Unverified
2Dynamics-Aware DQNAUCCESS85.2—Unverified
3Dec[Joint]1fAUCCESS80—Unverified
4DQNAUCCESS77.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9—Unverified
2ConvNeXt1:1 Accuracy51.2—Unverified
3ViT1:1 Accuracy50.3—Unverified
4DEiT1:1 Accuracy47.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100—Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4—Unverified