SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 601–650 of 698 papers

TitleStatusHype
VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity—0
Towards Explainable Neural-Symbolic Visual Reasoning—0
HENASY: Learning to Assemble Scene-Entities for Egocentric Video-Language Model—0
HalluSegBench: Counterfactual Visual Reasoning for Segmentation Hallucination Evaluation—0
Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learning—0
VGR: Visual Grounded Reasoning—0
Guiding Visual Question Answering with Attention Priors—0
GSR-BENCH: A Benchmark for Grounded Spatial Reasoning Evaluation via Multimodal LLMs—0
I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction—0
Abstract Diagrammatic Reasoning with Multiplex Graph Networks—0
Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks—0
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models—0
GSON: A Group-based Social Navigation Framework with Large Multimodal Model—0
Video Captioning Using Weak Annotation—0
Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning—0
Impact of ML Optimization Tactics on Greener Pre-Trained ML Models—0
Compromising Embodied Agents with Contextual Backdoor Attacks—0
Improving Generalization in Visual Reasoning via Self-Ensemble—0
Improving Scene Graph Classification by Exploiting Knowledge from Texts—0
Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs—0
Grounding Physical Object and Event Concepts Through Dynamic Visual Reasoning—0
INFERNO: Inferring Object-Centric 3D Scene Representations without Supervision—0
A Survey on Multimodal Large Language Models—0
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning—0
Grounded Reinforcement Learning for Visual Reasoning—0
Integrating LMM Planners and 3D Skill Policies for Generalizable Manipulation—0
GRIT: Teaching MLLMs to Think with Images—0
Graph Representation for Order-Aware Visual Transformation—0
Interpretable Visual Reasoning via Probabilistic Formulation under Natural Supervision—0
ViLEM: Visual-Language Error Modeling for Image-Text Retrieval—0
Grammar-Based Grounded Lexicon Learning—0
Introduction to Soar—0
A survey on knowledge-enhanced multimodal learning—0
GenVP: Generating Visual Puzzles with Contrastive Hierarchical VAEs—0
Generate Subgoal Images before Act: Unlocking the Chain-of-Thought Reasoning in Diffusion Model for Robot Manipulation with Multimodal Prompts—0
Iterative Search for Weakly Supervised Semantic Parsing—0
Iterative Visual Reasoning Beyond Convolutions—0
It's Not About the Journey; It's About the Destination: Following Soft Paths Under Question-Guidance for Visual Reasoning—0
A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Law—0
Jointly Visual- and Semantic-Aware Graph Memory Networks for Temporal Sentence Localization in Videos—0
ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling—0
ExoViP: Step-by-step Verification and Exploration with Exoskeleton Modules for Compositional Visual Reasoning—0
`Just because you are right, doesn't mean I am wrong': Overcoming a bottleneck in development and evaluation of Open-Ended VQA tasks—0
Just Say the Name: Online Continual Learning with Category Names Only via Data Generation—0
A-I-RAVEN and I-RAVEN-Mesh: Two New Benchmarks for Abstract Visual Reasoning—0
GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning—0
A Review of Emerging Research Directions in Abstract Visual Reasoning—0
KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinations—0
Language-Conditioned Robotic Manipulation with Fast and Slow Thinking—0
Language-Guided Salient Object Ranking—0
Show:102550
← PrevPage 13 of 14Next →
All datasetsWinogroundNLVR2 DevNLVR2 TestCLEVRERBongard-OpenWorldWinoGAViLVSRPHYRE-1B-CrossPHYRE-1B-WithinVASRIRFL: Image Recognition of Figurative LanguageNLVR

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5—Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25—Unverified
3GPT-4V (pick b/w two options)Text Score69.25—Unverified
4MMICL + CoCoTText Score64.25—Unverified
5GPT-4V + CoCoTText Score58.5—Unverified
6OpenFlamingo + CoCoTText Score58.25—Unverified
7GPT-4VText Score54.5—Unverified
8FIBER (EqSim)Text Score51.5—Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25—Unverified
10MMICL + CCoTText Score51—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51—Unverified
2X2-VLM (large)Accuracy88.7—Unverified
3XFM (base)Accuracy87.6—Unverified
4X2-VLM (base)Accuracy86.2—Unverified
5CoCaAccuracy86.1—Unverified
6VLMoAccuracy85.64—Unverified
7VK-OODAccuracy84.6—Unverified
8SimVLMAccuracy84.53—Unverified
9X-VLM (base)Accuracy84.41—Unverified
10VK-OODAccuracy83.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58—Unverified
2X2-VLM (large)Accuracy89.4—Unverified
3XFM (base)Accuracy88.4—Unverified
4X2-VLM (base)Accuracy87—Unverified
5CoCaAccuracy87—Unverified
6VLMoAccuracy86.86—Unverified
7SimVLMAccuracy85.15—Unverified
8X-VLM (base)Accuracy84.76—Unverified
9BLIP-129MAccuracy83.09—Unverified
10ALBEF (14M)Accuracy82.55—Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24—Unverified
2redherringAverage-per ques.91.14—Unverified
3VRDPAverage-per ques.90.24—Unverified
4FightttttAverage-per ques.88.71—Unverified
5neuralAverage-per ques.88.27—Unverified
6NERVAverage-per ques.88.05—Unverified
7DCLAverage-per ques.75.52—Unverified
8troublesolverAverage-per ques.73.3—Unverified
9v0.1Average-per ques.73.1—Unverified
10First_testAverage-per ques.69.65—Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6—Unverified
2GPT-4o + CA2-Class Accuracy92.8—Unverified
3Human2-Class Accuracy91—Unverified
4SNAIL2-Class Accuracy64—Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8—Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3—Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5—Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3—Unverified
9Otter2-Class Accuracy49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90—Unverified
2ViLT (Zero-Shot)Jaccard Index52—Unverified
3X-VLM (Zero-Shot)Jaccard Index46—Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41—Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40—Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38—Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35—Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15—Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1—Unverified
2ViLTaccuracy69.3—Unverified
3CLIP (finetuned)accuracy65.1—Unverified
4CLIP (frozen)accuracy56—Unverified
5VisualBERTaccuracy55.2—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2—Unverified
2Dec[Joint]1fAUCCESS40.3—Unverified
3Dynamics-Aware DQNAUCCESS39.9—Unverified
4DQNAUCCESS36.8—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS85.2—Unverified
2Dynamics-Aware DQNAUCCESS85.2—Unverified
3Dec[Joint]1fAUCCESS80—Unverified
4DQNAUCCESS77.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9—Unverified
2ConvNeXt1:1 Accuracy51.2—Unverified
3ViT1:1 Accuracy50.3—Unverified
4DEiT1:1 Accuracy47.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100—Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4—Unverified