SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 698 papers

TitleStatusHype
Improving Generalization in Visual Reasoning via Self-Ensemble—0
Improving Scene Graph Classification by Exploiting Knowledge from Texts—0
Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs—0
INFERNO: Inferring Object-Centric 3D Scene Representations without Supervision—0
Integrating LMM Planners and 3D Skill Policies for Generalizable Manipulation—0
Interpretable Visual Reasoning via Probabilistic Formulation under Natural Supervision—0
Introduction to Soar—0
Iterative Search for Weakly Supervised Semantic Parsing—0
Iterative Visual Reasoning Beyond Convolutions—0
It's Not About the Journey; It's About the Destination: Following Soft Paths Under Question-Guidance for Visual Reasoning—0
Jointly Visual- and Semantic-Aware Graph Memory Networks for Temporal Sentence Localization in Videos—0
`Just because you are right, doesn't mean I am wrong': Overcoming a bottleneck in development and evaluation of Open-Ended VQA tasks—0
Just Say the Name: Online Continual Learning with Category Names Only via Data Generation—0
KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinations—0
Language-Conditioned Robotic Manipulation with Fast and Slow Thinking—0
Language-Guided Salient Object Ranking—0
Language-Vision Planner and Executor for Text-to-Visual Reasoning—0
LaViPlan : Language-Guided Visual Path Planning with RLVR—0
Learning Rope Manipulation Policies Using Dense Object Descriptors Trained on Synthetic Depth Data—0
Learning to Act Properly: Predicting and Explaining Affordances from Images—0
Learning to Agree on Vision Attention for Visual Commonsense Reasoning—0
Learning to Collocate Neural Modules for Image Captioning—0
Learning to Compose and Reason with Language Tree Structures for Visual Grounding—0
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios—0
Learning to Stop Overthinking at Test Time—0
Lexical Conceptual Structure of Literal and Metaphorical Spatial Language: A Case Study of ``Push''—0
lilGym: Natural Language Visual Reasoning with Reinforcement Learning—0
LLMs Are Not Yet Ready for Deepfake Image Detection—0
Localizing Before Answering: A Hallucination Evaluation Benchmark for Grounded Medical Multimodal LLMs—0
LogicAD: Explainable Anomaly Detection via VLM-based Text Feature Extraction—0
LOIS: Looking Out of Instance Semantics for Visual Question Answering—0
LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception—0
Look, Remember and Reason: Grounded reasoning in videos with language models—0
LVLM_CSP: Accelerating Large Vision Language Models via Clustering, Scattering, and Pruning for Reasoning Segmentation—0
MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning—0
Making History Matter: History-Advantage Sequence Training for Visual Dialog—0
MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning—0
MAPS: Advancing Multi-Modal Reasoning in Expert-Level Physical Science—0
MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?—0
Measuring CLEVRness: Black-box Testing of Visual Reasoning Models—0
Measuring CLEVRness: Blackbox testing of Visual Reasoning Models—0
MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models—0
MiCo: Multi-image Contrast for Reinforcement Visual Reasoning—0
MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM—0
M-LLM Based Video Frame Selection for Efficient Video Understanding—0
MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning—0
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct—0
MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics?—0
MMSciBench: Benchmarking Language Models on Multimodal Scientific Problems—0
Modeling Gestalt Visual Reasoning on the Raven's Progressive Matrices Intelligence Test Using Generative Image Inpainting Techniques—0
Show:102550
← PrevPage 9 of 14Next →
All datasetsWinogroundNLVR2 DevNLVR2 TestCLEVRERBongard-OpenWorldWinoGAViLVSRPHYRE-1B-CrossPHYRE-1B-WithinVASRIRFL: Image Recognition of Figurative LanguageNLVR

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5—Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25—Unverified
3GPT-4V (pick b/w two options)Text Score69.25—Unverified
4MMICL + CoCoTText Score64.25—Unverified
5GPT-4V + CoCoTText Score58.5—Unverified
6OpenFlamingo + CoCoTText Score58.25—Unverified
7GPT-4VText Score54.5—Unverified
8FIBER (EqSim)Text Score51.5—Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25—Unverified
10MMICL + CCoTText Score51—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51—Unverified
2X2-VLM (large)Accuracy88.7—Unverified
3XFM (base)Accuracy87.6—Unverified
4X2-VLM (base)Accuracy86.2—Unverified
5CoCaAccuracy86.1—Unverified
6VLMoAccuracy85.64—Unverified
7VK-OODAccuracy84.6—Unverified
8SimVLMAccuracy84.53—Unverified
9X-VLM (base)Accuracy84.41—Unverified
10VK-OODAccuracy83.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58—Unverified
2X2-VLM (large)Accuracy89.4—Unverified
3XFM (base)Accuracy88.4—Unverified
4CoCaAccuracy87—Unverified
5X2-VLM (base)Accuracy87—Unverified
6VLMoAccuracy86.86—Unverified
7SimVLMAccuracy85.15—Unverified
8X-VLM (base)Accuracy84.76—Unverified
9BLIP-129MAccuracy83.09—Unverified
10ALBEF (14M)Accuracy82.55—Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24—Unverified
2redherringAverage-per ques.91.14—Unverified
3VRDPAverage-per ques.90.24—Unverified
4FightttttAverage-per ques.88.71—Unverified
5neuralAverage-per ques.88.27—Unverified
6NERVAverage-per ques.88.05—Unverified
7DCLAverage-per ques.75.52—Unverified
8troublesolverAverage-per ques.73.3—Unverified
9v0.1Average-per ques.73.1—Unverified
10First_testAverage-per ques.69.65—Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6—Unverified
2GPT-4o + CA2-Class Accuracy92.8—Unverified
3Human2-Class Accuracy91—Unverified
4SNAIL2-Class Accuracy64—Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8—Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3—Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5—Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3—Unverified
9Otter2-Class Accuracy49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90—Unverified
2ViLT (Zero-Shot)Jaccard Index52—Unverified
3X-VLM (Zero-Shot)Jaccard Index46—Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41—Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40—Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38—Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35—Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15—Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1—Unverified
2ViLTaccuracy69.3—Unverified
3CLIP (finetuned)accuracy65.1—Unverified
4CLIP (frozen)accuracy56—Unverified
5VisualBERTaccuracy55.2—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2—Unverified
2Dec[Joint]1fAUCCESS40.3—Unverified
3Dynamics-Aware DQNAUCCESS39.9—Unverified
4DQNAUCCESS36.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamics-Aware DQNAUCCESS85.2—Unverified
2RPINAUCCESS85.2—Unverified
3Dec[Joint]1fAUCCESS80—Unverified
4DQNAUCCESS77.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9—Unverified
2ConvNeXt1:1 Accuracy51.2—Unverified
3ViT1:1 Accuracy50.3—Unverified
4DEiT1:1 Accuracy47.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100—Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4—Unverified