SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 551–600 of 698 papers

TitleStatusHype
Test-time Distribution Learning Adapter for Cross-modal Visual Reasoning—0
Bootstrapping Top-down Information for Self-modulating Slot Attention—0
TextCaps: a Dataset for Image Captioning with Reading Comprehension—0
A Corpus of Natural Language for Visual Reasoning—0
V-PROM: A Benchmark for Visual Reasoning Using Visual Progressive Matrices—0
The Eye of Sherlock Holmes: Uncovering User Private Attribute Profiling via Vision-Language Model Agentic Framework—0
VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges—0
The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task—0
The role of object-centric representations, guided attention, and external memory on generalizing visual relations—0
Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry—0
Think-Program-reCtify: 3D Situated Reasoning with Large Language Models—0
Boosting Multimodal Reasoning with MCTS-Automated Structured Thinking—0
Boosting Cross-task Transferability of Adversarial Patches with Visual Relations—0
BlenderAlchemy: Editing 3D Graphics with Vision-Language Models—0
A Comprehensive Survey of Knowledge-Based Vision Question Answering Systems: The Lifecycle of Knowledge in Visual Reasoning Task—0
A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise—0
Towards A Unified Neural Architecture for Visual Recognition and Reasoning—0
Big Generalizations with Small Data: Exploring the Role of Training Samples in Learning Adjectives of Size—0
Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection—0
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models—0
Towards Truly Zero-shot Compositional Visual Reasoning with LLMs as Programmers—0
Towards Unsupervised Visual Reasoning: Do Off-The-Shelf Features Know How to Reason?—0
Towards Visual Discrimination and Reasoning of Real-World Physical Dynamics: Physics-Grounded Anomaly Detection—0
Transfer Learning in Visual and Relational Reasoning—0
Beyond Visual Understanding: Introducing PARROT-360V for Vision Language Model Benchmarking—0
VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learning—0
Transformers in Vision: A Survey—0
Transformers Utilization in Chart Understanding: A Review of Recent Advances & Future Trends—0
X-Former: Unifying Contrastive and Reconstruction Learning for MLLMs—0
Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning—0
TRRNet: Tiered Relation Reasoning for Compositional Visual Question Answering—0
TVBench: Redesigning Video-Language Evaluation—0
Understanding and Constructing Latent Modality Structures in Multi-modal Representation Learning—0
Beyond Visual Appearances: Privacy-sensitive Objects Identification via Hybrid Graph Reasoning—0
Understanding the computational demands underlying visual reasoning—0
Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models—0
Beyond Task-Specific Reasoning: A Unified Conditional Generative Framework for Abstract Visual Reasoning—0
Weakly Supervised Semantic Parsing with Abstract Examples—0
Human-Aligned Bench: Fine-Grained Assessment of Reasoning Ability in MLLMs vs. Humans—0
Unifying Vision-Language Representation Space with Single-tower Transformer—0
Benchmark Visual Question Answer Models by using Focus Map—0
Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases—0
Abstract Visual Reasoning with Tangram Shapes—0
Grounded Object Centric Learning—0
Automated 3D Physical Simulation of Open-world Scene with Gaussian Splatting—0
VALSE: A Task-Independent Benchmark for Vision and Language Models centered on Linguistic Phenomena—0
Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems—0
A Unified View of Abstract Visual Reasoning Problems—0
Webly Supervised Knowledge Embedding Model for Visual Reasoning—0
Attention on Abstract Visual Reasoning—0
Show:102550
← PrevPage 12 of 14Next →
All datasetsWinogroundNLVR2 DevNLVR2 TestCLEVRERBongard-OpenWorldWinoGAViLVSRPHYRE-1B-CrossPHYRE-1B-WithinVASRIRFL: Image Recognition of Figurative LanguageNLVR

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5—Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25—Unverified
3GPT-4V (pick b/w two options)Text Score69.25—Unverified
4MMICL + CoCoTText Score64.25—Unverified
5GPT-4V + CoCoTText Score58.5—Unverified
6OpenFlamingo + CoCoTText Score58.25—Unverified
7GPT-4VText Score54.5—Unverified
8FIBER (EqSim)Text Score51.5—Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25—Unverified
10MMICL + CCoTText Score51—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51—Unverified
2X2-VLM (large)Accuracy88.7—Unverified
3XFM (base)Accuracy87.6—Unverified
4X2-VLM (base)Accuracy86.2—Unverified
5CoCaAccuracy86.1—Unverified
6VLMoAccuracy85.64—Unverified
7VK-OODAccuracy84.6—Unverified
8SimVLMAccuracy84.53—Unverified
9X-VLM (base)Accuracy84.41—Unverified
10VK-OODAccuracy83.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58—Unverified
2X2-VLM (large)Accuracy89.4—Unverified
3XFM (base)Accuracy88.4—Unverified
4CoCaAccuracy87—Unverified
5X2-VLM (base)Accuracy87—Unverified
6VLMoAccuracy86.86—Unverified
7SimVLMAccuracy85.15—Unverified
8X-VLM (base)Accuracy84.76—Unverified
9BLIP-129MAccuracy83.09—Unverified
10ALBEF (14M)Accuracy82.55—Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24—Unverified
2redherringAverage-per ques.91.14—Unverified
3VRDPAverage-per ques.90.24—Unverified
4FightttttAverage-per ques.88.71—Unverified
5neuralAverage-per ques.88.27—Unverified
6NERVAverage-per ques.88.05—Unverified
7DCLAverage-per ques.75.52—Unverified
8troublesolverAverage-per ques.73.3—Unverified
9v0.1Average-per ques.73.1—Unverified
10First_testAverage-per ques.69.65—Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6—Unverified
2GPT-4o + CA2-Class Accuracy92.8—Unverified
3Human2-Class Accuracy91—Unverified
4SNAIL2-Class Accuracy64—Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8—Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3—Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5—Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3—Unverified
9Otter2-Class Accuracy49.3—Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90—Unverified
2ViLT (Zero-Shot)Jaccard Index52—Unverified
3X-VLM (Zero-Shot)Jaccard Index46—Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41—Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40—Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38—Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35—Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15—Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1—Unverified
2ViLTaccuracy69.3—Unverified
3CLIP (finetuned)accuracy65.1—Unverified
4CLIP (frozen)accuracy56—Unverified
5VisualBERTaccuracy55.2—Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2—Unverified
2Dec[Joint]1fAUCCESS40.3—Unverified
3Dynamics-Aware DQNAUCCESS39.9—Unverified
4DQNAUCCESS36.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamics-Aware DQNAUCCESS85.2—Unverified
2RPINAUCCESS85.2—Unverified
3Dec[Joint]1fAUCCESS80—Unverified
4DQNAUCCESS77.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9—Unverified
2ConvNeXt1:1 Accuracy51.2—Unverified
3ViT1:1 Accuracy50.3—Unverified
4DEiT1:1 Accuracy47.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100—Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4—Unverified