SOTAVerified

Visual Reasoning

Ability to understand actions and reasoning associated with any visual images

Papers

Showing 201250 of 698 papers

TitleStatusHype
Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language UnderstandingCode1
Image Retrieval on Real-life Images with Pre-trained Vision-and-Language ModelsCode1
Beyond Embeddings: The Promise of Visual Table in Visual ReasoningCode1
UPop: Unified and Progressive Pruning for Compressing Vision-Language TransformersCode1
Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMsCode1
LLMs can be Dangerous Reasoners: Analyzing-based Jailbreak Attack on Large Language ModelsCode1
Interpreting and Controlling Vision Foundation Models via Text ExplanationsCode1
Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language ModelsCode1
FiLM: Visual Reasoning with a General Conditioning LayerCode1
FineCops-Ref: A new Dataset and Task for Fine-Grained Compositional Referring Expression ComprehensionCode1
FLAVA: A Foundational Language And Vision Alignment ModelCode1
ClawMachine: Learning to Fetch Visual Tokens for Referential ComprehensionCode1
Forgotten Polygons: Multimodal Large Language Models are Shape-BlindCode1
Forward Prediction for Physical ReasoningCode1
ConTextual: Evaluating Context-Sensitive Text-Rich Visual Reasoning in Large Multimodal ModelsCode1
Context-Aware Alignment and Mutual Masking for 3D-Language Pre-TrainingCode1
BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal ModelsCode1
Visually Grounded Reasoning across Languages and CulturesCode1
From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video UnderstandingCode1
A Survey on Interpretable Cross-modal ReasoningCode1
Compositional Chain-of-Thought Prompting for Large Multimodal ModelsCode1
Visual Semantic Reasoning for Image-Text MatchingCode1
How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMsCode1
KiVA: Kid-inspired Visual Analogies for Testing Large Multimodal ModelsCode1
CLEVR-X: A Visual Reasoning Dataset for Natural Language ExplanationsCode1
Advancing Object Detection in Transportation with Multimodal Large Language Models (MLLMs): A Comprehensive Review and Empirical Testing0
Comparison Visual Instruction Tuning0
Comparing Visual Reasoning in Humans and AI0
Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases0
Integrating LMM Planners and 3D Skill Policies for Generalizable Manipulation0
Guiding Visual Question Answering with Attention Priors0
Automated 3D Physical Simulation of Open-world Scene with Gaussian Splatting0
Advancing Generalization Across a Variety of Abstract Visual Reasoning Tasks0
Grounding Physical Object and Event Concepts Through Dynamic Visual Reasoning0
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning0
A Cognitive Paradigm Approach to Probe the Perception-Reasoning Interface in VLMs0
A Unified View of Abstract Visual Reasoning Problems0
Abstract Visual Reasoning with Tangram Shapes0
Grounded Reinforcement Learning for Visual Reasoning0
GRIT: Teaching MLLMs to Think with Images0
Graph Representation for Order-Aware Visual Transformation0
Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning0
GSON: A Group-based Social Navigation Framework with Large Multimodal Model0
GSR-BENCH: A Benchmark for Grounded Spatial Reasoning Evaluation via Multimodal LLMs0
Code Repair with LLMs gives an Exploration-Exploitation Tradeoff0
Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learning0
Attention on Abstract Visual Reasoning0
HalluSegBench: Counterfactual Visual Reasoning for Segmentation Hallucination Evaluation0
HENASY: Learning to Assemble Scene-Entities for Egocentric Video-Language Model0
Grammar-Based Grounded Lexicon Learning0
Show:102550
← PrevPage 5 of 14Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4o + CAText Score75.5Unverified
2GPT-4V (CoT, pick b/w two options)Text Score75.25Unverified
3GPT-4V (pick b/w two options)Text Score69.25Unverified
4MMICL + CoCoTText Score64.25Unverified
5GPT-4V + CoCoTText Score58.5Unverified
6OpenFlamingo + CoCoTText Score58.25Unverified
7GPT-4VText Score54.5Unverified
8FIBER (EqSim)Text Score51.5Unverified
9FIBER (finetuned, Flickr30k)Text Score51.25Unverified
10MMICL + CCoTText Score51Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy91.51Unverified
2X2-VLM (large)Accuracy88.7Unverified
3XFM (base)Accuracy87.6Unverified
4X2-VLM (base)Accuracy86.2Unverified
5CoCaAccuracy86.1Unverified
6VLMoAccuracy85.64Unverified
7VK-OODAccuracy84.6Unverified
8SimVLMAccuracy84.53Unverified
9X-VLM (base)Accuracy84.41Unverified
10VK-OODAccuracy83.9Unverified
#ModelMetricClaimedVerifiedStatus
1BEiT-3Accuracy92.58Unverified
2X2-VLM (large)Accuracy89.4Unverified
3XFM (base)Accuracy88.4Unverified
4X2-VLM (base)Accuracy87Unverified
5CoCaAccuracy87Unverified
6VLMoAccuracy86.86Unverified
7SimVLMAccuracy85.15Unverified
8X-VLM (base)Accuracy84.76Unverified
9BLIP-129MAccuracy83.09Unverified
10ALBEF (14M)Accuracy82.55Unverified
#ModelMetricClaimedVerifiedStatus
1AI CoreAverage-per ques.95.24Unverified
2redherringAverage-per ques.91.14Unverified
3VRDPAverage-per ques.90.24Unverified
4FightttttAverage-per ques.88.71Unverified
5neuralAverage-per ques.88.27Unverified
6NERVAverage-per ques.88.05Unverified
7DCLAverage-per ques.75.52Unverified
8troublesolverAverage-per ques.73.3Unverified
9v0.1Average-per ques.73.1Unverified
10First_testAverage-per ques.69.65Unverified
#ModelMetricClaimedVerifiedStatus
1Gemini-2.0 + CA2-Class Accuracy93.6Unverified
2GPT-4o + CA2-Class Accuracy92.8Unverified
3Human2-Class Accuracy91Unverified
4SNAIL2-Class Accuracy64Unverified
5InstructBLIP + GPT-42-Class Accuracy63.8Unverified
6BLIP-2 + ChatGPT (Fine-tuned)2-Class Accuracy63.3Unverified
7InstructBLIP + ChatGPT + Neuro-Symbolic2-Class Accuracy55.5Unverified
8ChatCaptioner + ChatGPT2-Class Accuracy49.3Unverified
9Otter2-Class Accuracy49.3Unverified
#ModelMetricClaimedVerifiedStatus
1HumansJaccard Index90Unverified
2ViLT (Zero-Shot)Jaccard Index52Unverified
3X-VLM (Zero-Shot)Jaccard Index46Unverified
4CLIP-ViT-B/32 (Zero-Shot)Jaccard Index41Unverified
5CLIP-ViT-L/14 (Zero-Shot)Jaccard Index40Unverified
6CLIP-RN50x64/14 (Zero-Shot)Jaccard Index38Unverified
7CLIP-RN50 (Zero-Shot)Jaccard Index35Unverified
8CLIP-ViL (Zero-Shot)Jaccard Index15Unverified
#ModelMetricClaimedVerifiedStatus
1LXMERTaccuracy70.1Unverified
2ViLTaccuracy69.3Unverified
3CLIP (finetuned)accuracy65.1Unverified
4CLIP (frozen)accuracy56Unverified
5VisualBERTaccuracy55.2Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS42.2Unverified
2Dec[Joint]1fAUCCESS40.3Unverified
3Dynamics-Aware DQNAUCCESS39.9Unverified
4DQNAUCCESS36.8Unverified
#ModelMetricClaimedVerifiedStatus
1RPINAUCCESS85.2Unverified
2Dynamics-Aware DQNAUCCESS85.2Unverified
3Dec[Joint]1fAUCCESS80Unverified
4DQNAUCCESS77.6Unverified
#ModelMetricClaimedVerifiedStatus
1Swin1:1 Accuracy52.9Unverified
2ConvNeXt1:1 Accuracy51.2Unverified
3ViT1:1 Accuracy50.3Unverified
4DEiT1:1 Accuracy47.2Unverified
#ModelMetricClaimedVerifiedStatus
1Humans1-of-100 Accuracy100Unverified
#ModelMetricClaimedVerifiedStatus
1VisualBERTAccuracy (Dev)67.4Unverified