SOTAVerified

Visual Question Answering

MLLM Leaderboard

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 2177 papers

TitleStatusHype
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and ActionCode2
DreamLLM: Synergistic Multimodal Comprehension and CreationCode2
MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive DiversityCode2
Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous DrivingCode2
MiniGPT-Med: Large Language Model as a General Interface for Radiology DiagnosisCode2
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual ScenariosCode2
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision ModelsCode2
MedPromptX: Grounded Multimodal Prompting for Chest X-ray DiagnosisCode2
MG-LLaVA: Towards Multi-Granularity Visual Instruction TuningCode2
Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert ReasonerCode2
MedM-VL: What Makes a Good Medical LVLM?Code2
MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMsCode2
MDETR - Modulated Detection for End-to-End Multi-Modal UnderstandingCode2
MC-LLaVA: Multi-Concept Personalized Vision-Language ModelCode2
Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language ModelsCode2
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image AnalysisCode2
DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal PerceptionCode2
Calibrated Self-Rewarding Vision Language ModelsCode2
MC-LLaVA: Multi-Concept Personalized Vision-Language ModelCode2
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist CollaborationCode2
Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language ModelsCode2
DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario UnderstandingCode2
A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document UnderstandingCode2
OneLLM: One Framework to Align All Modalities with LanguageCode2
Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context SparsificationCode2
AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMCode2
Doe-1: Closed-Loop Autonomous Driving with Large World ModelCode2
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsCode2
Med-Flamingo: a Multimodal Medical Few-shot LearnerCode2
MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language UnderstandingCode2
Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language ModelsCode2
Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration RateCode2
BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical TasksCode2
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual QuestionsCode2
Efficient Large Multi-modal Models via Visual Context CompressionCode2
BiMediX2: Bio-Medical EXpert LMM for Diverse Medical ModalitiesCode2
LLaVA-Plus: Learning to Use Tools for Creating Multimodal AgentsCode2
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-ExpertsCode2
LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal ModelsCode2
LLMGA: Multimodal Large Language Model based Generation AssistantCode2
Large Continual Instruction AssistantCode2
Beyond Text: Frozen Large Language Models in Visual Signal ComprehensionCode2
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMsCode2
LLaMA-VID: An Image is Worth 2 Tokens in Large Language ModelsCode2
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language ModelCode2
LingoQA: Visual Question Answering for Autonomous DrivingCode2
JourneyDB: A Benchmark for Generative Image UnderstandingCode2
LinVT: Empower Your Image-level Large Language Model to Understand VideosCode2
LOVA3: Learning to Visual Question Answering, Asking and AssessmentCode2
Aligning Modalities in Vision Large Language Models via Preference Fine-tuningCode2
Show:102550
← PrevPage 3 of 44Next →
All datasetsMM-VetViP-BenchVQA v2 test-devBenchLMMMMBenchV*benchVQA v2 valMSRVTT-QAVQA v2 test-stdMMHal-BenchMSVD-QAPlotQA-D1

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MMCTAgent (GPT-4 + GPT-4V)GPT-4 score74.24—Unverified
2Qwen2-VL-72BGPT-4 score74—Unverified
3InternVL2.5-78BGPT-4 score72.3—Unverified
4GPT-4o +text rationale +IoTGPT-4 score72.2—Unverified
5Lyra-ProGPT-4 score71.4—Unverified
6GLM-4V-PlusGPT-4 score71.1—Unverified
7Phantom-7BGPT-4 score70.8—Unverified
8InternVL2.5-38BGPT-4 score68.8—Unverified
9InternVL2-26B (SGP, token ratio 64%)GPT-4 score65.6—Unverified
10Baichuan-Omni (7B)GPT-4 score65.4—Unverified