SOTAVerified

MME

MME is a comprehensive evaluation benchmark for multimodal large language models. It measures both perception and cognition abilities on a total of 14 subtasks, including existence, count, position, color, poster, celebrity, scene, landmark, artwork, OCR, commonsense reasoning, numerical calculation, text translation, and code reasoning.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 95 papers

TitleStatusHype
Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding—0
Re-Imagining Multimodal Instruction Tuning: A Representation ViewCode0
Ultra-High-Frequency Harmony: mmWave Radar and Event Camera Orchestrate Accurate Drone Landing—0
AIDE: Agentically Improve Visual Language Model with Domain Experts—0
MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency—0
Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment—0
Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding—0
MME-Industry: A Cross-Industry Multimodal Evaluation Benchmark—0
Temporal Preference Optimization for Long-Form Video Understanding—0
Expand VSR Benchmark for VLLM to Expertize in Spatial RulesCode0
GFormer: Accelerating Large Language Models with Optimized Transformers on Gaudi Processors—0
Apollo: An Exploration of Video Understanding in Large Multimodal Models—0
EACO: Enhancing Alignment in Multimodal LLMs via Critical Observation—0
Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Heads—0
SAVEn-Vid: Synergistic Audio-Visual Integration for Enhanced Understanding in Long Video Context—0
Enhancing Instruction-Following Capability of Visual-Language Models by Reducing Image Redundancy—0
The economic value of empowering older patients transitioning from hospital to home: Evidence from the 'Your Care Needs You' intervention—0
MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning—0
ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification—0
Temporal Reasoning Transfer from Text to Video—0
DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucination—0
TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable QuestionsCode0
MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?—0
Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine ExperimentCode0
DrVideo: Document Retrieval Based Long Video Understanding—0
Show:102550
← PrevPage 3 of 4Next →

No leaderboard results yet.