SOTAVerified

MME

MME is a comprehensive evaluation benchmark for multimodal large language models. It measures both perception and cognition abilities on a total of 14 subtasks, including existence, count, position, color, poster, celebrity, scene, landmark, artwork, OCR, commonsense reasoning, numerical calculation, text translation, and code reasoning.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–95 of 95 papers

TitleStatusHype
Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding—0
Re-Imagining Multimodal Instruction Tuning: A Representation ViewCode0
Ultra-High-Frequency Harmony: mmWave Radar and Event Camera Orchestrate Accurate Drone Landing—0
AIDE: Agentically Improve Visual Language Model with Domain Experts—0
MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency—0
Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment—0
Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding—0
MME-Industry: A Cross-Industry Multimodal Evaluation Benchmark—0
Temporal Preference Optimization for Long-Form Video Understanding—0
Expand VSR Benchmark for VLLM to Expertize in Spatial RulesCode0
GFormer: Accelerating Large Language Models with Optimized Transformers on Gaudi Processors—0
Apollo: An Exploration of Video Understanding in Large Multimodal Models—0
EACO: Enhancing Alignment in Multimodal LLMs via Critical Observation—0
Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Heads—0
SAVEn-Vid: Synergistic Audio-Visual Integration for Enhanced Understanding in Long Video Context—0
Enhancing Instruction-Following Capability of Visual-Language Models by Reducing Image Redundancy—0
The economic value of empowering older patients transitioning from hospital to home: Evidence from the 'Your Care Needs You' intervention—0
MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning—0
ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification—0
Temporal Reasoning Transfer from Text to Video—0
DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucination—0
TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable QuestionsCode0
MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?—0
Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine ExperimentCode0
DrVideo: Document Retrieval Based Long Video Understanding—0
RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in Large Vision Language Models—0
Don't Miss the Forest for the Trees: Attentional Vision Calibration for Large Vision Language Models—0
Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language ModelsCode0
A Challenger to GPT-4V? Early Explorations of Gemini in Visual ExpertiseCode0
Silkie: Preference Distillation for Large Visual Language Models—0
ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsCode0
The Use of Symmetry for Models with Variable-size Variables—0
Enhancing the Spatial Awareness Capability of Multi-Modal Large Language Model—0
Benchmarking and In-depth Performance Study of Large Language Models on Habana Gaudi Processors—0
InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and CompositionCode0
Domain Adaptation via Minimax Entropy for Real/Bogus Classification of Astronomical Alerts—0
Multi-Modal Evaluation Approach for Medical Image Segmentation—0
MAAL: Multimodality-Aware Autoencoder-Based Affordance Learning for 3D Articulated ObjectsCode0
MM-GNN: Mix-Moment Graph Neural Network towards Modeling Neighborhood Feature DistributionCode0
MME-CRS: Multi-Metric Evaluation Based on Correlation Re-Scaling for Evaluating Open-Domain Dialogue—0
Machine Learning Methods for Inferring the Number of UAV Emitters via Massive MIMO Receive Array—0
Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation—0
Learning Multilingual Meta-Embeddings for Code-Switching Named Entity Recognition—0
Deep Learning for Hybrid 5G Services in Mobile Edge Computing Systems: Learn from a Digital Twin—0
Scalable K-Medoids via True Error Bound and Familywise Bandits—0
Show:102550
← PrevPage 2 of 2Next →

No leaderboard results yet.