SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 340 papers

TitleStatusHype
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language ModelsCode0
Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning—0
KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoning—0
AttentionInfluence: Adopting Attention Head Influence for Weak-to-Strong Pretraining Data Selection—0
SEM: Reinforcement Learning for Search-Efficient Large Language Models—0
LLMs Outperform Experts on Challenging Biology Benchmarks—0
Elastic Weight Consolidation for Full-Parameter Continual Pre-Training of Gemma2—0
A Scaling Law for Token Efficiency in LLM Fine-Tuning Under Fixed Compute Budgets—0
Measuring Hong Kong Massive Multi-Task Language Understanding—0
Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients—0
ReasonIR: Training Retrievers for Reasoning TasksCode3
LongPerceptualThoughts: Distilling System-2 Reasoning for System-1 Perception—0
Video-MMLU: A Massive Multi-Discipline Lecture Understanding BenchmarkCode1
SHA256 at SemEval-2025 Task 4: Selective Amnesia -- Constrained Unlearning for Large Language Models via Knowledge IsolationCode0
DataDecide: How to Predict Best Pretraining Data with Small ExperimentsCode3
Transferable text data distillation by trajectory matching—0
Probing then Editing Response Personality of Large Language ModelsCode0
Domain-Adaptive Continued Pre-Training of Small Language Models—0
Large Language Models Could Be Rote Learners—0
Dynamic Cheatsheet: Test-Time Learning with Adaptive MemoryCode3
Task-Circuit Quantization: Leveraging Knowledge Localization and Interpretability for CompressionCode1
GAAPO: Genetic Algorithmic Applied to Prompt Optimization—0
Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning IncentivizationCode2
Sample, Don't Search: Rethinking Test-Time Alignment for Language Models—0
More is Less: The Pitfalls of Multi-Model Synthetic Preference Data in DPO Safety Alignment—0
YourBench: Easy Custom Evaluation Sets for EveryoneCode3
Order Independence With Finetuning—0
Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space ModelsCode2
Effective Skill Unlearning through Intervention and AbstentionCode0
Mobile-MMLU: A Mobile Intelligence Language Understanding BenchmarkCode1
Qwen2.5-Omni Technical ReportCode7
Efficient Model Development through Fine-tuning Transfer—0
ChatBench: From Static Benchmarks to Human-AI EvaluationCode0
Bias Evaluation and Mitigation in Retrieval-Augmented Medical Question-Answering Systems—0
SuperBPE: Space Travel for Language Models—0
LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama—0
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation—0
Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach—0
Effectiveness of Zero-shot-CoT in Japanese Prompts—0
Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework—0
Symbolic Mixture-of-Experts: Adaptive Skill-based Routing for Heterogeneous Reasoning—0
Leveraging Approximate Caching for Faster Retrieval-Augmented Generation—0
Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size—0
KurTail : Kurtosis-based LLM Quantization—0
When an LLM is apprehensive about its answers -- and when its uncertainty is justifiedCode0
None of the Above, Less of the Right: Parallel Patterns between Humans and LLMs on Multi-Choice Questions Answering—0
SCORE: Systematic COnsistency and Robustness Evaluation for Large Language ModelsCode11
PolyPrompt: Automating Knowledge Extraction from Multilingual Language Models with Dynamic Prompt Generation—0
Voting or Consensus? Decision-Making in Multi-Agent DebateCode0
Distill Not Only Data but Also Rewards: Can Smaller Language Models Surpass Larger Ones?—0
Show:102550
← PrevPage 2 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5WafflesFinal_score60.91—Unverified
6raakaFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified