SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 340 papers

TitleStatusHype
Eir: Thai Medical Large Language Models—0
CPL: Critical Plan Step Learning Boosts LLM Generalization in Reasoning Tasks—0
Selective Self-Rehearsal: A Fine-Tuning Approach to Improve Generalization in Large Language Models—0
MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMsCode0
Performance Law of Large Language ModelsCode0
Reasoning Beyond Bias: A Study on Counterfactual Prompting and Chain of Thought Reasoning—0
SelectLLM: Query-Aware Efficient Selection Algorithm for Large Language Models—0
ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language ModelsCode1
BOTS-LM: Training Large Language Models for Setswana—0
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up QuestionsCode4
A deeper look at depth pruning of LLMsCode1
Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design—0
ALLaM: Large Language Models for Arabic and English—0
Compact Language Models via Pruning and Knowledge DistillationCode3
Qwen2 Technical ReportCode13
Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMsCode1
metabench -- A Sparse Benchmark to Measure General Ability in Large Language ModelsCode0
AgentInstruct: Toward Generative Teaching with Agentic Flows—0
Cost-Effective Proxy Reward Model Construction with On-Policy and Active Learning—0
Changing Answer Order Can Decrease MMLU Accuracy—0
EmPO: Emotion Grounding for Empathetic Response Generation through Preference OptimizationCode0
The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleCode1
Training-Free Exponential Context Extension via Cascading KV CacheCode0
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer MergingCode1
Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language ModelsCode1
What Matters in Transformers? Not All Attention is NeededCode2
Pistis-RAG: Enhancing Retrieval-Augmented Generation with Human Feedback—0
Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling—0
DEM: Distribution Edited Model for Training with Mixed Data Distributions—0
Optimised Grouped-Query Attention Mechanism for Transformers—0
Understanding Finetuning for Factual Knowledge Extraction—0
Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model EvaluationCode0
LiveMind: Low-latency Large Language Models with Simultaneous InferenceCode1
ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All ToolsCode14
Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting—0
Input Conditioned Graph Generation for Language AgentsCode0
DataComp-LM: In search of the next generation of training sets for language modelsCode7
The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performance—0
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank AdaptationCode0
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models—0
Reactor Mk.1 performances: MMLU, HumanEval and BBH test results—0
GEB-1.3B: Open Lightweight Large Language Model—0
Quantifying Variance in Evaluation Benchmarks—0
An Empirical Study of Mamba-based Language Models—0
Are We Done with MMLU?Code3
Does your data spark joy? Performance gains from domain upsampling at the end of training—0
MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures—0
Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization FunctionCode0
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding BenchmarkCode3
Spanish and LLM Benchmarks: is MMLU Lost in Translation?—0
Show:102550
← PrevPage 5 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5WafflesFinal_score60.91—Unverified
6raakaFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified