SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 340 papers

TitleStatusHype
Setting Standards in Turkish NLP: TR-MMLU for Large Language Model Evaluation—0
Slimming Down LLMs Without Losing Their Minds—0
YAYI 2: Multilingual Open-Source Large Language Models—0
Spanish and LLM Benchmarks: is MMLU Lost in Translation?—0
SSR: Alignment-Aware Modality Connector for Speech Language Models—0
Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework—0
Step Guided Reasoning: Improving Mathematical Reasoning using Guidance Generation and Step Reasoning—0
SuperBPE: Space Travel for Language Models—0
Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models—0
SUTRA: Scalable Multilingual Language Model Architecture—0
Swallowing the Poison Pills: Insights from Vulnerability Disparity Among LLMs—0
Symbolic Mixture-of-Experts: Adaptive Skill-based Routing for Heterogeneous Reasoning—0
Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models—0
TeacherLM: Teaching to Fish Rather Than Giving the Fish, Language Modeling Likewise—0
The Alignment Ceiling: Objective Mismatch in Reinforcement Learning from Human Feedback—0
The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performance—0
The Claude 3 Model Family: Opus, Sonnet, Haiku—0
The Poison of Alignment—0
The Vulnerability of Language Model Benchmarks: Do They Accurately Reflect True LLM Performance?—0
Uncovering Latent Chain of Thought Vectors in Language Models—0
Tokenization Standards for Linguistic Integrity: Turkish as a Benchmark—0
Towards Multilingual LLM Evaluation for European Languages—0
Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception—0
Towards Uncertainty-Aware Language Agent—0
Transcending Scaling Laws with 0.1% Extra Compute—0
Transferable text data distillation by trajectory matching—0
Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests—0
Understanding Finetuning for Factual Knowledge Extraction—0
Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size—0
Unraveling Indirect In-Context Learning Using Influence Functions—0
Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach—0
Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs—0
Upcycling Large Language Models into Mixture of Experts—0
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content—0
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination—0
BrainTransformers: SNN-LLM—0
B-score: Detecting biases in large language models using response history—0
ChainRank-DPO: Chain Rank Direct Preference Optimization for LLM Rankers—0
Changing Answer Order Can Decrease MMLU Accuracy—0
Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients—0
MIND: Math Informed syNthetic Dialogues for Pretraining LLMs—0
Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning—0
MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures—0
MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design—0
Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference—0
Watson: A Cognitive Observability Framework for the Reasoning of LLM-Powered Agents—0
An Assessment of Model-On-Model Deception—0
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation—0
Model Unlearning via Sparse Autoencoder Subspace Guided Projections—0
MoE-GPS: Guidlines for Prediction Strategy for Dynamic Expert Duplication in MoE Load Balancing—0
Show:102550
← PrevPage 5 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5raakaFinal_score60.91—Unverified
6WafflesFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified